Community Membership

This video is available with a RapidWeaver Community subscription. Signup and get instant access to all our videos, priority support, discounts and more.

Monthly $25 Yearly $240 Lifetime $399

Subscribing is quick and easy — you'll have access in less than two minutes. Cancel anytime, no questions asked. More information.

Control How Google Indexes Your Site

In this lesson we're going to use a robots.txt file to control how Google (and other search engines) index your site's content. We'll take a look at a couple of different options for creating a robots.txt file, including using the [RapidBot 2 plugin by Foreground](http://rapidweavercommunity.com/addons/plugins/rapidbot-2) If you don't know what a robots.txt file, or why you should create one, be sure to read [about robots.txt files](https://support.google.com/webmasters/answer/6062608?hl=en) before watching this lesson.

Comments

Turtle

1 year ago

Excellent video of multiple ways to control some bots from indexing your website content.

Video Details