Generate Robots.txt files quickly and easily with this robots.txt generator. Help the search engines properly index your page by using a robots.txt file.
By default this tool will allow the major search engines to crawl every part of your webpage - if there are areas you wish to exclude, simply add them to this file and upload it to your root directory.
Some areas you may wish to exclude from the bots include:
|Default: All robots allowed; all access|
|Action||Robot||Files or directories|
Select folders and/or files
Saving your robots.txt file
Uploading your robots.txt file
NOTE: A robots.txt file does not make areas on your site secure! It will not block bad bots nor protect sensitive areas of your site. There are other techniques you can also use to block bad bots, such as your .htaccess file.