™
Home
Blog
Contact US
Webtools
Small SEO Tools - Optimize your site for free!
All your keywords, competitors and backlink research in one SEO tool!
Robots.txt Generator
Default - All Robots are:
Allowed
Refused
Crawl-Delay:
Default - No Delay
5 Seconds
10 Seconds
20 Seconds
60 seconds
120 Seconds
Sitemap:
(leave blank if you don't have)
Search Robots:
Google
Same as Default
Allowed
Refused
Google Image
Same as Default
Allowed
Refused
Google Mobile
Same as Default
Allowed
Refused
MSN Search
Same as Default
Allowed
Refused
Yahoo
Same as Default
Allowed
Refused
Yahoo MM
Same as Default
Allowed
Refused
Yahoo Blogs
Same as Default
Allowed
Refused
Ask/Teoma
Same as Default
Allowed
Refused
GigaBlast
Same as Default
Allowed
Refused
DMOZ Checker
Same as Default
Allowed
Refused
Nutch
Same as Default
Allowed
Refused
Alexa/Wayback
Same as Default
Allowed
Refused
Baidu
Same as Default
Allowed
Refused
Naver
Same as Default
Allowed
Refused
MSN PicSearch
Same as Default
Allowed
Refused
Restricted Directories:
The path is relative to root and must contain a trailing slash "/"
Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.
Related Tools
Get Source Code of Webpage
URL Rewriting Tool
Email Privacy
Website Speed Test
Robots.txt Generator
WebPage Size Checker
LATEST BLOGS
How to Download Facebook Videos: A Simple Guide
6 Oct
/
697
views / by
Admin
The complete SEO checklist 2022 that use to rank new websites
2 Jan
/
77630
views / by
Admin
Popular SEO Tools
Plagiarism Checker
Article Spinner / Rewriter
Keyword Position Checker
Grammar Check
Domain Authority Checker
Pagespeed Insights Checker
Reverse Image Search
Page Authority checker
Backlink Checker
Alexa Rank Checker
Backlink Maker
Domain Age Checker
Website Ping Tool
Website Seo Score Checker
Keyword Density Checker
Website Page Size Checker
Word Count Checker
Mozrank Checker
×
Sign In
×
Sign in with your username
Username
Password
×
Sign Up
×
Sign up with your email address
Username
Email
Full Name
Password
×