Deprecated: Function eregi() is deprecated in /var/www/vhosts/megrisoft.com/httpdocs/kb/global.php on line 90 Deprecated: Function eregi() is deprecated in /var/www/vhosts/megrisoft.com/httpdocs/kb/global.php on line 94 Deprecated: Function ereg() is deprecated in /var/www/vhosts/megrisoft.com/httpdocs/kb/inc/user_session.inc.php on line 92 What is Robots.txt.? Knowledge Base
Knowledge Base by Megrisoft
Internet Knowledge Base 		Glossary    Contact Us
Search  
   
Browse by Category


Knowledge Base by Megrisoft
 Databases
 Hardware
 Internet & WWW
 Abuse
 Domain
 E-mail
 Web Designing
 Web Hosting
 Web Pormotion
 Directories
 Internet Advertising
 Internet Marketing
 Keyword Research
 Link Popularity
 Press Release Service
 Search Engine Optimization
 Search Engine Submission
 Search Engines
 Google
 PPC Search Engines
 Search Bots
 Yahoo
 OperatingSystems
 Programming
 Software
Knowledge Base by Megrisoft .: Internet & WWW .: Web Pormotion .: Search Engines .: Search Bots .: What is Robots.txt.?

What is Robots.txt.?

The robots.txt is a very simple text file that is placed on your root directory. An example would be www.yourdomain.com/robots.txt. This file tells search engine and other robots which areas of your site they are allowed to visit and index.

At it's most simple, a robots.txt file looks like this:

User-agent: *
Disallow:

This one tells all robots (user agents) to go anywhere they want (disallow nothing).
Article 046
Created 7-22-2005
Author megri
Rating

How helpful was this article to you?



Knowledge Base by Megrisoft Web Services Company in India