• Howdy! Welcome to our community of more than 130.000 members devoted to web hosting. This is a great place to get special offers from web hosts and post your own requests or ads. To start posting sign up here. Cheers! /Peo, FreeWebSpace.net

Robots meta tags or Robots txt file


New Member
I just want to know which is more important for webpages crawling or indexing in between Robots meta tags or Robots txt file ?
The very first point is there is big difference between both. The Robot Meta tag option is used to tell the bots not to index any individual files, whereas Robots.txt can be used to restrict access to entire directories as well.
Now it is clear that what exactly your purpose and what you want to instruct the bots. There is no concern to use these both as per your requirements.