• Howdy! Welcome to our community of more than 130.000 members devoted to web hosting. This is a great place to get special offers from web hosts and post your own requests or ads. To start posting sign up here. Cheers! /Peo, FreeWebSpace.net
managed wordpress hosting

Robots meta tags or Robots txt file

JJesica

Member
I just want to know which is more important for webpages crawling or indexing in between Robots meta tags or Robots txt file ?
 
The very first point is there is big difference between both. The Robot Meta tag option is used to tell the bots not to index any individual files, whereas Robots.txt can be used to restrict access to entire directories as well.
Now it is clear that what exactly your purpose and what you want to instruct the bots. There is no concern to use these both as per your requirements.
 
The very first point is there is big difference between both. The Robot Meta tag option is used to tell the bots not to index any individual files, whereas Robots.txt can be used to restrict access to entire directories as well.

Now it is clear that what exactly your purpose and what you want to instruct the bots. There is no concern to use these both as per your requirements.

HTH!
 
The very first point is there is big difference between both. The Robot Meta tag option is used to tell the bots not to index any individual files, whereas Robots.txt can be used to restrict access to entire directories as well.

Now it is clear that what exactly your purpose and what you want to instruct the bots. There is no concern to use these both as per your requirements.

HTH!


Hi @Wilsonjacob45 Thanks for the answer such a great information.
 
There is little bit difference between robots.txt file and robots meta tags, robots meta tags are used to disallowing single files or pages of the website whereas robots.txt file is used to deindexed whole website or section of website.
 
Back
Top