Robots meta tags or Robots txt file

[JJesica]

I just want to know which is more important for webpages crawling or indexing in between Robots meta tags or Robots txt file ?

 

[AdrianG001]

The very first point is there is big difference between both. The Robot Meta tag option is used to tell the bots not to index any individual files, whereas Robots.txt can be used to restrict access to entire directories as well.
Now it is clear that what exactly your purpose and what you want to instruct the bots. There is no concern to use these both as per your requirements.

 

[JJesica]

Thanks for replying the very informative information. Got It.

 

[Jackleo7878]

You can use the Robots.txt file.

 

[Wilsonjacob45]

The very first point is there is big difference between both. The Robot Meta tag option is used to tell the bots not to index any individual files, whereas Robots.txt can be used to restrict access to entire directories as well.

Now it is clear that what exactly your purpose and what you want to instruct the bots. There is no concern to use these both as per your requirements.

HTH!

 

[Daniel165]

The very first point is there is big difference between both. The Robot Meta tag option is used to tell the bots not to index any individual files, whereas Robots.txt can be used to restrict access to entire directories as well.

Now it is clear that what exactly your purpose and what you want to instruct the bots. There is no concern to use these both as per your requirements.

HTH!

Hi @Wilsonjacob45 Thanks for the answer such a great information.

 

[hoststud]

There is little bit difference between robots.txt file and robots meta tags, robots meta tags are used to disallowing single files or pages of the website whereas robots.txt file is used to deindexed whole website or section of website.