Search code examples
robots.txtgoogle-crawlersgoogle-index

robots.txt content itself is indexed?


The contents of my robots.txt file are actually itself indexed and show up in Google search results. It's only Google and not Yahoo for example.

I really think Google should understand not to index the contents of my robots file as it's only there to tell Google what not to index!

Am I missing something here?


Solution

  • That's normal. Mine was indexed a few months ago too. I think it's an issue with the crawler. edit: btw, you can delete the link on the webmaster tools website.