DelphiFAQ Home Search:
General :: Web publishing
Information about web publishing, how to maintain, optimize and promote a web site.

Articles:

This list is sorted by recent document popularity (not total page views).
New documents will first appear at the bottom.
Recommended links on this topic:
Featured Article

Googlebot requested a document that does not exist

Question:

I looked through my web server's log files and found a 404 request made by googlebot - for a document that I never had nor ever linked to. How did googlebot come up with that URL?

Answer:

Did you submit a Google sitemap? In this case Google's googlebot will ask your server for a filename that it's fairly sure to not exist, in order to verify that calls for invalid filenames do - as they should - result in a "404" response.


Generated 4:01:51 on May 22, 2018