02 Oct 09 1:45 am
Google blocks part of my site because it's "not found" ???
I have a site at 18.104.22.168 and Google's bots have been routinely stopping by each week for months now. And every time they come to my site. AdSense Site Diagnostics advises me that 22.214.171.124/gallery is a blocked url because it's "not found."
Not found? Not only is it there, but literally everything on my site is in that directory.
If anyone can shed light on why this may be happening, I'd really appreciate hearing it. Google says this may happen when the robots.txt file excludes them or when the site was down at the time Google tried to crawl it. Neither of these cases apply.
I have hundreds of pages of original content adsense pages that are sitting there hidden from everyone, and no idea why this is happening!