Reply to this post | See parent post | Go Back

View Post [edit]

Poster:	Jeff Kaplan	Date:	July 11, 2011 10:38:05pm
Forum:	web	Subject:	Re: Cannot access my site which for the longest time was available to me.

if a robots.txt is in place that blocks crawling all pages are blocked in the Wayback Machine for that site including pages captured prior to the robots.txt being put in place.