Reply to this post | Go Back

View Post [edit]

Poster:	yongtao	Date:	September 04, 2012 02:26:02am
Forum:	web	Subject:	robots.txt

I put robots.txt on my sites(you may access it as http://www.lehmanco.com/robots.txt), but the archived pages still can be access on the backway machine, what can I do?

Reply to this post

Reply [edit]

Poster:	Jeff Kaplan	Date:	September 05, 2012 12:32:23am
Forum:	web	Subject:	Re: robots.txt

Take down requests can be sent to info@archive.org.

Reply to this post

Reply [edit]

Poster:	Hydriz	Date:	September 04, 2012 11:23:05pm
Forum:	web	Subject:	Re: robots.txt

The change isn't instant, might take a few weeks, months or at most a year before the archived pages are removed off the Wayback machine.