Reply to this post | See parent post | Go Back

View Post [edit]

Poster:	Jeff Kaplan	Date:	November 23, 2011 09:46:17am
Forum:	web	Subject:	Re: Removal Request

Can you please provide examples of urls that have robots.txt that are not being blocked.

How long ago did you email the request for removal?

Reply to this post

Reply [edit]

Poster:	rexman2000	Date:	November 23, 2011 09:49:00am
Forum:	web	Subject:	Re: Removal Request

www.greenstreetct.com for one example

If the site has been shut down and the business is closed... how is someone supposed to add a robots.txt file?

Reply to this post

Reply [edit]

Poster:	Jeff Kaplan	Date:	November 23, 2011 10:05:10am
Forum:	web	Subject:	Re: Removal Request

i'll pass on your question about the site to the wayback team. as for putting a robots.txt in place, the current owner of the domain would have that discretion.

Reply to this post

Reply [edit]

Poster:	rexman2000	Date:	November 23, 2011 10:08:24am
Forum:	web	Subject:	Re: Removal Request

Thanks Jeff...

However.. if the site in question has been shut down.. the business is closed...and the domain not renewed... how does one add the txt file and get the site removed?

They don't.. so do you have a process involved in such a case?

Reply to this post

Reply [edit]

Poster:	Jeff Kaplan	Date:	November 23, 2011 10:12:46am
Forum:	web	Subject:	Re: Removal Request

send a request for removal to infoATarchive.org