- Joined
- Jan 16, 2010
- Messages
- 3,874
Is there one?
Because at the moment, it seems like pages are made inaccessible at random because some idiotic domain squatter buys them and decides they need a robots.txt page, which the archive apparently likes to honour retrospectively.
So is there an equivalent where it treats domain owners as seperate people? And only removes pages if the original site owner puts up a robots.txt page rather than any old domain squatter?
Because at the moment, it seems like pages are made inaccessible at random because some idiotic domain squatter buys them and decides they need a robots.txt page, which the archive apparently likes to honour retrospectively.
So is there an equivalent where it treats domain owners as seperate people? And only removes pages if the original site owner puts up a robots.txt page rather than any old domain squatter?