☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to technology@hexbear.netEnglish · 2 months agoReddit will block the Internet Archivewww.theverge.comexternal-linkmessage-square6linkfedilinkarrow-up132arrow-down10cross-posted to: reddit@lemmy.worldreddit@lemmy.mltechnology@lemmygrad.mlredditwasfun@lemmy.worldnews@lemmy.worldtechnology@lemmy.worldfedibridge@lemmy.dbzer0.comtechnology@piefed.socialtechnology@lemmy.zip
arrow-up132arrow-down1external-linkReddit will block the Internet Archivewww.theverge.com☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to technology@hexbear.netEnglish · 2 months agomessage-square6linkfedilinkcross-posted to: reddit@lemmy.worldreddit@lemmy.mltechnology@lemmygrad.mlredditwasfun@lemmy.worldnews@lemmy.worldtechnology@lemmy.worldfedibridge@lemmy.dbzer0.comtechnology@piefed.socialtechnology@lemmy.zip
minus-squareLargeAdultRedBook [none/use name]@hexbear.netlinkfedilinkEnglisharrow-up1·2 months agoHow so? Do archive services not also archive content from linked CDNs?
minus-squareThermonuclearEgg [she/her, they/them]@hexbear.netlinkfedilinkEnglisharrow-up2·2 months agoMaybe I’m mistaken but I have heard the Internet Archive applies robots.txt retroactively
How so? Do archive services not also archive content from linked CDNs?
Maybe I’m mistaken but I have heard the Internet Archive applies robots.txt retroactively