Andy Reid to Technology@lemmy.worldEnglish • 1 year agoAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comexternal-linkmessage-square101fedilinkarrow-up1860arrow-down114cross-posted to: technology@beehaw.org
arrow-up1846arrow-down1external-linkAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comAndy Reid to Technology@lemmy.worldEnglish • 1 year agomessage-square101fedilinkcross-posted to: technology@beehaw.org
minus-square@Sorgan71@lemmy.worldlinkfedilinkEnglish-4•1 year agogood. robots.txt was always a bad idea
minus-square@Reddfugee42@lemmy.worldlinkfedilinkEnglish7•1 year agoLike so many terrible ideas, it worked flawlessly for generations
good. robots.txt was always a bad idea
Like so many terrible ideas, it worked flawlessly for generations