minus-squarebodiesofeverest@lemmy.worldtoTechnology@kbin.social•Google Says It'll Scrape Everything You Post Online for AIlinkfedilinkarrow-up1·2 years agoOh and they won’t. We had a lengthy verification process where we proved we owned these sites we didn’t want aggregated and they still refused to honor robots.txt. linkfedilink
Oh and they won’t. We had a lengthy verification process where we proved we owned these sites we didn’t want aggregated and they still refused to honor robots.txt.