minus-squareyetAnotherUser@discuss.tchncs.detoSelfhosted@lemmy.world•Anubis is awesome! Stopping (AI)crawlbotslinkfedilinkEnglisharrow-up1·1 month agoPlus even if they were to implement those features, the challenges would still get increasingly harder the more bot-like a scraper behaves. You can’t prevent scraping entirely but you can certainly prevent scraping that behaves like a DOS attack. linkfedilink
Plus even if they were to implement those features, the challenges would still get increasingly harder the more bot-like a scraper behaves.
You can’t prevent scraping entirely but you can certainly prevent scraping that behaves like a DOS attack.