hn • r/hackernews
Comment on: How to Block Some of the Bots
the top tier ai scaper and bot defeat companies, they are big business. really they are not grey market at all.the real humans you are seeing, are bots.brightdata is one vendor, they have 150m genuine residential ips, aquired through standard business.
actually, since this was kind of an invitation, i scraped it. the volume is so small compared to the ai corpus, this volume does not cost anything. as i suspected it was a 100% success rate. the only page it did not reach was the one needing authentication. the tests, they were fine. of course, ai knows ascii from this type of data but it wouldn