23 points darkwater 35 minutes ago 10 comments
tempest_ 11 minutes ago | parent
I assume this is because of LLM scraping.
nijave 9 minutes ago | parent
Presumably but I wish they'd also focus on optimizing code/making pages fully cacheable instead of rate-limits and blocking
Frieren 8 minutes ago | parent
We need a new non-commercial version of the internet. Free of bots, free of ads, ... you pay to access social media optimized to be interesting enough to be worth paying instead of addictive enough to keep you scrolling to show you more ads.
It may look impossible right now. But what is impossible for real is to continue as we are. The damage that internet does to society is increasing by the day while its value is reduced (economic value, social value).
ddtaylor 8 minutes ago | parent
> A request that arrives with no credentials gets 60 requests per hour per IP address.
One request per minute.
mplanchard 5 minutes ago | parent
Average, yes, but the way they phrase it, it could be a token bucket or similar, where you can do 60 quick requests and then be blocked for a bit while the bucket refills
sparkling 6 minutes ago | parent
I noticed that recently Github.com has some kind of weird bot detection on public repos. I have a browser extension for switching User Agents for a specific legacy site, sometimes i forget to turn it off and Github will require me to login to view public repos.
All of this is most likely due to mass scraping by LLMs. Welcome to the total shitification of the web.
296012 6 minutes ago | parent
Congrats on making the world worse with AI. All this performative data scraping and uploading and no progress at all.
jtwaleson 6 minutes ago | parent
I think it's because people are building agentic flows, reducing the amount of developer seats needed. It's the first step towards usage based pricing.