Below you will find pages that utilize the taxonomy term “web scraping”
🔗 linkblog: my thoughts on 'Bluesky, AI, and the battle for consent on the open web'
- kudos:Lots of interesting reflections here. link to “Bluesky, AI, and the battle for consent on the open web”
a local news dilemma
- kudos:A while ago, the RSS feeds for my local newspaper stopped working (at least with my feed reader), which caused me some consternation as I tried to decide whether to build a workaround or just give up on the Herald-Leader. I believe in supporting local news, so I’ve wanted to find a technical solution to this, but a lot of the decision making is out of my hands, and I don’t really have time on my hands to build myself the kind of webscraper that would be fun to try out.
- kudos:
The RSS feeds for my local newspaper don’t seem to be compatible with my current feed reader, and I’m torn between building myself a web-scrape-to-RSS workaround for the fun of it or just pivoting to another local news source.
🔗 linkblog: my thoughts on 'The rise and fall of robots.txt'
- kudos:Fascinating read on web crawlers and robots.txt link to “The rise and fall of robots.txt”
🔗 linkblog: my thoughts on 'Major critic of X sues after being banned from platform | Ars Technica'
- kudos:The headline obscures something important—that this is about research, access to data, and Terms of Service. Worrying stuff. link to “Major critic of X sues after being banned from platform | Ars Technica”