🔗 linkblog: my thoughts on 'The rise and fall of robots.txt'

14 February 2024 - kudos:

Fascinating read on web crawlers and robots.txt link to “The rise and fall of robots.txt”

🔗 linkblog: my thoughts on 'Major critic of X sues after being banned from platform | Ars Technica'

1 November 2023 - kudos:

The headline obscures something important—that this is about research, access to data, and Terms of Service. Worrying stuff. link to “Major critic of X sues after being banned from platform | Ars Technica”

7 May 2021 - kudos:

What is the most soothing form of digital data collection, and why is it forum scraping?