Robots.txt - Jim Nielsen’s Blog
I realized why I hadn’t yet added any rules to my
robots.txt: I have zero faith in it.
Link tags: scrap
7
Statement on Generative AI | Ben Myers
I endorse this statement.
Mercury by Postlight
Readability is back, but now it’s called Mercury.
kimono : Turn websites into structured APIs from your browser in seconds
This tool for building ScrAPIs is an interesting development—the current trend for not providing a simple API (or even a simple RSS feed) is being interpreted as damage and routed around.
Scrap Ideas — David Cole
David Cole shares the ideas for projects he would like to develop further, but probably never will. I like this a lot (and there are some great ideas in here).
I Don’t Need No Stinking API: Web Scraping For Fun and Profit | Hartley Brody
A handy step-by-step guide to scraping HTML to get data out. Useful for services (—cough—Twitter—cough—) that keep changing the rules of their API use.
Brighton to London, leaving at 14:00 - Accessible UK Train Timetables
A new feature on Matthew Somerville's brilliant train timetable site. Just put /fares at the end of any URL to get the cheapest available fare.