Dan Q · @dan
172 followers · 610 posts · Server m.danq.me

Max props to the developer of puppeteer-extra-plugin-stealth, who I just bought a coffee for.

The screen-scraper I wrote to bulk-export data from my Garmin sports tracker (because Garmin's API is "only for corporate partners", which is a magic spell you can say to make me write and open source a screen-scraper that targets your systems) stopped working today. Turns out Cloudflare could detect my automation.

Installed puppeteer-extra-plugin-stealth. Fixed instantly. Awesome.

#screenscraping #puppeteer #opensource

Last updated 2 years ago

Dan Q · @dan
144 followers · 492 posts · Server m.danq.me

A colleague was looking for a calendar showing all the planned UK strike action, so I scraped one: danq.me/strikes-ics

Now you can have your calendar app remind you each day which strikes to support. ✊

#uk #strike #strikes #screenscraping #calendar

Last updated 3 years ago

Dan Q · @dan
44 followers · 122 posts · Server m.danq.me

3 years ago I used a proxy to add RSS to The Far Side's "Daily Dose". Since FreshRSS 1.20.0, I can use XPath Scraping to achieve the same directly in my RSS reader!

Here's how: danq.me/far-side-freshrss-xpat

#rss #freshrss #xpath #screenscraping

Last updated 3 years ago

Tarnkappe.info · @tarnkappeinfo
1529 followers · 3787 posts · Server social.tchncs.de
ITSEC News · @itsecbot
687 followers · 32461 posts · Server schleuss.online