FedSearch - Federated network search engine

Dan Q · @dan

172 followers · 610 posts · Server m.danq.me

Max props to the developer of puppeteer-extra-plugin-stealth, who I just bought a coffee for.

The screen-scraper I wrote to bulk-export data from my Garmin sports tracker (because Garmin's API is "only for corporate partners", which is a magic spell you can say to make me write and open source a screen-scraper that targets your systems) stopped working today. Turns out Cloudflare could detect my automation.

Installed puppeteer-extra-plugin-stealth. Fixed instantly. Awesome.

#ScreenScraping #puppeteer #OpenSource

#screenscraping #puppeteer #opensource

Last updated 2 years ago

Original post

Dan Q · @dan

144 followers · 492 posts · Server m.danq.me

A colleague was looking for a calendar showing all the planned UK strike action, so I scraped one: https://danq.me/strikes-ics

Now you can have your calendar app remind you each day which strikes to support. ✊

#UK #strike #strikes #ScreenScraping #calendar

#uk #strike #strikes #screenscraping #calendar

Last updated 3 years ago

Original post

Dan Q · @dan

44 followers · 122 posts · Server m.danq.me

3 years ago I used a proxy to add RSS to The Far Side's "Daily Dose". Since FreshRSS 1.20.0, I can use XPath Scraping to achieve the same directly in my RSS reader!

Here's how: https://danq.me/far-side-freshrss-xpath

#RSS #FreshRSS #XPath #ScreenScraping

#rss #freshrss #xpath #screenscraping

Last updated 3 years ago

Original post