Ask HN: Whats a modern way to parse data from webpages at interval?
I'm doing a personal project where I'd like to get different data from maybe 100 or so webpages every day (or maybe more often) and store them for future use/processing.
Its been a while since I did programming (used to do PHP/JS in another lifetime) so I thought I'd ask here whats the modern way of doing this thats also easy to implement?
Dunno if on my own PC, buy even better somewhere online where I'd set it up and forget about it for a while. Serverless seems to be a thing these days - is there a simple (newbie) way to set this up with JS snipplets somewhere? Have been reading about Cloudflare workers - are they a good fit for this? Could you retrieve pages a list of pages at interval, get their DOM and send parsed data somewhere?