Web Scraping – Multiple posts at once

Currently struggling to foresee how I may manage this, so any help truly appreciated.

Currently running a WooCommerce based site with the Dokan theme. This is all well and good but it requires a lot of communication with clients and I currently don’t have the time, so I’m looking at turning the site in to a search engine type situation. Think Indeed.com / Adzuna.co.uk where they typically scrape careers pages and job boards and turn all that data in to listings on their own site.

I will of course be doing this with permission of the site owner, and want to start with my current clients. The reason for this is that my site would then contain more data. I’m happy to sacrifice my commission in the first instance if need be. But, what I’m hoping I can set up is the following.

Either, with WP classifieds scrape all information from category pages and turn individual listings in to single classified posts with a link to the product on their store.

Or,

basically doing the same but turning the data in to single product files on my store where buyers can check out through my WooCommerce store.

I have a few crawler apps installed but they’re typically turning the page of data in to one post/product.

Any suggestions, documentation to look at would be great. I’m finding it extremely hard to find any helpful information.