This site is doing exactly what I hoped it would do. I have been looking for a way to find hikes on AllTrails so that I could sort and categorize them without having to key ion all of the data.
Structured data
from any site.
Call one over HTTP and it returns clean, schema-checked JSON. You never write a selector, rotate a proxy, or wake up to a column of nulls.
POST api.apify.com/v2/acts/parseforge~nasdaq-short-interest-scraper/run-sync-get-dataset-itemsThe library
The library, at its real size.
One dot per published scraper, all 1,832 of them. Keep scrolling and they sort themselves busiest first, so the top rows are the ones carrying six figures of runs on their own.
Coverage
What we cover.
Counts come straight from the live catalogue. Click a category to browse everything in it.
What we own
Five things break scrapers. We own all five.
- 01
Requests that come from real homes
Residential IPs, country-matched to the source. Half the web answers differently to a cloud IP, and that is the failure most scrapers never notice.
- 02
A connection the site accepts
Real-Chrome TLS, a Firefox fingerprint, or a full browser, chosen per source. A JA4 mismatch is a 403 that no header will fix.
- 03
Each scraper is written for one site
Every Actor is written against one source's real markup or private API. No generic crawler guessing at your fields.
- 04
A schema that fails loudly
Output is validated against a declared dataset schema, so upstream drift surfaces as an error instead of a column of silent nulls.
- 05
Watched, and fixed
Runs are monitored for failures and empty results. When a site changes, the Actor gets fixed. Your integration contract does not move.
The factory
How the library gets built.
A line of agents finds the source, builds the scraper, tests it against the live site, publishes it, then keeps re-running it. Scroll to follow one job along the line.
- 01
Scouts
Look for sources worth having, and check nobody has built them yet.
- 02
Builders
Write the scraper, work out how to reach the site, and shape the output.
- 03
Inspectors
Run it for real and reject anything that comes back empty or wrong.
- 04
Publishers
Document it, price it, and put it in the public library.
- 05
Keepers
Re-run everything on a clock and repair whatever the web broke.
Keepers hand failures back to Builders, so the line runs continuously. That is why the count at the top of this page keeps moving.
What you can pull
A few of the sources.
Eight of them, in their own words. Click any one to open it. There are 1,832 more where these came from.
Still standing
Scrapers rot if nobody tends them.
Sites change constantly, so most public scraper collections are half-dead within a year. Here is what keeping this one alive looks like in numbers.
- Ran in the last 7 days
- 1,829of 1,832
- Not one Actor in the library sat idle for a week.
- Rebuilds shipped
- 32,108
- Each one is a scraper rebuilt and re-tested against its live source.
- Rated by users
- 4.64/ 5
- Across 144 reviewed Actors and 434 bookmarks.
Reviews
What people wrote on the store.
Every quote below is a five star review left on Apify, printed exactly as it was typed. The one line ones are not here, because "works well" tells you nothing. Each quote links to the scraper it was written about.
Solid scraper. Pulled the Gumtree job listings I needed with clean salary and location fields, no issues. Saved me a bunch of manual work. Thanks!
I didn't expect it to be this powerful after the iteration. I hope it continues to improve
I tested it, and I was able to get auction listings from Copart, and it is doing well.
This scraper saved me at least 5 hrs a week looking for deals and comps.
Works very well. Got me the listings I needed fast. 5 stars
Excellent actor. Does exactly what it says it does. Saves me hours searching for deals each week. It's turning into my competitive advantage in my market.
Integrate
Two ways to call it.
Write the request yourself, or hand the job to an assistant and paste it the words. Either way it runs on demand, on a schedule, or on a webhook, and exports as JSON, CSV, Excel or XML.
curl -X POST "https://api.apify.com/v2/acts/\
parseforge~ebay-scraper/runs?token=$APIFY_TOKEN" \
-H "Content-Type: application/json" \
-d '{ "searchQuery": "leica m6", "maxItems": 50 }'Every scraper takes the same call. Swap the slug, keep everything else.
Custom build
Missing a source?
Send the site and the fields you need. We build it, you get it first, and it joins the public library.
Before you integrate
Straight answers.
Where do the Actors run?
On Apify, called with your own token. You inherit that platform's scheduling, webhooks, storage and monitoring for every Actor in the library.
What happens when a site changes?
Runs are watched for failures and empty results. The Actor gets repaired and rebuilt; the API contract you integrated against stays identical.
Can I get something other than JSON?
Yes. Results live in a dataset you can export as JSON, CSV, Excel or XML, or page through over the API.
What if my source isn't in the library?
Send it below. We build Actors to order, and the finished one joins the public library.
What about sites behind logins or hard anti-bot walls?
We scrape publicly accessible data only. Where a source is genuinely walled, we say so rather than shipping an Actor that returns nothing.