medRxiv Preprints Scraper

medRxiv Preprints Scraper

Scrape medRxiv preprints by keyword, subject, author, or date range, up to a million papers per run. Every record comes with its title, authors, abstract, DOI, subject collection, and posting date. No API key or login. Export to CSV, JSON, Excel, or XML.

medRxiv's official API needs registration and rate limits you. This reads the public preprint listings directly, filtered by search term, subject collection, author, or posting date, and returns each match in one fixed schema.

Who uses it	What they scrape medRxiv for
Epidemiologists	Monitor new preprint evidence on a disease or intervention
Systematic reviewers	Build a corpus of preprints for a living review
Pharma competitive intelligence teams	Track competitor research posted as preprints
Science journalists	Find early findings on a topic before journal publication
Academic researchers	Stay current on preprints in their field

What it does

This Actor collects medRxiv preprint records by search query or direct URL, and returns each paper as a flat row.

• 🔍 Keyword search: enter any term, from 'bacterial infection' to a full title, and get matching preprints.
• 📅 Date range filter: restrict results to papers posted between two dates with Posted From and Posted To.
• 👤 Author filter: narrow to preprints by a specific author name.
• 🏷️ Subject collection: pick from 50+ medical specialties, from Cardiology to Public and Global Health.
• 🔗 Direct URL: paste any medRxiv search URL to scrape exactly that result set.
• 📊 Structured output: each paper is a flat row with title, authors, abstract, DOI, subject, and posting date.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

What you can do with medRxiv data

📈 Track emerging research topics.

A public health researcher runs the scraper weekly with the query 'long covid' and a date range of the last 7 days to see new preprints and decide which to read.

🧪 Build a systematic review corpus.

A systematic reviewer collects all preprints in the Infectious Diseases subject collection from the last year, then exports the CSV to screen titles and abstracts.

💊 Monitor competitor preprints.

A pharma analyst sets the author filter to a competitor's lead scientist and gets every preprint they post, with abstracts, to inform pipeline strategy.

📰 Find early science stories.

A journalist searches for 'cancer vaccine' and sorts by newest to spot preprints that could become news before journal publication.

🎓 Stay current in a specialty.

A cardiologist runs the scraper with subject collection 'Cardiovascular Medicine' and date from last month to keep up with new findings.

Why choose this scraper

	What you get
No API key	Scrape public preprint pages without registering or waiting for rate limits
Full record	Title, authors, abstract, DOI, subject collection, and posting date in one row
Flexible input	Search by keyword, subject, author, date range, or paste a URL
Any volume	Collect up to 1,000,000 papers per run
Export anywhere	CSV, JSON, Excel, or XML for your analysis pipeline

How it compares

This Actor focuses on medRxiv only, with a full set of search filters and a flat row per paper. The competitors below either cover both bioRxiv and medRxiv or offer a subset of fields.

Feature	ParseForge	bioRxiv & medRxiv Preprint Scraper	Medrxiv Preprints Scraper	Medrxiv Scraper
Search by keyword	Yes	Not listed	Not listed	Not listed
Filter by subject collection	Yes	Not listed	Not listed	Not listed
Filter by author	Yes	Not listed	Not listed	Not listed
Filter by date range	Yes	Yes	Not listed	Yes
Full abstract text	Yes	Not listed	Not listed	Yes
DOI	Yes	Yes	Yes	Yes
Export to CSV, JSON, Excel, XML	Yes	Not listed	Yes	Not listed

Configure the run

Drive the Actor from a search query or a direct medRxiv URL, and filters run as each paper is read so only matches reach your dataset. The Input tab lists every parameter.

A first run with the defaults:

{
  "maxItems": 10,
  "searchQuery": "bacterial infection",
  "orderBy": "relevance"
}

A larger pull:

{
  "maxItems": 200,
  "searchQuery": "bacterial infection",
  "orderBy": "relevance"
}

Pricing

Pay-per-result: $0.075 per result collected. You pay only for the results written to your dataset.

Results collected	Approximate cost
100 results	$7.50
1,000 results	$75.00
10,000 results	$750.00

New Apify accounts start with $5 in free credit.

Free users

Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.

Run it

1. Create a free Apify account with $5 in credit.
2. Open the medRxiv Preprints Scraper.
3. Set your inputs and any filters, then click Start.
4. Export the results as CSV, Excel, JSON, or XML from the Dataset tab.

Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.

Use with AI agents (MCP)

Give an AI agent live access to medRxiv through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/medrxiv-scraper"

Then prompt it in plain language to run the scraper and read back the results.

Troubleshooting

Why am I getting no results?

Check that your search query or URL is correct and that the filters are not too restrictive. Try removing the date range or subject collection to see if results appear.

Why did the run stop before reaching my maximum papers?

The scraper stops when there are no more results matching your filters. Try broadening the search or removing some filters.

Why are some papers missing fields like abstract or author?

Some medRxiv records may have incomplete metadata. The scraper returns whatever is available on the page.

Can I scrape a search URL with multiple pages?

Yes. The scraper follows pagination automatically. Set the Maximum papers field to control how many papers to collect.

Why did I get an error when using both searchQuery and startUrl?

These fields are mutually exclusive. Use only one of them per run.

FAQ

Question	Answer
What is medRxiv?	medRxiv is a free online archive for complete but unpublished manuscripts in the medical, clinical, and related health sciences. It is operated by Cold Spring Harbor Laboratory.
Do I need an API key or login?	No. The scraper reads the public medRxiv search pages directly, so no registration or authentication is required.
Can I scrape a specific medRxiv article?	Yes. Paste the article URL into the startUrl field and the scraper will collect that paper's record.
What data does each paper include?	Each row includes the title, authors, abstract, DOI, subject collection, and posting date, among other fields shown in the sample output.
How do I filter by date?	Use the Posted From and Posted To fields with dates in YYYY-MM-DD format. The scraper maps these to medRxiv's limit_from and limit_to filters.
Can I search by author?	Yes. Enter a name in the Author field and the scraper will restrict results to papers where that name appears in the author list.
What subject collections are available?	There are over 50 subject collections, from Addiction Medicine to Urology. Select one from the dropdown or leave it blank for all subjects.
How do I sort the results?	Use the Sort Order field to choose Best Match, Oldest First, or Newest First.
Can I export the data?	Yes. The scraper outputs structured data that you can export as CSV, JSON, Excel, or XML from the Apify dataset.
Is there a limit on how many papers I can scrape?	You can set the Maximum papers field up to 1,000,000 per run. The default is 10.
Can I use both a search query and a start URL?	No. Use either the searchQuery field or the startUrl field, not both. The scraper will use whichever is provided.
Does this scrape bioRxiv too?	No, this Actor is for medRxiv only. For bioRxiv, consider a dedicated bioRxiv scraper.

Related actors

Browse the full ParseForge collection for more scrapers.

🆘 Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.

⚠️ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Cold Spring Harbor Laboratory. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.