Dryad Research Datasets Scraper

Dryad Research Datasets Scraper

Scrape Dryad research datasets by search term, up to a million per run. Every dataset comes with its DOI, title, abstract, authors, keywords, and publication dates. No login or API key. Export to CSV, JSON, Excel, or XML.

Dryad's official API requires registration and rate limits you. This reads the public dataset search results directly, filtered by your search term, and returns each match in one fixed schema. It is built for researchers, librarians, and data analysts who need research data metadata at scale.

Who uses it	What they scrape Dryad for
Researchers	Find datasets in their field for literature review or meta-analysis
Librarians	Build a catalog of open research data for their institution
Data analysts	Gather metadata for trend analysis or data quality assessment
Journal publishers	Monitor datasets associated with published articles

What it does

This Actor collects Dryad research datasets by search term and returns each one as a flat row with its DOI, title, abstract, authors, keywords, and publication dates.

• 🔍 Search by term: pass any free-text query and get matching datasets.
• 📄 Rich metadata: DOI, title, abstract, authors, keywords, and publication dates for each dataset.
• 📊 Scalable: collect up to 1,000,000 datasets per run for paid users.
• 💾 Multiple exports: save results as CSV, JSON, Excel, or XML.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

What you can do with Dryad data

📚 Build a research data catalog.

A librarian runs the Actor with a broad search term like 'ecology' to collect metadata for all matching datasets and import them into the institutional repository.

📈 Track dataset publication trends.

A data analyst runs the Actor weekly with a field-specific query to monitor how many new datasets are published and which topics are trending.

🔗 Find datasets for a literature review.

A researcher runs the Actor with keywords from their review topic to gather all relevant datasets and their DOIs for citation.

🧪 Monitor data sharing compliance.

A journal publisher runs the Actor with article titles to verify that authors have deposited their data in Dryad.

Why choose this scraper

	What you get
No API key	No registration or OAuth, run the Actor
Complete metadata	DOI, title, abstract, authors, keywords, and publication dates
Flexible search	Any free-text query, from broad topics to specific titles
Scalable	Up to 1,000,000 datasets per run for paid users

How it compares

This Actor offers a straightforward search-based approach to Dryad metadata, while the competitor focuses on recent datasets without search filtering.

Feature	ParseForge	Dryad Datasets Scraper - Research Data Metadata
Search by term	Yes	Not listed
Collect recent datasets	Not listed	Yes
DOI	Yes	Yes
Title	Yes	Yes
Abstract	Yes	Yes
Authors	Yes	Yes
Keywords	Yes	Yes
Publication dates	Yes	Yes
Canonical links	Not listed	Yes

Configure the run

Drive the Actor with a search term, and set a maximum number of datasets to collect. The search runs as each dataset is read so only matches reach your dataset. The Input tab lists every parameter.

A first run with the defaults:

{
 "maxItems": 10
}

A larger pull:

{
 "maxItems": 200
}

Free users

Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.

Run it

1. Create a free Apify account with $5 in credit.
2. Open the Dryad Research Datasets Scraper.
3. Set your inputs and any filters, then click Start.
4. Export the results as CSV, Excel, JSON, or XML from the Dataset tab.

Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.

Use with AI agents (MCP)

Give an AI agent live access to Dryad through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/datadryad-datasets-scraper"

Then prompt it in plain language to run the scraper and read back the results.

Troubleshooting

Why am I getting no results?

Check your search term. Try a broader term or remove special characters. Also ensure that the maximum datasets limit is not set too low.

Why am I only getting 10 results?

Free users are limited to 10 items as a preview. Upgrade to a paid plan to collect more datasets.

The Actor is taking too long.

Reduce the maximum datasets limit or narrow your search term to speed up the run.

Some fields are empty in the results.

Not all datasets have complete metadata. Empty fields are normal for datasets that lack that information.

I get an error when exporting to Excel.

Try exporting to CSV or JSON instead. If the problem persists, check the dataset size and reduce the number of items.

FAQ

Question	Answer
Do I need a Dryad API key?	No. This Actor scrapes the public Dryad search pages directly, so no registration or API key is required.
What metadata does each dataset include?	Each dataset row includes its DOI, title, abstract, authors, keywords, and publication dates.
Can I search for a specific dataset?	Yes. Use the search term input to enter a title, author, or keyword, and the Actor will return matching datasets.
How many datasets can I collect?	Free users are limited to 10 items as a preview. Paid users can collect up to 1,000,000 datasets per run.
What formats can I export the results to?	You can export the results as CSV, JSON, Excel, or XML.
Is the data from Dryad open access?	Yes, Dryad is an open data repository, and all datasets are publicly available.
Can I filter by publication date?	The Actor returns publication dates for each dataset, but filtering by date is not currently supported. You can filter the results after export.
Does this Actor download the actual data files?	No, it only collects metadata. To download the data files, you would need to follow the DOI link for each dataset.
Is this Actor suitable for large-scale harvesting?	Yes, paid users can collect up to 1,000,000 datasets per run, making it suitable for large-scale metadata harvesting.
Can I run this Actor on a schedule?	Yes, you can schedule runs in Apify to collect new datasets automatically at regular intervals.

🆘 Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.

⚠️ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Dryad Digital Repository. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.