Education scrapers
Education scrapers cover scholarly sources and open media catalogues. Openverse Media Scraper returns media rows, while OpenAlex Scholarly Works Scraper covers scholarly works.
324 scrapers, busiest first.
-
GreatSchools District Scraper Scrapes GreatSchools district profiles by state, city, or direct URL. -
Rate My Professors & Schools Scraper Scrapes professor and school profiles from Rate My Professors by search query or direct URL. -
Openverse Media Scraper Scrapes openly licensed images and audio from Openverse by search term, media type, license, source, and aspect ratio. -
Semantic Scholar Scraper Scrapes academic papers from Semantic Scholar search results. -
ClinicalTrials.gov Scraper Scrapes clinical trial records from ClinicalTrials.gov by search query or direct URL. -
TMDB Movies, TV Shows and People Scraper Scrapes TMDB movie, TV show, and person records by search term or curated list (popular, trending, top-rated, now playin -
Wikimedia Commons Media Scraper Scrapes media file metadata from Wikimedia Commons by search query, category, or exact File: titles. -
arXiv Preprint Scraper Scrapes arXiv preprints by search query, category, or paper ID and returns each paper's metadata as a flat row. -
Hugging Face Papers Scraper Scrapes Hugging Face papers by search query or trending feed. -
OpenAlex Scholarly Works Scraper Scrapes OpenAlex scholarly works, authors, institutions, sources, concepts, publishers, and funders. -
Open Library Books Scraper Scrapes Open Library books by search query, subject, author, list, or direct URL. -
Unpaywall Article Metadata Scraper Scrape scholarly article metadata from the Unpaywall database by title search. -
Coursera Scraper Scrapes Coursera course listings by search query, returning ratings, review counts, difficulty levels, skills, and enrol -
medRxiv Preprints Scraper Scrapes medRxiv preprint records by search query or direct URL. -
Library of Congress Scraper Scrapes Library of Congress items by format, search term, language, date range, or collection. -
PLOS Journals Scraper Scrapes PLOS ONE search results and returns each article as a flat row with title, authors, abstract, publication date, -
DOAJ Open Access Journals Scraper Scrapes journal metadata from the DOAJ API. -
Justia Case Law Scraper Scrapes Justia case law by court and year range. -
Crossref DOI Metadata Scraper Scrapes Crossref publication metadata by search query, title, author, or specific DOI. -
Niche Schools & Colleges Scraper Scrapes Niche ranking lists for K-12 schools, districts, and colleges. -
NASA Technical Reports Scraper Scrapes NASA NTRS for technical reports by search query, author, center, or document type. -
Open Citations Scraper Scrapes citation records from OpenCitations by DOI, PMID, or OMID. -
DataCite Metadata Scraper Scrapes DataCite metadata records by search term, repository, publisher, resource type, year, or specific DOI. -
India Supreme Court Judgments Scraper Scrapes judgments from the Supreme Court of India's eSCR portal. -
iNaturalist Observations Scraper Scrapes iNaturalist wildlife observations by taxon, place, or date. -
NSF Research Grants Scraper Scrapes NSF research grants by keyword, state, program, or date range. -
Semantic Scholar Author Profiles Scraper Scrapes Semantic Scholar author profiles by name search or author ID. -
CORDIS EU Research Projects Scraper Scrapes EU research projects from the CORDIS public database by keyword or CORDIS query syntax. -
Open Library Authors Scraper Scrapes Open Library author profiles by search query or URL. -
Udemy Scraper Scrapes Udemy courses, instructors, and reviews from course URLs or sitemap discovery. -
UN Comtrade Trade Statistics Scraper Scrapes UN Comtrade international trade records by reporter, partner, commodity, and year. -
Etymonline Word Etymology Scraper Scrapes word etymologies from Etymonline by keyword search or direct word lookup. -
EU Clinical Trials EMA CTIS Scraper Scrapes EU clinical trials from the EMA CTIS register by search term, status, or phase. -
ORCID Researcher Profile Scraper Scrapes ORCID researcher profiles by search query, institution, or ORCID ID. -
wger Exercise Database Scraper Scrapes exercises from the wger open fitness database. -
Udacity Course Scraper Scrapes Udacity course and nanodegree listings by search query or school filter. -
DOAB Open Access Books Scraper Scrapes open access book records from the Directory of Open Access Books by search query, language, subject, or publishe -
USDA FoodData Central Scraper Scrapes USDA FoodData Central for food nutrition data. -
NIH RePORTER Scraper Scrapes NIH RePORTER research projects by keyword, agency, or fiscal year. -
Europe PMC Literature Scraper Scrapes Europe PMC biomedical literature by search query and returns each article as a flat row with abstracts, authors, -
MusicBrainz Scraper Scrapes MusicBrainz artists, releases, and recordings by search query with optional country and type filters. -
College Scorecard Scraper Scrapes U.S. -
GeoNames Places Scraper Scrapes GeoNames places, postal codes, and country dumps. -
TheMealDB Recipes Scraper Scrapes recipes from TheMealDB by search, category, area, ingredient, or random. -
RePEc Economics Papers Scraper Scrapes economics papers from a RePEc series handle and returns each paper as a flat row with title, authors, abstract, -
Statistics Canada Web Data Service Scraper Scrapes Statistics Canada's Web Data Service for catalogue entries, cube metadata, coordinate observations, and vector t -
DEV.to Articles Scraper Scrapes DEV.to articles by tag, top week, latest, or username. -
PyPI Packages Scraper Scrapes PyPI package metadata by exact name or keyword search. -
Project Gutenberg Books Scraper Scrapes Project Gutenberg book metadata via the Gutendex API. -
Wikidata Entity Search Scraper Scrapes Wikidata entity search results by term, language, and type. -
NASA Near-Earth Asteroids Scraper Scrapes near-Earth asteroid data from NASA's NeoWs API. -
TheCocktailDB Drink Recipes Scraper Scrapes cocktail recipes from TheCocktailDB by search or filter. -
Zenodo Research Repository Scraper Scrape Zenodo research records by search query, community, or resource type. -
Open Targets Platform Scraper Scrapes target, disease, and drug entities from the Open Targets Platform by ID or free-text search. -
HAL Open Science Scraper Scrapes research publications from HAL Open Science by query, document type, domain, or year. -
Figshare Research Data Scraper Scrapes Figshare research items by search, category, institution, or date. -
Stack Exchange Q&A Scraper Scrapes Stack Exchange questions and answers by site, tag, search query, or date range. -
Open Trivia DB Quiz Questions Scraper Scrapes trivia questions from Open Trivia DB with optional category, difficulty, and type filters. -
Medscape Disease & Condition Scraper Export Medscape disease and condition reference articles: title, overview, etiology, presentation, workup and treatment -
IETF Datatracker Documents Scraper Scrapes IETF Datatracker documents by type, working group, state, and date window. -
OECD SDMX Statistics Scraper Scrape OECD economic and social statistics via the SDMX REST API. -
IBGE Brazil Statistics Scraper Scrapes official Brazilian statistics from the IBGE SIDRA database by mode: localidades, aggregate catalogue, data obser -
Wikivoyage Travel Articles Scraper Scrapes full Wikivoyage travel articles by destination title or keyword search in any supported language. -
OEIS Integer Sequences Scraper Scrapes OEIS integer sequences by search query, A-number list, or keyword filter. -
Europeana Cultural Heritage Scraper Scrapes Europeana's 60M+ cultural heritage items by search query and optional filters. -
Wikipedia Page Summaries Scraper Scrapes Wikipedia page summaries by direct title or keyword search. -
WHO GHO Health Indicators Scraper Scrapes WHO Global Health Observatory indicators and returns each fact as a flat row with indicator code, country, year, -
INE Portugal Statistics Scraper Scrapes INE Portugal statistics by indicator code, theme, or catalogue. -
Drugs.com Medication Scraper Scrape drug/medication information from Drugs.com including drug name, drug class, generic name, brand names, descriptio -
OBIS Ocean Biodiversity Scraper Scrapes OBIS Ocean Biodiversity Information System data: occurrence records, species checklists, statistics, and dataset -
Yu-Gi-Oh! Card Database Scraper Scrapes Yu-Gi-Oh! card records from the official database. -
INE Spain Statistics Scraper Scrapes official INE Spain statistical operations, tables, datasets, and time series. -
Docker Hub Container Images Scraper Scrapes Docker Hub container images by keyword search or direct owner/name lookup. -
ChEMBL Molecules Scraper Scrapes ChEMBL molecules by name substring, ChEMBL ID, or molecule type. -
Open Library Editions Scraper Scrapes Open Library edition metadata by ISBN list or work key. -
Wikipedia Pageviews Scraper Scrapes Wikipedia pageview counts for a list of articles from the Wikimedia REST API. -
GBIF Biodiversity Data Scraper Scrapes GBIF species search results and occurrence records. -
Metropolitan Museum of Art Scraper Scrapes artwork records from the Metropolitan Museum of Art's open-access collection by search query, department ID, or -
RCSB PDB Protein Structure Scraper Scrapes RCSB PDB protein structure metadata by keyword search or PDB ID list. -
Crates.io Rust Crates Scraper Scrapes Rust crate metadata from crates.io by search, name lookup, or sorted feeds. -
CelesTrak Satellites Orbital Catalog Scraper Scrapes satellite orbital data from CelesTrak by group, NORAD ID, or international designator. -
REST Countries Reference Data Scraper Pull rich reference data on every country: official + common names, capital, currencies, languages, region, demonym, cal -
Dictionary Word Definitions Scraper Scrapes word definitions, synonyms, pronunciations, and etymologies from Dictionary.com and Thesaurus.com. -
OSF Open Science Framework Scraper Scrapes public OSF research projects, preprints, and registrations by keyword, provider, or subject. -
NCI GDC Cancer Genomics Scraper Scrapes NCI Genomic Data Commons public endpoints for projects, cases, files, or annotations. -
Kaggle Datasets Scraper Scrapes Kaggle dataset listings by search term, tag, file type, license, or size. -
Stack Exchange Questions Scraper Scrapes Stack Exchange questions by site, search term, and tags. -
ONS UK Statistics Scraper Scrapes the ONS Beta API for UK statistics. -
India Postal PIN Code Scraper Scrapes Indian post office details by 6-digit PIN code or branch name. -
RxNorm Drug Concepts Scraper Scrapes RxNorm drug concepts from the NLM by ingredient name, RxCUI, or term type. -
NASA Astronomy Picture of the Day Scraper Scrapes NASA's Astronomy Picture of the Day archive by date, range, or random sample. -
UniProt Protein Sequence & Annotation Scraper Scrapes UniProt protein entries by search query or accession and returns each one as a flat row with gene names, organis -
UKRI Gateway to Research Scraper Scrapes UKRI Gateway to Research projects matching a free-text search query. -
Urban Dictionary Definitions Scraper Scrapes Urban Dictionary for slang definitions, examples, votes, and author info. -
Argentina Open Data Scraper Scrapes Argentina's open data portal datos.gob.ar. -
ICD-10-CM, LOINC & Clinical Terminology Scraper Scrapes ICD-10-CM diagnosis codes, LOINC lab observations, RxTerms drugs, and other clinical terminology from the NLM Cl -
REST Countries Scraper Scrapes country data from REST Countries API by region or name search. -
Wiktionary Definitions Scraper Scrapes Wiktionary definitions for a list of words from 10 language editions. -
Allrecipes Recipe Scraper Scrapes Allrecipes recipe listings by search term and optional category. -
disease.sh Global Health Stats Scraper Scrapes disease.sh for COVID-19 and vaccine statistics by country, US state, continent, or global totals. -
OpenFDA Drug Adverse Events & Recall Scraper Scrapes drug adverse events, drug labels, and food enforcement recalls from the openFDA public API. -
University Rankings Mega Pack Scraper Scrapes university rankings, institutional data, and online courses from Shanghai ARWU, THE Impact Rankings, US College -
CDC WONDER Mortality Data Scraper Scrapes aggregated mortality counts and population data from CDC WONDER databases. -
EMA Medicines Scraper Scrapes the EMA medicines registry returning name, active substance, therapeutic area, status, marketing authorisation h -
ICD-10 Codes Scraper Scrapes official ICD-10 and ICD-9 medical codes by keyword or code prefix and returns each match as a flat row with desc -
USGS Water Services Scraper Scrapes USGS water data including instantaneous values, daily summaries, and groundwater levels by site code and paramet -
RxList Drug Information Scraper Scrapes RxList drug entries by starting letter and returns each drug as a flat row with generic name, brand names, drug -
REST Countries Info Scraper Scrapes country information from the REST Countries API. -
LinkedIn Learning Courses Scraper Scrapes LinkedIn Learning courses by search query and returns each course as a flat row with title, instructor, duration -
Colombia Open Data Scraper Scrapes any public dataset from datos.gov.co by its resource ID. -
GBIF Occurrence Search Scraper Scrapes GBIF occurrence records by taxon, scientific name, country, year range, or record type and returns each record a -
Drugs@FDA Approvals Scraper Scrapes drug approval records from the FDA's Drugs@FDA database. -
ISS & Satellite Live Position Scraper Collects live position snapshots for the International Space Station and returns each one as a flat row with coordinates -
Tatoeba Sentence Corpus Scraper Scrapes Tatoeba sentences and translations by language pair, search term, or tag. -
EU Clinical Trials Register Scraper Scrapes clinical trial records from the EU Clinical Trials Register by keyword and status. -
RFC Editor Index Scraper Scrapes RFC metadata from the RFC Editor index. -
Internet Archive Search Scraper Scrapes Internet Archive items from a Lucene search query with optional filters for collection, media type, creator, and -
KEGG Pathways Scraper Scrapes KEGG pathways, modules, and orthology entries by list, keyword search, or specific ID. -
Canada Open Data Catalog Scraper Scrapes Canada's open data catalog, returning each dataset as a flat row with title, description, organization, license, -
openFDA Medical Device Events Scraper Scrapes medical device adverse event reports from the openFDA database. -
openFDA Drug Adverse Events Scraper Scrapes adverse event reports from the FDA's openFDA API. -
openFDA Drug NDC Directory Scraper Scrapes the FDA National Drug Code Directory via openFDA. -
Wikidata Lexemes Scraper Scrapes Wikidata lexemes by lemma search, language QID, or lexical category QID. -
MIT OpenCourseWare Scraper Scrapes MIT OpenCourseWare course listings by search query, department, or level. -
Yummly Recipe Scraper Scrapes Yummly recipes by search query and returns each recipe as a flat row with title, URL, and metadata. -
Dutch CBS Statistics Scraper Scrapes Dutch CBS statistics tables and catalog entries. -
Nos Deputes France Parliament Scraper Scrapes French deputy profiles from nosdeputes.fr. -
Open5e SRD 5.1 Scraper Scrapes Open5e SRD 5.1 entries by resource type, search query, challenge rating, spell level, or source document. -
DailyMed FDA Drug Labels Scraper Scrapes FDA drug labels from the DailyMed database. -
Art Institute of Chicago Scraper Scrapes the Art Institute of Chicago's public collection. -
openFDA Animal & Veterinary Scraper Scrapes animal and veterinary adverse event reports from the openFDA API. -
Alison Free Online Courses Scraper Scrapes Alison free online courses by search keyword and returns each course as a flat row with title, category, provide -
MedlinePlus Health Conditions Scraper Scrapes MedlinePlus health condition pages by keyword and returns each condition as a flat row with title, URL, and full -
Congress.gov Bills Scraper Scrapes US federal bills and resolutions from Congress.gov by congress number and bill type. -
Chile Open Data Scraper Scrapes dataset metadata and full rows from Chile's official open data portal, datos.gob.cl. -
PubChem Compound Scraper Look up chemical compounds on PubChem by CID, name, SMILES, or InChIKey. -
Australia Open Data (data.gov.au) Scraper Scrapes dataset metadata from Australia's official open data portal data.gov.au. -
D&D 5e SRD Content Scraper Scrapes spells, monsters, classes, equipment, and 20 other resource types from the D&D 5e SRD. -
QS World University Rankings Scraper Scrapes QS World University Rankings by year and optional country. -
Datamuse Word Finder Scraper Collect related words, rhymes, synonyms, and lexical data from the Datamuse API. -
Open Targets Platform Scraper Scrapes targets, diseases, and drugs from the Open Targets Platform GraphQL API. -
LibriVox Audiobooks Scraper Scrapes the LibriVox free public-domain audiobook catalog. -
Brilliant.org Courses Catalog Scraper Scrapes Brilliant.org course catalog entries by subject area. -
ICJ Cases Scraper Scrapes International Court of Justice cases by list type and returns each case as a flat row with docket number, title, -
Serious Eats Recipe Scraper Scrapes Serious Eats recipes by search query and returns each one as a flat row with ingredients, instructions, equipmen -
BBC Good Food Recipe Scraper Scrapes BBC Good Food recipes by search query, diet, cuisine, or difficulty. -
SWAPI Star Wars Scraper Collects Star Wars data from the open SWAPI by category and returns each record as a flat row. -
OpenAIRE Publications Scraper Scrapes open access research publications from OpenAIRE by search query and optional year range. -
Simply Recipes Scraper Scrapes Simply Recipes search results by keyword and returns each recipe as a flat row with ingredients, instructions, n -
Ensembl Genomics Scraper Scrapes Ensembl gene annotations, variant consequences, and DNA sequences by symbol, stable ID, region, or rsID. -
Skillshare Course Scraper Scrapes Skillshare course listings by search keyword and returns each class as a flat row with title, instructor, studen -
HGNC Gene Symbols Scraper Scrapes HGNC gene records by symbol, HGNC ID, Entrez ID, UniProt accession, or search. -
Cat Breeds Scraper (TheCatAPI) Scrapes cat breed records from TheCatAPI. -
eBird Bird Observations Scraper Scrapes recent or notable bird observations from the eBird API by region code. -
edX Course Scraper Scrapes edX course listings by search keyword and optional subject filter. -
FutureLearn Courses Scraper Scrapes FutureLearn course listings by search term or from the full catalog. -
Delish Recipe Scraper Scrapes Delish recipes by search query. -
Wikipedia On This Day Scraper Scrapes historical events, births, deaths, and holidays from Wikipedia's On This Day feeds by date and language. -
Bon Appétit Recipes Scraper Scrapes Bon Appétit recipes by search query or category. -
CourtListener Opinions Scraper Scrapes court opinions from CourtListener's public feeds by court. -
OpenAlex Institutions Scraper Scrapes OpenAlex institution records by search term, country, or type. -
Caselaw Access Project Scraper Scrapes US court opinions from the Caselaw Access Project by reporter slug and search term. -
NASA JPL Horizons Ephemeris Scraper Scrapes NASA JPL Horizons ephemeris data for a chosen body, observer center, and time span. -
openFDA Drug Labels Scraper Scrapes drug labels from the openFDA API by search expression. -
Health Canada Drug Database Scraper Scrapes the Health Canada Drug Product Database (DPD) for approved and marketed drugs. -
Federal Judicial Center Scraper Scrapes federal judge profiles from the FJC Biographical Directory. -
Medscape eMedicine Articles Scraper Scrapes eMedicine clinical articles from Medscape specialty hubs. -
OpenSesame Courses Scraper Scrapes OpenSesame course listings by keyword search and returns each course as a flat row with title, provider, duratio -
Crossref Journals Scraper Scrapes journal-level metadata from Crossref by search term. -
CORE Open Access Research Scraper Scrapes open access research paper metadata from CORE by keyword or title query. -
Clinical Trial Multi-Source Scraper Scrapes clinical trial records from ClinicalTrials.gov, WHO ICTRP, OpenFDA, and ClinVar. -
Stanford Online Courses Scraper Scrapes Stanford Online continuing education and professional development courses by keyword. -
bioRxiv and medRxiv Preprints Scraper Scrape preprints from bioRxiv and medRxiv by server and date range. -
College Navigator Scraper Scrapes institution profiles from the NCES College Navigator by state FIPS code and IPEDS year. -
Worldometer Data Scraper Scrapes real-time world statistics from Worldometer sections including world population, coronavirus, cars, and populati -
Victoria and Albert Museum Collection Scraper Scrapes Victoria and Albert Museum collection objects by search term, maker, or object type. -
IACHR Court Cases Scraper Scrapes case records from the Inter-American Court of Human Rights jurisprudence database. -
ShanghaiRanking ARWU 软科世界大学学术排名 Scraper Scrapes the Shanghai ARWU university ranking for a given year and returns each university as a flat row with world rank, -
openFDA Food Adverse Events Scraper Scrapes food adverse event reports from the openFDA CAERS database using Lucene search queries. -
Dryad Research Datasets Scraper Scrapes Dryad research datasets by search term and returns each dataset as a flat row with DOI, title, abstract, authors -
OpenAlex Topics Scraper Collects OpenAlex research topics with their works counts, citation metrics, related concepts, and hierarchical ancestor -
EBI OLS Ontologies Scraper Scrapes ontology terms from the EMBL-EBI Ontology Lookup Service API and returns each term as a flat row with its IRI, l -
openFDA Animal & Veterinary Events Scraper Scrapes animal and veterinary adverse event reports from openFDA. -
ICC Defendants & Cases Scraper Scrapes defendant and case records from the International Criminal Court public docket. -
US Drug & Medical Reference Pro Scraper Queries openFDA drug labels, FDA Orange Book, FDA warning letters, MedlinePlus, Medscape, and eMedicine from one keyword -
Crossref Funder Registry Scraper Scrapes funder records from the Crossref Funder Registry by name, keyword, or country. -
UCSC Genome Browser Tracks Scraper Scrapes UCSC Genome Browser track metadata for a given genome assembly and returns each track as a flat row with its tab -
NCBI ClinVar Variants Scraper Scrapes NCBI ClinVar for genetic variant records by gene, condition, or free-text query. -
BioModels Models Scraper Scrapes BioModels model records by search query and returns each model as a flat row with ID, name, URL, format, submitt -
NCBI dbSNP Variants Scraper Scrapes NCBI dbSNP variant records by free-text query and returns each one as a flat row with rsID, alleles, clinical si -
Wikiquote Quotations Scraper Collects quotes from specified Wikiquote pages across ten language editions and returns each one as a flat row with its -
bioRxiv Preprints Scraper Scrape bioRxiv and medRxiv preprint metadata by date range, subject category, or DOI. -
Macrostrat Geology Units Scraper Scrapes geologic unit records from Macrostrat by latitude/longitude or stratigraphic name. -
NASA Image and Video Library Scraper Scrapes the NASA Image and Video Library by search query. -
Ensembl Gene Lookup Scraper Looks up human gene symbols on Ensembl and returns stable IDs, biotype, chromosome location, and description as flat row -
iNaturalist Observations Scraper Scrapes iNaturalist observations by taxon, place, and quality grade. -
ChEMBL Compounds Scraper Scrapes ChEMBL compound records by clinical phase or molregno range. -
OSF Projects Scraper Scrapes public OSF project listings by search query or research category and returns each project as a flat row with tit -
Paleobiology Database Fossils Scraper Scrapes fossil occurrence records from the Paleobiology Database by taxon, with optional filters for geologic interval a -
Reactome Pathways Scraper Scrapes Reactome pathway records by search term, stable ID, or species, and returns each record as a flat row with stabl -
Nobel Prize Laureates Scraper Scrapes Nobel Prize laureates from the official site. -
OpenStax Textbooks Scraper Scrapes OpenStax open textbooks by subject or search term. -
WHO GHO Indicators Scraper Scrapes WHO Global Health Observatory indicators by name filter. -
WHO GHO Data Scraper Scrapes WHO Global Health Observatory data by indicator code. -
Figshare Research Articles Scraper Scrapes Figshare research articles by keyword search and item type filter. -
Zenodo Research Records Scraper Scrapes Zenodo research records by free-text search and resource type filter. -
EBI OLS Ontologies List Scraper Scrapes the complete list of ontologies from the EMBL-EBI Ontology Lookup Service and returns each one as a flat row wit -
UniProt Protein Scraper Scrapes UniProt protein entries from a search query and returns each one as a flat row with accession, protein name, gen -
EBI Proteins API Scraper Collects protein metadata from the EBI Proteins API by protein name, organism, or both. -
NASA JPL Fireball Events Scraper Scrapes NASA JPL fireball events with filters for date range, minimum total radiated energy, and location availability. -
ESA Gaia DR3 Star Catalog Scraper Scrapes stellar sources from the ESA Gaia DR3 catalog by ADQL query or cone search and returns each star as a flat row w -
SIMBAD Astronomical Objects Scraper Collects astronomical object records from the SIMBAD database with filters for object type, identifier pattern, and V ma -
NASA JPL Small-Body Database Scraper Scrapes asteroid and comet records from the NASA JPL Small-Body Database by designation or catalogue browse. -
GTEx Gene Expression Scraper Collects median gene expression values from the GTEx portal for one or more HGNC gene symbols. -
CDC Socrata Datasets Scraper Scrapes CDC Socrata dataset listings by category and returns each dataset as a flat row with metadata and source URL. -
SCB Sweden Statistics PxWeb Scraper Collects official Swedish statistics datasets from SCB's PxWeb API by subject path. -
StatFin Finland Statistics PxWeb Scraper Scrapes statistical records from StatFin Finland's PxWeb database by subject path. -
Europe PMC Scientific Literature Scraper Scrapes scientific publications from Europe PMC by search query. -
Europe PMC Articles Scraper Scrapes biomedical literature from Europe PMC by a free-text search query. -
GBIF Species Taxonomy Scraper Scrapes GBIF species search by scientific name, keyword, or taxonomic rank. -
NASA Exoplanet Archive Scraper Scrapes confirmed exoplanet data from the NASA Exoplanet Archive. -
SIMBAD Astronomical Objects Scraper Scrapes astronomical objects from SIMBAD using an optional ADQL where clause. -
UniProt Proteins Scraper Scrapes UniProt protein entries by search query and returns each protein as a flat row with accession, names, gene, orga -
TCIA Collections Scraper Scrapes public cancer imaging collection metadata from The Cancer Imaging Archive. -
OpenAIRE Publications Scraper Scrapes OpenAIRE publication records by keyword query and optional acceptance date. -
EBI Ontology Lookup Service Scraper Scrapes ontology terms from the EBI Ontology Lookup Service and returns each term as a flat row with its IRI, label, ont -
Harvard Dataverse Datasets Scraper Scrapes Harvard Dataverse datasets, files, and dataverses by search query. -
ChEMBL Assays Scraper Scrapes ChEMBL assay records by target ChEMBL ID, assay type, organism, keyword search, or direct assay ID. -
SMK Denmark Collection Scraper Scrapes artworks from the SMK Denmark collection by search term, artist, or public domain filter. -
CTAN TeX Packages Scraper Scrapes CTAN TeX package metadata by keyword search. -
NCBI Gene Summary Scraper Fetches NCBI Gene summary records for a provided list of Gene UIDs and returns each gene's name, description, synonyms, -
ChEMBL Targets Scraper Scrapes ChEMBL target records by search term, ChEMBL ID, organism, or target type. -
NASA JPL Close Approach Scraper Scrapes NASA JPL close approach data for asteroids and comets. -
Dryad Research Datasets Scraper Scrapes Dryad dataset metadata by free-text query or affiliation ROR ID. -
HPO Phenotypes Scraper Scrapes Human Phenotype Ontology terms by keyword or HPO ID, with optional disease and gene associations. -
Cleveland Museum of Art Scraper Scrapes Cleveland Museum of Art open access collection. -
Orphanet Rare Diseases Scraper Scrapes Orphanet rare-disease records by ORPHAcode or from the latest Orphadata list. -
MyChem.info Drug Annotation Scraper Scrapes curated drug annotations from MyChem.info for a search query or a list of drug names or InChIKeys. -
CWTS Leiden Ranking Scraper Scrapes CWTS Leiden Ranking university data by publication period and optional country filter. -
Google Scholar Scraper Retrieve paper metadata from Google Scholar search results. -
openHPI Courses Scraper Scrapes openHPI course metadata from the public catalog. -
ShanghaiRanking GRAS 软科学科排名 Subject Rankings Scraper Scrapes ShanghaiRanking GRAS subject rankings for any subject and year. -
Pharos Target Druggability Scraper Scrapes target druggability profiles from the NIH Pharos knowledgebase by gene symbol. -
Wikimedia Commons Book Text Scraper Scrapes OCR text from DjVu and PDF books on Wikimedia Commons. -
InterPro Protein Families Scraper Scrapes InterPro protein family entries by accession list or by browsing a chosen entry type. -
Times Higher Education Rankings Scraper Scrapes Times Higher Education World University Rankings by year and optional subject. -
College Board BigFuture Colleges Scraper Scrapes college profiles from College Board BigFuture search results. -
NCI Thesaurus Concept Scraper Scrapes NCI Thesaurus cancer ontology concepts by search term or NCIt code, returning synonyms, definitions, semantic ty -
Yale LUX Cultural Objects Scraper Searches the Yale LUX cross-collection catalog by keyword and optional object type, and returns each matching cultural o -
Rijksmuseum Collection Scraper Scrapes the Rijksmuseum's online collection by search term, object type, or maker name. -
Harvard Art Museums Collection Scraper Scrapes Harvard Art Museums collection by keyword, classification, culture, or century. -
DBLP Publications Scraper Scrapes DBLP computer science publications by author, title, or keyword and returns each paper as a flat row with title, -
WikiArt Paintings Scraper Scrapes WikiArt paintings by art style and returns each painting as a flat row with title, artist, year, image URL, and -
Sigma-Aldrich Chemical Catalog Scraper Scrape Sigma-Aldrich (MilliporeSigma) research chemicals including pack sizes, list prices, stock status, CAS numbers, f -
OSTI DOE Research Scraper Searches OSTI.gov by keyword and optional document type, then returns each publication as a flat row with title, authors -
Free Dictionary Word Definitions Scraper Scrapes word definitions, phonetics, pronunciation audio, parts of speech, and examples from the Free Dictionary API. -
INSPIRE-HEP Physics Papers Scraper Scrapes paper records from the INSPIRE-HEP high-energy physics database by search query. -
VC Fellowships & Talent Networks Scraper Export fellows and talent network members from top VC programs (a16z, Neo Scholars, Pear Fellows, Kleiner Perkins, Gener -
Norway SSB Public Statistics Scraper Scrapes any public dataset from Statistics Norway's Statbank by table ID and returns each row as a flat record with offi -
HKMA 香港金融管理局 Daily Monetary Statistics Scraper Scrapes daily monetary statistics from the Hong Kong Monetary Authority for a specified date range. -
Lithuania OSP Statistics Scraper Scrapes official statistical data from the Lithuania OSP public API by indicator code. -
Philippines PSA OpenStat Scraper Scrapes Philippine Statistics Authority OpenStat PXWeb catalog entries and table cell values. -
BCRP Peru Statistical Series Scraper Scrapes a single BCRP Peru statistical series by code and date range and returns each observation as a flat row with dat -
EU Open Data Portal Scraper Scrapes EU Open Data Portal datasets by search term. -
Met Museum Artworks Scraper Searches The Metropolitan Museum of Art's public collection by keyword and returns each matching artwork as a flat row w -
Niche Scraper - School Districts, Schools & Colleges Reads Niche profiles into structured rows: the overall grade, every subject grade, the statistics table with national co -
Art Institute of Chicago Artworks Scraper Scrapes Art Institute of Chicago artworks by search term. -
V&A Museum Artworks Scraper Scrapes V&A Museum artworks matching a search term and returns each one as a flat row with title, maker, materials, date -
CBS Netherlands Statistics Scraper Scrapes CBS OpenData tables by table ID and returns each row of the TypedDataSet as a flat object. -
ITIS Species Taxonomy Scraper Search ITIS by common or scientific name and get back the full taxonomic hierarchy, TSN, synonyms, and expert review sta -
disease.sh Global Health Data Scraper Scrapes global health data from disease.sh for every country. -
re3data Research Data Repositories Scraper Scrapes repository records from re3data.org by name or keyword and returns each one as a flat row with its metadata, sub -
Wikisource Texts Scraper Scrapes full texts from Wikisource by exact title or full-text search. -
Statistics Canada Data Tables Scraper Scrapes Statistics Canada data catalogue by keyword and returns dataset metadata as flat rows. -
Opendata Swiss Datasets Scraper Scrapes Swiss open data datasets from opendata.swiss by keyword and returns each dataset as a flat row with metadata. -
Course Report Bootcamps Scraper Scrapes bootcamp school profiles from Course Report by keyword or full directory browse. -
Iceland Hagstofa PxWeb Statistics Scraper Scrapes data from Statistics Iceland's PxWeb API. -
Disease Ontology Terms Scraper Scrapes disease terms from the Disease Ontology by keyword or DOID. -
Goodreads Quotes Scraper Searches Goodreads quotes by keyword and returns each quote as a flat row with its text, author, book title, tags, and l -
Worldometers Statistics Scraper Scrape live statistics from any Worldometers page. -
Wikimedia Commons Deletion Scraper Scrapes deletion nominations from Wikimedia Commons categories. -
CourtListener Opinions Scraper Scrape US court opinions from CourtListener by search query or as a live feed of the latest rulings. -
Niche Scholarships Scraper Scrapes Niche scholarship listings with award amounts, deadlines, eligibility text, and direct apply links. -
Goodreads Book Details Scraper Scrapes Goodreads book details from lists, shelves, or search queries. -
Wikimedia Commons Valued Images Scraper Scrape valued images from any Wikimedia Commons category via the MediaWiki API. -
Goodreads Genre Bestsellers Scraper Extract genre bestseller books from Goodreads. -
Wikimedia Commons File Talk Scraper Pull discussion pages for files on Wikimedia Commons via the official API. -
Wikimedia Commons Page Views Scraper Retrieve daily page view statistics for any Wikimedia Commons media file. -
Smithsonian Volcanoes Scraper Scrapes volcano records from the Smithsonian Global Volcanism Program Holocene catalogue. -
USGS ScienceBase Catalog Scraper Scrapes USGS ScienceBase Catalog records by search query, parent item ID, or browse category. -
Preply Tutors Scraper Scrapes Preply tutor profiles by subject and optional country filter. -
Wikimedia Commons License Templates Scraper Scrapes license template metadata from Wikimedia Commons categories using the MediaWiki API. -
Academic Research Aggregator Scraper Queries Crossref journals, OpenAlex institutions and topics, and Dryad datasets from a single keyword. -
DOAJ Subject Classification Scraper -
Wikipedia Structured Data Scraper Extract embedded JSON-LD structured data from Wikipedia pages. -
Wikimedia Commons User Rights Log Scraper Scrapes Wikimedia Commons user rights log entries via the public MediaWiki API. -
Wikimedia Commons Quality Images Scraper Scrapes the official Quality Images category from Wikimedia Commons via the public API. -
Crossref Academic Paper Metadata Scraper Scrapes academic paper metadata from Crossref by search query or publication type. -
Wikimedia Site Statistics Scraper -
Wikimedia Commons Category Files Scraper -
PubMed Article Metadata Scraper -
Wikimedia Commons SDC Scraper Scrape structured data (SDC) from Wikimedia Commons media files by entity ID. -
OpenClipart Coloring Pages Scraper Scrape coloring pages from OpenClipart by search query. -
Wikimedia Commons WikiProject Scraper Scrape Wikimedia Commons WikiProject pages: name, status, shortcut, participants, sections, categories, edit history. -
Coloring.ws Printable Coloring Pages Scraper Scrapes coloring page images from Coloring.ws category pages and returns each image URL with its alt text, dimensions, a -
Wikimedia Commons Page History Scraper Scrapes the complete revision history of a Wikimedia Commons page, returning each edit as a flat row with editor, timest -
Wikimedia Commons Subcategory Scraper Scrapes Wikimedia Commons subcategory names and IDs from a starting category. -
Wikimedia Commons Category Hierarchy Scraper Recursively scrapes Wikimedia Commons category trees from a start category. -
Genomics & Variants Pack Scraper Scrape variants, clinical significance, coordinates and ontology terms from dbSNP, ClinVar, UCSC and EBI OLS in one run. -
Openclipart Line Art Scraper Scrapes Openclipart clipart by search query and returns each item with its title, artist, tags, download counts, SVG and -
Wikimedia Commons Creator Templates Scraper Scrapes Wikimedia Commons creator template pages from any MediaWiki category and returns each one as a flat row with pag -
Wikimedia Commons Users Scraper Scrapes Wikimedia Commons user records by group filter or active status. -
Wikimedia Commons Admin Logs Scraper Scrapes Wikimedia Commons admin log events by deletion, block, or user rights type. -
HelloKids Coloring Pages Scraper Scrapes HelloKids coloring pages and drawing tutorials by category or search term. -
Wikimedia Commons Template Scraper Scrapes template pages from Wikimedia Commons via the public API. -
Wikimedia Commons Geolocated Files Scraper Queries Wikimedia Commons for files tagged with GPS coordinates and returns each matching record as a flat row with titl -
Wikimedia Commons Featured Pictures Scraper Scrapes the complete list of featured pictures from Wikimedia Commons using the official API. -
Wikimedia Commons Abuse Filters Scraper Collects Wikimedia Commons abuse filter records via the query API and returns each filter as a flat row with description -
Wikimedia Commons Help Pages Scraper Scrapes Wikimedia Commons help page listings from the MediaWiki API. -
Wikimedia Commons WikiProjects Scraper Scrapes WikiProjects from Wikimedia Commons using the public category members API. -
Wikipedia Category Members Scraper Scrapes all page titles and IDs that belong to a Wikipedia category. -
SuperColoring Coloring Pages Scraper Scrape SuperColoring printables: PNG and PDF download links, licence, tags, size and print counts. -
CourtListener Citation Scraper - Case Law Citation Graph Scrape US court opinions from CourtListener with every reporter citation, times-cited counts and the citation graph. -
Disneyclips Coloring Pages Scraper Scrape Disneyclips printables: PNG and PDF links, character, film or franchise, collection and licence wording.