ParseForge Scrapers

Kaggle Datasets Scraper

parseforge/kaggle-scraper

AIDeveloper toolsEducation

Scrapes Kaggle dataset listings by search term, tag, file type, license, or size. Returns one flat row per dataset with title, URL, size, votes, and optional full description and version history.

Run this scraper See the API call
Total users
5
Monthly active
1
Total runs
121
Bookmarked
0
Rating
Not rated yet
Last modified
12 days ago

Overview

ParseForge

Kaggle Datasets Scraper

Scrape Kaggle datasets by search, tag, file type, or license, up to a million per run. Every dataset comes with its title, URL, size, votes, and optional full description and version history. No API key. Export to CSV, JSON, Excel, or XML.

Kaggle's official API needs an account, a key, and rate limits you. This reads the public dataset catalogue directly, filtered by search term, tag, file type, license, or size, and returns each match in one fixed schema. It works for market research, ML dataset discovery, and competitive analysis.

Who uses it What they scrape Kaggle for
Data scientists Find ready-made datasets for model training and benchmarking
Market researchers Track which public datasets companies and researchers publish
ML engineers Build a pipeline of candidate datasets for a new project
Competitive analysts Monitor dataset releases by topic, license, or file format

What it does

This Actor collects Kaggle dataset listings by search term, tag, file type, license, or size, and returns each one as a flat row.

  • ๐Ÿ”Ž Search and filters: free-text search plus tag, file type, license, and size range filters.
  • ๐Ÿ“Š Sort orders: hottest, most votes, recently updated, most active, or recently published.
  • ๐Ÿ“ Full descriptions: optional fetch of the dataset detail page for long-form description, tags, and version history.
  • ๐Ÿ“ฆ Flat output: one row per dataset with title, URL, size, votes, and more, ready for CSV, JSON, Excel, or XML.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

What you can do with Kaggle data

๐Ÿ“ˆ Track dataset trends.

A market researcher runs the scraper weekly with a tag like 'finance' and sortBy 'hottest' to see which datasets are gaining traction.

๐Ÿง  Build a training data shortlist.

An ML engineer searches for 'computer vision' with fileType 'csv' and minSize 1000000 to find candidate datasets for a new model.

๐Ÿ” Monitor competitor data releases.

A competitive analyst filters by license 'cc' and tag 'nlp' to track what open datasets competitors are publishing.

๐Ÿ“š Audit dataset availability.

A data governance lead runs a search for a specific term and includes full descriptions to review what data is publicly available.

Why choose this scraper

What you get
No API key Scrape Kaggle's public catalogue without registering an app or managing tokens
Flexible filters Combine search, tag, file type, license, and size to narrow results
Rich metadata Get title, URL, size, votes, and optional full description and version history
Scalable Collect up to a million datasets per run

How it compares

This actor competes directly with the Kaggle Datasets Scraper, which also searches Kaggle's public dataset catalogue and returns metadata with optional full descriptions and version history.

Feature ParseForge Kaggle Datasets Scraper
Search by keyword Yes Yes
Filter by tag Yes Not listed
Filter by file type Yes Not listed
Filter by license Yes Not listed
Filter by size range Yes Not listed
Sort orders Yes Not listed
Full description and version history Yes Yes

Configure the run

Drive the Actor from a search term, tag, file type, license, and size range, alone or together, and filters run as each dataset is read so only matches reach your dataset. The Input tab lists every parameter.

A first run with the defaults:

{
 "maxItems": 10
}

A larger pull:

{
 "maxItems": 200
}

Pricing

Pay-per-result: $0.012 per result collected. You pay only for the results written to your dataset.

Results collected Approximate cost
100 results $1.20
1,000 results $12.00
10,000 results $120.00

New Apify accounts start with $5 in free credit.

Free users

Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.

Run it

  1. Create a free Apify account with $5 in credit.
  2. Open the Kaggle Datasets Scraper.
  3. Set your inputs and any filters, then click Start.
  4. Export the results as CSV, Excel, JSON, or XML from the Dataset tab.

Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.

Use with AI agents (MCP)

Give an AI agent live access to Kaggle through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/kaggle-scraper"

Then prompt it in plain language to run the scraper and read back the results.

Troubleshooting

Why am I getting no results?

Check your filters. If you set a search term, tag, file type, license, or size range that is too restrictive, no datasets may match. Try removing filters one by one to see which one is blocking results.

Why is the run slow?

The includeDescription option fetches each dataset's detail page, which adds one request per record. Disable it if you only need listing metadata, or reduce maxItems.

Why are some fields null?

Fields like description, tags, and versions are only populated when includeDescription is true. If it is false, those fields stay null by design.

Can I scrape a specific dataset by URL?

This scraper is designed for search and filter-based discovery, not direct URL scraping. Use the search term or tag to find the dataset you need.

Why did I get fewer results than maxItems?

The scraper returns all datasets that match your filters, up to maxItems. If there are fewer matches, you will get fewer results.

FAQ

Question Answer
Do I need a Kaggle account or API key? No. The scraper reads Kaggle's public dataset catalogue directly, so no login or key is required.
Can I filter by file type or license? Yes. Use the fileType and license inputs to restrict results to datasets containing CSV, JSON, SQLite, or BigQuery files, or shared under Creative Commons, GPL, Open Database, or other licenses.
What does the 'includeDescription' option do? When enabled, the scraper fetches each dataset's detail page to populate the full description, tags, and version history. It costs one extra request per record, so disable it for faster runs if you only need the listing metadata.
How many datasets can I scrape in one run? You can set maxItems up to 1,000,000. The actual number returned depends on how many datasets match your filters.
Can I sort the results? Yes. Use sortBy to order by hottest, most votes, recently updated, most active, or recently published.
What is a tag slug? Kaggle tags are short identifiers like 'classification', 'finance', or 'computer vision'. You can find valid slugs on Kaggle's datasets page.
Does the scraper download the dataset files? No. It collects metadata about the datasets, not the files themselves. To download files, you would need a separate step.
Can I filter by dataset size? Yes. Use minSize and maxSize to set a range on the dataset's total uncompressed size in bytes.
What output formats are supported? The scraper returns data in Apify's standard formats: CSV, JSON, Excel, and XML.
Is this legal? The scraper only reads publicly available information from Kaggle's catalogue. You are responsible for complying with Kaggle's terms of service and any applicable laws.

Related actors

Browse the full ParseForge collection for more scrapers.

๐Ÿ†˜ Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.

โš ๏ธ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Kaggle Inc. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.

Input

FieldTypeWhat it doesDefault
search string Free-text query against dataset titles, descriptions, and tags. Leave blank to browse without a keyword (use sortBy / fileType to control discovery). not set
maxItems integer How many datasets to collect per run. 10
sortBy string (5 options) Order results by Kaggle's built-in sort orders. hottest
fileType string (5 options) Restrict results to datasets containing the chosen file format. 'all' returns every format. all
license string (5 options) Restrict results to datasets shared under the chosen license. 'all' returns every license. all
tag string Filter by a Kaggle tag slug (for example: 'classification', 'finance', 'computer vision', 'nlp', 'health'). Leave blank for no tag filter. See https://www.kaggle.com/datasets for valid tag slugs. not set
minSize integer Lower bound on the dataset's total uncompressed size in bytes. not set
maxSize integer Upper bound on the dataset's total uncompressed size in bytes. not set
includeDescription boolean Fetch the dataset detail endpoint for each record to populate description, tags, and versions. When false, those fields stay null and the run is faster. true

Pricing

from $9.00 per 1,000 results

Charged forWhat it isPrice each
Actor Start Charged once when the run starts. $0.005
Dataset Record Charged once per Kaggle dataset record returned. $0.009 to $0.012

Tiered: the lower figure is the price on a higher Apify plan. Billing and the free credit live on Apify.

API

One POST returns the dataset directly. Same shape for every scraper in the library, so swapping the slug is the only change.

POST ยท run and get results
curl -X POST "https://api.apify.com/v2/acts/parseforge~kaggle-scraper/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "helloWorld": 123
  }'

Examples

Input that runs as-is.

input.json
{
  "helloWorld": 123
}

Reviews

No reviews yet. Be the first.

Issues

We build and maintain this scraper, so a problem with it comes to us. Report it on the Apify listing and the thread stays attached to the scraper where the next person can find it: open an issue.

Broken and urgent, or you would rather not post in public? Write to parseforge@protonmail.com and it reaches the people who wrote it.

Related scrapers

Run Kaggle Datasets Scraper on Apify All scrapers