ParseForge
Debian Source Packages Scraper
parseforge/debian-packages-scraper
Developer toolsAutomationOther
Scrapes Debian source packages by name or keyword and returns each package as a flat row with version, suite, summary, and canonical link.
- Total users
- 2
- Monthly active
- 1
- Total runs
- 44
- Bookmarked
- 0
- Rating
- Not rated yet
- Last modified
- 12 days ago
Overview
Debian Source Packages Scraper
Scrape Debian source packages by name or keyword, up to a million per run. Every package comes with its version, suite, summary, and canonical link. No login or API key. Export to CSV, JSON, Excel, or XML.
Debian's package archive is huge, and the official search interface is built for humans, not for bulk analysis. This Actor reads the public source package index directly, filters by your search term, and returns each match in one fixed schema. It is the fastest way to turn a package name like nginx or python3 into a clean dataset.
| Who uses it | What they scrape Debian Packages for |
|---|---|
| DevOps engineers | Which versions of a package exist across Debian suites |
| Security researchers | Which source packages match a CVE-affected name |
| Software auditors | Which packages are available for a given keyword |
| Data analysts | Which package metadata to join with other datasets |
What it does
This Actor collects Debian source packages by name or keyword and returns each one as a flat row.
- 🔍 Keyword search: type a package name or a partial term, and the Actor returns every source package that matches.
- 📦 Bulk collection: set a maximum up to 1,000,000 packages per run, so one search can cover the whole archive.
- 🧾 Flat rows: each package is returned as a single record with its name, version, suite, summary, and canonical link.
- 📤 Multiple exports: download the result as CSV, JSON, Excel, or XML from the Apify dataset.
Results export to CSV, JSON, Excel, or XML, or straight from the API.
What you can do with Debian Packages data
🔎 Audit package availability.
A DevOps engineer searches for nginx and gets every source package across suites, then compares versions before an upgrade.
🛡️ Map CVE-affected packages.
A security researcher searches for a library name from a CVE report and collects all matching source packages for triage.
📊 Build a package inventory.
A data analyst runs a broad keyword like python and exports the full result set to CSV for a compliance spreadsheet.
🔗 Collect canonical links.
A software auditor scrapes package metadata and uses the canonical URLs to open each official page for manual review.
Why choose this scraper
| What you get | |
|---|---|
| No API key | The Actor reads the public Debian package index, so you do not need to register or authenticate. |
| One fixed schema | Every package comes back with the same fields, so you can merge runs without cleaning. |
| Up to a million rows | One run can collect the full result set for a broad keyword like python or lib. |
| Canonical links | Each row includes the official package page URL, ready for follow-up scraping or citation. |
How it compares
This Actor and the Debian Packages Scraper - APT Package Search both read the Debian package index, but this one focuses on source packages and bulk collection.
| Feature | ParseForge | Debian Packages Scraper - APT Package Search |
|---|---|---|
| Source package records | Yes | Not listed |
| Bulk collection up to 1,000,000 packages | Yes | Not listed |
| Canonical package links | Yes | Yes |
| Package summaries | Yes | Yes |
| Available releases | Yes | Yes |
| Export to CSV, JSON, Excel, XML | Yes | Not listed |
Configure the run
Drive the Actor with a single search term, and set a maximum number of packages to collect per run. The Input tab lists every parameter.
A first run with the defaults:
{
"searchQuery": "nginx",
"maxItems": 10
}
A larger pull:
{
"searchQuery": "nginx",
"maxItems": 200
}
Pricing
Pay-per-result: $0.021 per result collected. You pay only for the results written to your dataset.
| Results collected | Approximate cost |
|---|---|
| 100 results | $2.10 |
| 1,000 results | $21.00 |
| 10,000 results | $210.00 |
New Apify accounts start with $5 in free credit.
Free users
Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.
Run it
- Create a free Apify account with $5 in credit.
- Open the Debian Source Packages Scraper.
- Set your inputs and any filters, then click Start.
- Export the results as CSV, Excel, JSON, or XML from the Dataset tab.
Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.
Use with AI agents (MCP)
Give an AI agent live access to Debian Packages through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:
claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/debian-packages-scraper"
Then prompt it in plain language to run the scraper and read back the results.
Troubleshooting
Why am I getting no results?
Check that your searchQuery is spelled correctly and is not too specific. Try a shorter keyword or a known package name like nginx.
Why did the run stop before reaching maxItems?
The Actor stops when there are no more matching packages in the Debian index. Lower maxItems or broaden your search term.
Why is the run taking a long time?
A very broad keyword can match thousands of packages. Reduce maxItems or use a more specific search term.
Why are some fields empty in the output?
Not every Debian source package has every metadata field. Empty fields mean the Debian index did not provide that value for that package.
Can I search for multiple keywords at once?
No, the Actor accepts one searchQuery per run. Run it multiple times with different keywords and merge the datasets.
FAQ
| Question | Answer |
|---|---|
| What is a Debian source package? | A source package is the original code plus packaging metadata that Debian uses to build binary packages. This Actor returns source package records from the Debian archive. |
| Can I search for a partial package name? | Yes. The searchQuery field accepts any keyword, and the Actor returns every source package whose name or metadata matches that term. |
| How many packages can I collect in one run? | You can set maxItems from 1 up to 1,000,000. The Actor stops after collecting that many matching packages. |
| Do I need a Debian account or API key? | No. The Actor reads the public Debian package index, so no authentication is required. |
| What fields does each package row contain? | Each row includes the package name, version, suite, summary, and canonical link, plus any other fields returned by the Debian index. |
| Can I export the results to Excel? | Yes. The Apify dataset can be exported to CSV, JSON, Excel, or XML. |
| Does this Actor scrape binary packages too? | No, it returns source packages only. Binary package data is not included. |
| Which Debian suites are covered? | The Actor returns packages from all suites present in the Debian source package index, such as stable, testing, and unstable. |
| Can I schedule this Actor to run daily? | Yes. You can set up a schedule in Apify to run the Actor automatically and receive updated package data. |
| Is there a limit on how often I can run it? | No fixed limit. You can run the Actor as often as you need, subject to your Apify plan. |
Related actors
Browse the full ParseForge collection for more scrapers.
🆘 Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.
⚠️ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Debian Project. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.
Input
| Field | Type | What it does | Default |
|---|---|---|---|
| searchQuery required | string | Required. The term to search for in the Debian source package archive (for example nginx, python3, ffmpeg). | nginx |
| maxItems | integer | How many packages to collect per run. | 10 |
Pricing
from $19.00 per 1,000 results
| Charged for | What it is | Price each |
|---|---|---|
| result | Single result in the default dataset. | $0.019 to $0.021 |
Tiered: the lower figure is the price on a higher Apify plan. Billing and the free credit live on Apify.
API
One POST returns the dataset directly. Same shape for every scraper in the library, so swapping the slug is the only change.
curl -X POST "https://api.apify.com/v2/acts/parseforge~debian-packages-scraper/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
-H "Content-Type: application/json" \
-d '{
"helloWorld": 123
}' Examples
Input that runs as-is.
{
"helloWorld": 123
} Reviews
No reviews yet. Be the first.
Issues
We build and maintain this scraper, so a problem with it comes to us. Report it on the Apify listing and the thread stays attached to the scraper where the next person can find it: open an issue.
Broken and urgent, or you would rather not post in public? Write to parseforge@protonmail.com and it reaches the people who wrote it.