AWS Marketplace Scraper
parseforge/aws-marketplace-scraper
AutomationE-commerceDeveloper tools
Scrapes AWS Marketplace product listings by search query, category, or direct URL. Returns each product as a flat row with pricing, deployment, and region data.
- Total users
- 6
- Monthly active
- 0
- Total runs
- 293
- Bookmarked
- 1
- Rating
- 5.0 (1)
- Last modified
- 9 days ago
Overview
AWS Marketplace Scraper
Scrape AWS Marketplace product listings by search query, category, or direct URL, up to a million per run. Each product comes with its pricing model, deployment type, region, and certification status. No API key required. Export to CSV, JSON, Excel, or XML.
The AWS Marketplace catalog is massive, and manually browsing for software that fits your stack wastes hours. This Actor reads the public product listings directly, letting you filter by category, pricing type, region, operating system, and more. You get a structured dataset of matching products, ready for analysis.
| Who uses it | What they scrape AWS Marketplace for |
|---|---|
| Cloud architects | Building a shortlist of compliant, region-available third-party tools for a new AWS deployment. |
| Procurement teams | Comparing pricing models and free trial availability across competing SaaS products. |
| Market researchers | Tracking which new security or machine learning products are listed each week. |
| Sales engineers | Finding complementary products to partner with or benchmark against. |
What it does
This Actor collects AWS Marketplace product listings by search query, category, or direct URL, and returns each one as a flat row.
- ๐ Search-driven scraping: Enter a search query like 'machine learning' or 'database' to target specific product niches.
- ๐ Category filtering: Narrow results to categories such as Security, Data Analytics, or DevOps.
- ๐ฐ Pricing model filters: Select free, paid, freemium, BYOL, or pay-as-you-go products only.
- ๐ Region and OS targeting: Filter by AWS region and operating system to find products that run where you do.
- โ Certification and trial flags: Include only AWS Certified products or those with a free trial available.
Results export to CSV, JSON, Excel, or XML, or straight from the API.
What you can do with AWS Marketplace data
๐ Build a compliant software shortlist.
A cloud architect filters for security products available in eu-west-1 with AWS Certification to meet a client's compliance requirements.
๐ธ Compare SaaS pricing at scale.
A procurement analyst scrapes all products in the Data Analytics category with a free trial to evaluate cost before vendor calls.
๐ Monitor new market entrants.
A market researcher runs a weekly scrape for 'machine learning' products to track new listings and competitive shifts.
๐ค Identify partnership targets.
A sales engineer scrapes the DevOps category for complementary container-based products to propose a bundled offering.
Why choose this scraper
| What you get | |
|---|---|
| No API key | Reads the public AWS Marketplace catalog with no registration or credentials. |
| Structured output | Every product returns as a flat row with consistent columns for pricing, deployment, and region. |
| Flexible input | Start from a search term, a category, a direct URL, or scrape the entire catalog. |
How it compares
No other Store actor targets AWS Marketplace the same way, so the honest comparison is with the alternatives teams actually weigh.
| AWS Marketplace Scraper | Build it in-house | By hand | |
|---|---|---|---|
| Setup | Run it now, zero config | Days of engineering | None, but hours per pull |
| When AWS Marketplace changes | Maintained for you | You fix it | You re-learn the page |
| Proxies, retries, anti-bot | Built in | Your problem | Browser only |
| Output | Fixed JSON schema, CSV/Excel export | Whatever you build | Copy-paste |
| Cost | Pay per result | Engineering time | Analyst hours |
Configure the run
Drive the Actor from a search query, a category, or a direct URL, and filters run as each product is read so only matches reach your dataset. The Input tab lists every parameter.
A first run with the defaults:
{
"maxItems": 10,
"categories": [
"security"
],
"pricingTypes": [
"free",
"paid"
],
"productTypes": [
"saas"
],
"regions": [
"us-east-1"
],
"operatingSystems": [
"Linux"
],
"deploymentTypes": [
"cloud"
],
"freeTrialAvailable": "ALL",
"awsCertified": "ALL",
"featured": "ALL"
}
A larger pull:
{
"maxItems": 200,
"categories": [
"security"
],
"pricingTypes": [
"free",
"paid"
],
"productTypes": [
"saas"
],
"regions": [
"us-east-1"
],
"operatingSystems": [
"Linux"
],
"deploymentTypes": [
"cloud"
],
"freeTrialAvailable": "ALL",
"awsCertified": "ALL",
"featured": "ALL"
}
Pricing
Pay-per-result: $0.001 per result collected. You pay only for the results written to your dataset.
| Results collected | Approximate cost |
|---|---|
| 100 results | $0.10 |
| 1,000 results | $1.00 |
| 10,000 results | $10.00 |
New Apify accounts start with $5 in free credit.
Free users
Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.
Run it
- Create a free Apify account with $5 in credit.
- Open the AWS Marketplace Scraper.
- Set your inputs and any filters, then click Start.
- Export the results as CSV, Excel, JSON, or XML from the Dataset tab.
Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.
Use with AI agents (MCP)
Give an AI agent live access to AWS Marketplace through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:
claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/aws-marketplace-scraper"
Then prompt it in plain language to run the scraper and read back the results.
Troubleshooting
Why am I getting no results?
Check that your search query or filters are not too restrictive. Try leaving all filters empty and using only a broad search term, or scrape without any filters to see the full catalog.
The Actor is running slowly. Is that normal?
Scraping many pages takes time. Reduce the Max Items limit for a faster test run, or narrow your search with additional filters to target a smaller set of products.
Some products are missing fields in the output.
Not every product listing on AWS Marketplace fills in all fields. If a product does not list its operating system or deployment type, that cell will be empty in your dataset.
I get an error when using a direct URL.
Ensure the URL is a full, valid AWS Marketplace product page link. The Actor expects a URL that starts with 'https://aws.amazon.com/marketplace/'. If the product is no longer listed, the scrape will fail.
FAQ
| Question | Answer |
|---|---|
| Can I scrape the entire AWS Marketplace catalog? | Yes. Leave the search query and all filters empty, and set a high Max Items limit. The Actor will paginate through all available product listings. |
| Do I need an AWS account or API key to use this? | No. This Actor reads the public AWS Marketplace website. You do not need an AWS account, IAM role, or any API credentials. |
| What data does each product row include? | Each row includes the product name, description, pricing model, deployment type, supported regions, operating systems, and flags like AWS Certified or free trial availability. |
| How do I filter for only free products? | In the input, set the Pricing Types filter to 'free'. You can combine this with other filters like category or region to narrow results further. |
| Can I scrape a specific product page directly? | Yes. Paste the full URL of an AWS Marketplace product page into the Start URL field. The Actor will extract that single product's details. |
| What is the maximum number of products I can scrape? | Free Apify users are limited to 10 items per run. Paid users can set Max Items up to 1,000,000 to scrape the full catalog. |
| How do I filter products by AWS region? | Use the Regions filter to select one or more AWS regions like us-east-1 or eu-west-1. Only products available in those regions will be returned. |
| Can I filter for products that offer a free trial? | Yes. Set the Free Trial Available filter to 'true' to return only products that offer a free trial. |
| What export formats are supported? | You can export your dataset in CSV, JSON, Excel, or XML formats from the Apify platform. |
| Does this Actor handle pagination automatically? | Yes. It navigates through all pages of search results or category listings until it reaches your Max Items limit or the end of the catalog. |
Related actors
Browse the full ParseForge collection for more scrapers.
๐ Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.
โ ๏ธ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Amazon Web Services, Inc. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.
Input
| Field | Type | What it does | Default |
|---|---|---|---|
| startUrl | string | Direct URL to scrape from AWS Marketplace. Leave empty to use search filters or scrape all products. | not set |
| maxItems | integer | Free users: Limited to 100. Paid users: Optional, max 1,000,000 | 10 |
| searchQuery | string | Enter specific terms like 'machine learning', 'security', 'database', or 'analytics' to find relevant products. Leave all filters empty to fetch all products. | not set |
| categories | array | Filter by product categories (optional). Leave empty to include all categories. | ["security"] |
| pricingTypes | array | Choose pricing models (optional). Leave empty to include all pricing types. | ["free","paid"] |
| productTypes | array | Filter by product types (optional). Leave empty to include all types. | ["saas"] |
| regions | array | Filter by AWS regions (optional). Leave empty to include all regions. | ["us-east-1"] |
| operatingSystems | array | Filter by operating systems (optional). Leave empty to include all operating systems. | ["Linux"] |
| deploymentTypes | array | Filter by deployment types (optional). Leave empty to include all deployment types. | ["cloud"] |
| freeTrialAvailable | string (3 options) | Filter by free trial availability (optional). | ALL |
| awsCertified | string (3 options) | Filter by AWS certification status (optional). | ALL |
| featured | string (3 options) | Filter by featured status (optional). | ALL |
Pricing
from $0.50 per 1,000 results
| Charged for | What it is | Price each |
|---|---|---|
| result | Single result in the default dataset. | $0.0005 to $0.001 |
Tiered: the lower figure is the price on a higher Apify plan. Billing and the free credit live on Apify.
API
One POST returns the dataset directly. Same shape for every scraper in the library, so swapping the slug is the only change.
curl -X POST "https://api.apify.com/v2/acts/parseforge~aws-marketplace-scraper/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
-H "Content-Type: application/json" \
-d '{
"helloWorld": 123
}' Examples
Input that runs as-is.
{
"helloWorld": 123
} Reviews
Rated 5.0 out of 5 across 1 review. Read them on Apify.
Issues
We build and maintain this scraper, so a problem with it comes to us. Report it on the Apify listing and the thread stays attached to the scraper where the next person can find it: open an issue.
Broken and urgent, or you would rather not post in public? Write to parseforge@protonmail.com and it reaches the people who wrote it.
