ParseForge Scrapers

AWS Marketplace Scraper

parseforge/aws-marketplace-scraper

AutomationE-commerceDeveloper tools

Scrapes AWS Marketplace product listings by search query, category, or direct URL. Returns each product as a flat row with pricing, deployment, and region data.

Run this scraper See the API call
Total users
6
Monthly active
0
Total runs
293
Bookmarked
1
Rating
5.0 (1)
Last modified
9 days ago

Overview

ParseForge

AWS Marketplace Scraper

Scrape AWS Marketplace product listings by search query, category, or direct URL, up to a million per run. Each product comes with its pricing model, deployment type, region, and certification status. No API key required. Export to CSV, JSON, Excel, or XML.

The AWS Marketplace catalog is massive, and manually browsing for software that fits your stack wastes hours. This Actor reads the public product listings directly, letting you filter by category, pricing type, region, operating system, and more. You get a structured dataset of matching products, ready for analysis.

Who uses it What they scrape AWS Marketplace for
Cloud architects Building a shortlist of compliant, region-available third-party tools for a new AWS deployment.
Procurement teams Comparing pricing models and free trial availability across competing SaaS products.
Market researchers Tracking which new security or machine learning products are listed each week.
Sales engineers Finding complementary products to partner with or benchmark against.

What it does

This Actor collects AWS Marketplace product listings by search query, category, or direct URL, and returns each one as a flat row.

  • ๐Ÿ” Search-driven scraping: Enter a search query like 'machine learning' or 'database' to target specific product niches.
  • ๐Ÿ“‚ Category filtering: Narrow results to categories such as Security, Data Analytics, or DevOps.
  • ๐Ÿ’ฐ Pricing model filters: Select free, paid, freemium, BYOL, or pay-as-you-go products only.
  • ๐ŸŒ Region and OS targeting: Filter by AWS region and operating system to find products that run where you do.
  • โœ… Certification and trial flags: Include only AWS Certified products or those with a free trial available.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

What you can do with AWS Marketplace data

๐Ÿ“‹ Build a compliant software shortlist.

A cloud architect filters for security products available in eu-west-1 with AWS Certification to meet a client's compliance requirements.

๐Ÿ’ธ Compare SaaS pricing at scale.

A procurement analyst scrapes all products in the Data Analytics category with a free trial to evaluate cost before vendor calls.

๐Ÿ“ˆ Monitor new market entrants.

A market researcher runs a weekly scrape for 'machine learning' products to track new listings and competitive shifts.

๐Ÿค Identify partnership targets.

A sales engineer scrapes the DevOps category for complementary container-based products to propose a bundled offering.

Why choose this scraper

What you get
No API key Reads the public AWS Marketplace catalog with no registration or credentials.
Structured output Every product returns as a flat row with consistent columns for pricing, deployment, and region.
Flexible input Start from a search term, a category, a direct URL, or scrape the entire catalog.

How it compares

No other Store actor targets AWS Marketplace the same way, so the honest comparison is with the alternatives teams actually weigh.

AWS Marketplace Scraper Build it in-house By hand
Setup Run it now, zero config Days of engineering None, but hours per pull
When AWS Marketplace changes Maintained for you You fix it You re-learn the page
Proxies, retries, anti-bot Built in Your problem Browser only
Output Fixed JSON schema, CSV/Excel export Whatever you build Copy-paste
Cost Pay per result Engineering time Analyst hours

Configure the run

Drive the Actor from a search query, a category, or a direct URL, and filters run as each product is read so only matches reach your dataset. The Input tab lists every parameter.

A first run with the defaults:

{
  "maxItems": 10,
  "categories": [
    "security"
  ],
  "pricingTypes": [
    "free",
    "paid"
  ],
  "productTypes": [
    "saas"
  ],
  "regions": [
    "us-east-1"
  ],
  "operatingSystems": [
    "Linux"
  ],
  "deploymentTypes": [
    "cloud"
  ],
  "freeTrialAvailable": "ALL",
  "awsCertified": "ALL",
  "featured": "ALL"
}

A larger pull:

{
  "maxItems": 200,
  "categories": [
    "security"
  ],
  "pricingTypes": [
    "free",
    "paid"
  ],
  "productTypes": [
    "saas"
  ],
  "regions": [
    "us-east-1"
  ],
  "operatingSystems": [
    "Linux"
  ],
  "deploymentTypes": [
    "cloud"
  ],
  "freeTrialAvailable": "ALL",
  "awsCertified": "ALL",
  "featured": "ALL"
}

Pricing

Pay-per-result: $0.001 per result collected. You pay only for the results written to your dataset.

Results collected Approximate cost
100 results $0.10
1,000 results $1.00
10,000 results $10.00

New Apify accounts start with $5 in free credit.

Free users

Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.

Run it

  1. Create a free Apify account with $5 in credit.
  2. Open the AWS Marketplace Scraper.
  3. Set your inputs and any filters, then click Start.
  4. Export the results as CSV, Excel, JSON, or XML from the Dataset tab.

Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.

Use with AI agents (MCP)

Give an AI agent live access to AWS Marketplace through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/aws-marketplace-scraper"

Then prompt it in plain language to run the scraper and read back the results.

Troubleshooting

Why am I getting no results?

Check that your search query or filters are not too restrictive. Try leaving all filters empty and using only a broad search term, or scrape without any filters to see the full catalog.

The Actor is running slowly. Is that normal?

Scraping many pages takes time. Reduce the Max Items limit for a faster test run, or narrow your search with additional filters to target a smaller set of products.

Some products are missing fields in the output.

Not every product listing on AWS Marketplace fills in all fields. If a product does not list its operating system or deployment type, that cell will be empty in your dataset.

I get an error when using a direct URL.

Ensure the URL is a full, valid AWS Marketplace product page link. The Actor expects a URL that starts with 'https://aws.amazon.com/marketplace/'. If the product is no longer listed, the scrape will fail.

FAQ

Question Answer
Can I scrape the entire AWS Marketplace catalog? Yes. Leave the search query and all filters empty, and set a high Max Items limit. The Actor will paginate through all available product listings.
Do I need an AWS account or API key to use this? No. This Actor reads the public AWS Marketplace website. You do not need an AWS account, IAM role, or any API credentials.
What data does each product row include? Each row includes the product name, description, pricing model, deployment type, supported regions, operating systems, and flags like AWS Certified or free trial availability.
How do I filter for only free products? In the input, set the Pricing Types filter to 'free'. You can combine this with other filters like category or region to narrow results further.
Can I scrape a specific product page directly? Yes. Paste the full URL of an AWS Marketplace product page into the Start URL field. The Actor will extract that single product's details.
What is the maximum number of products I can scrape? Free Apify users are limited to 10 items per run. Paid users can set Max Items up to 1,000,000 to scrape the full catalog.
How do I filter products by AWS region? Use the Regions filter to select one or more AWS regions like us-east-1 or eu-west-1. Only products available in those regions will be returned.
Can I filter for products that offer a free trial? Yes. Set the Free Trial Available filter to 'true' to return only products that offer a free trial.
What export formats are supported? You can export your dataset in CSV, JSON, Excel, or XML formats from the Apify platform.
Does this Actor handle pagination automatically? Yes. It navigates through all pages of search results or category listings until it reaches your Max Items limit or the end of the catalog.

Related actors

Browse the full ParseForge collection for more scrapers.

๐Ÿ†˜ Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.

โš ๏ธ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Amazon Web Services, Inc. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.

Input

FieldTypeWhat it doesDefault
startUrl string Direct URL to scrape from AWS Marketplace. Leave empty to use search filters or scrape all products. not set
maxItems integer Free users: Limited to 100. Paid users: Optional, max 1,000,000 10
searchQuery string Enter specific terms like 'machine learning', 'security', 'database', or 'analytics' to find relevant products. Leave all filters empty to fetch all products. not set
categories array Filter by product categories (optional). Leave empty to include all categories. ["security"]
pricingTypes array Choose pricing models (optional). Leave empty to include all pricing types. ["free","paid"]
productTypes array Filter by product types (optional). Leave empty to include all types. ["saas"]
regions array Filter by AWS regions (optional). Leave empty to include all regions. ["us-east-1"]
operatingSystems array Filter by operating systems (optional). Leave empty to include all operating systems. ["Linux"]
deploymentTypes array Filter by deployment types (optional). Leave empty to include all deployment types. ["cloud"]
freeTrialAvailable string (3 options) Filter by free trial availability (optional). ALL
awsCertified string (3 options) Filter by AWS certification status (optional). ALL
featured string (3 options) Filter by featured status (optional). ALL

Pricing

from $0.50 per 1,000 results

Charged forWhat it isPrice each
result Single result in the default dataset. $0.0005 to $0.001

Tiered: the lower figure is the price on a higher Apify plan. Billing and the free credit live on Apify.

API

One POST returns the dataset directly. Same shape for every scraper in the library, so swapping the slug is the only change.

POST ยท run and get results
curl -X POST "https://api.apify.com/v2/acts/parseforge~aws-marketplace-scraper/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "helloWorld": 123
  }'

Examples

Input that runs as-is.

input.json
{
  "helloWorld": 123
}

Reviews

Rated 5.0 out of 5 across 1 review. Read them on Apify.

Issues

We build and maintain this scraper, so a problem with it comes to us. Report it on the Apify listing and the thread stays attached to the scraper where the next person can find it: open an issue.

Broken and urgent, or you would rather not post in public? Write to parseforge@protonmail.com and it reaches the people who wrote it.

Related scrapers

Run AWS Marketplace Scraper on Apify All scrapers