AEMO NEM Market Data Scraper

AEMO NEM Market Data Scraper

Scrape electricity market data from AEMO's NEMWeb portal, including price, demand, and dispatch tables. Every record captures the raw data as published, ready for CSV, JSON, Excel, or XML export. No API key required.

AEMO's NEMWeb portal publishes critical National Electricity Market data, but manually downloading and parsing the ZIP and CSV files is slow and repetitive. This scraper reads the public market data pages directly, collecting the latest tables and file links so you can feed them into your models and reports. It handles the navigation and extraction, returning a structured dataset from the URLs you provide.

Who uses it	What they scrape AEMO NEMWeb for
Energy analysts	Feed real-time price and demand data into forecasting models.
Traders	Monitor dispatch and pricing tables for trading decisions.
Researchers	Gather historical market data for academic studies on grid behavior.
Market operators	Track regional price and demand figures for compliance reporting.

What it does

This Actor collects market data tables and file links from AEMO NEMWeb pages and returns each row as a flat record.

• 📊 Structured extraction: Tables from NEMWeb pages are parsed into rows and columns automatically.
• 🔗 File link capture: URLs to the latest ZIP and CSV data files are collected for downstream processing.
• ⚙️ Configurable limits: Set a maximum number of items to scrape, from a quick preview to a full-scale run.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

What you can do with AEMO NEMWeb data

📈 Feed short-term trading models.

An energy trader runs the scraper on the dispatch and price pages every five minutes to update their automated bidding strategy.

📋 Automate compliance reporting.

A market operator collects daily regional demand and price summaries to populate a regulatory report with minimal manual effort.

🔍 Research grid events.

A PhD student scrapes historical data archives to analyze price spikes during a particular summer's heatwave.

📊 Build internal dashboards.

An analytics team schedules the scraper to feed a live dashboard showing NEM price and demand trends across all regions.

Why choose this scraper

	What you get
No manual downloads	Stop clicking through pages and unzipping files by hand.
Always current	Each run fetches the latest published data from the live portal.
Flexible output	Export to CSV, JSON, Excel, or XML for your existing toolchain.

How it compares

No other Store actor targets AEMO NEMWeb the same way, so the honest comparison is with the alternatives teams actually weigh.

	AEMO NEM Market Data Scraper	Build it in-house	By hand
Setup	Run it now, zero config	Days of engineering	None, but hours per pull
When AEMO NEMWeb changes	Maintained for you	You fix it	You re-learn the page
Proxies, retries, anti-bot	Built in	Your problem	Browser only
Output	Fixed JSON schema, CSV/Excel export	Whatever you build	Copy-paste
Cost	Pay per result	Engineering time	Analyst hours

Configure the run

Drive the Actor from one or more AEMO NEMWeb page URLs, and set a maximum item count to control the size of your dataset. The Input tab lists every parameter.

A first run with the defaults:

{
 "startUrls": [
 {
 "url": "https://aemo.com.au/en/energy-systems/electricity/national-electricity-market-nem/data-nem/market-data-nemweb"
 }
 ],
 "maxItems": 10
}

A larger pull:

{
 "startUrls": [
 {
 "url": "https://aemo.com.au/en/energy-systems/electricity/national-electricity-market-nem/data-nem/market-data-nemweb"
 }
 ],
 "maxItems": 200
}

Pricing

Pay-per-result: $0.21273 per result collected. You pay only for the results written to your dataset.

Results collected	Approximate cost
100 results	$21.27
1,000 results	$212.73
10,000 results	$2127.30

New Apify accounts start with $5 in free credit.

Free users

Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.

Run it

1. Create a free Apify account with $5 in credit.
2. Open the AEMO NEM Market Data Scraper.
3. Set your inputs and any filters, then click Start.
4. Export the results as CSV, Excel, JSON, or XML from the Dataset tab.

Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.

Use with AI agents (MCP)

Give an AI agent live access to AEMO NEMWeb through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/aemo-nem-market-data-scraper"

Then prompt it in plain language to run the scraper and read back the results.

Troubleshooting

Why am I getting no results?

Check that the URL you provided points to a valid AEMO NEMWeb page with data tables. The page structure may have changed; try a different URL or check the AEMO website directly.

The scraper is only returning 10 items.

This is the default preview limit for free accounts. If you have a paid plan, increase the 'Max Items' setting in the input up to 1,000,000.

Some data is missing from the output.

The scraper extracts what is publicly visible on the page. If a table is loaded dynamically after the page renders, it may not be captured. Verify the data is present in the page's initial HTML.

The run fails with a timeout error.

The target AEMO page may be slow to respond. Try increasing the run timeout in the Actor's advanced settings, or reduce the number of start URLs.

FAQ

Question	Answer
Do I need an AEMO API key or login?	No. This scraper reads the publicly accessible NEMWeb pages, so no registration or API key is required.
What data does this scraper collect?	It extracts the tables and file links present on the NEMWeb pages you target, such as price, demand, and dispatch data. The exact fields depend on the page, and a sample record is shown in the dataset preview.
Can I scrape historical market data?	Yes. If you provide URLs to historical archive pages on NEMWeb, the scraper will collect the data from those pages.
How many items can I scrape?	Free Apify users are limited to 10 items for a preview. Paid users can scrape up to 1,000,000 items per run by adjusting the max items setting.
What format is the exported data in?	You can export your dataset in CSV, JSON, Excel, or XML format from the Apify platform.
How do I target a specific data table?	Provide the exact URL of the NEMWeb page containing the table you want. The scraper will extract all tables and file links found on that page.
Does this scraper download the ZIP and CSV files?	It collects the URLs to those files. You can use another Actor or a simple script to download the files from the captured links.
Can I schedule this scraper to run automatically?	Yes. Apify's scheduler lets you set the scraper to run at regular intervals, such as every 5 minutes or daily.

Related actors

Browse the full ParseForge collection for more scrapers.

🆘 Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.

⚠️ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Australian Energy Market Operator Limited. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.