ParseForge
FreightWaves News Scraper
parseforge/freightwaves-scraper
News & mediaAutomationOther
Scrapes public FreightWaves news articles by keyword, category, or date range. Returns each article as a flat row with headline, author, date, and full body text.
- Total users
- 10
- Monthly active
- 0
- Total runs
- 306
- Bookmarked
- 3
- Rating
- 5.0 (1)
- Last modified
- 12 days ago
Overview
FreightWaves News Scraper
Scrape FreightWaves news articles by keyword, category, or date range, up to a million per run. Each article returns its headline, author, publication date, and full body text. No login or API key. Export to CSV, JSON, Excel, or XML.
FreightWaves is the leading news source for freight markets, but manually tracking trucking rates, maritime disruptions, or supply chain regulation is slow. This Actor reads the public news feeds directly, filtered by logistics category, search keyword, or date, and returns each matching article in one fixed schema.
| Who uses it | What they scrape FreightWaves for |
|---|---|
| Logistics analysts | Monitor daily trucking rate headlines and capacity shifts. |
| Supply chain managers | Track container shipping disruptions and port congestion news. |
| Freight brokers | Follow LTL and truckload market trends to adjust pricing. |
| Market researchers | Collect historical freight economics articles for quarterly reports. |
What it does
This Actor collects FreightWaves news articles by keyword, category, or date range, and returns each one as a flat row.
- 🔍 Keyword search: find articles mentioning specific freight topics like 'trucking rates' or 'container shortage'.
- 📂 Category filter: restrict results to trucking, maritime, railroad, air cargo, logistics, shipping, regulation, supply chains, economics, finance, or weather.
- 📅 Date range: pull articles published between two dates to build a historical dataset or track a developing story.
- ⚡ High volume: collect up to 1,000,000 articles in a single run for large-scale freight market intelligence.
Results export to CSV, JSON, Excel, or XML, or straight from the API.
What you can do with FreightWaves data
📈 Monitor trucking rate trends.
A logistics analyst runs the Actor daily with the 'trucking' category and a keyword like 'spot rates' to feed a dashboard that flags pricing shifts.
🚢 Track maritime disruption alerts.
A supply chain manager scrapes the 'maritime' category for 'port congestion' weekly, exporting to CSV for a risk report shared with procurement.
📊 Build a freight news archive.
A market researcher sets a wide date range and the 'economics' category to collect a year of articles for a freight market outlook study.
⚖️ Follow regulatory changes.
A compliance officer filters by the 'regulation' category and a keyword like 'FMCSA' to catch new trucking rules as they are reported.
Why choose this scraper
| What you get | |
|---|---|
| Full article text | The complete body of each news piece, not a snippet. |
| Fixed flat schema | Every article lands in your dataset with the same predictable columns. |
| No API key needed | Reads public FreightWaves pages directly with no registration. |
| Multi-format export | Download as CSV, JSON, Excel, or XML for your existing workflow. |
How it compares
This Actor focuses on high-volume, filtered FreightWaves news extraction with full article text, while other scrapers on Apify offer similar headline-level collection.
| Feature | ParseForge | FreightWaves News Scraper - Low-cost💲🔥📰🚛 | FreightWaves News Scraper |
|---|---|---|---|
| Full article body text | Yes | Not listed | Yes |
| Category filter (trucking, maritime, etc.) | Yes | Not listed | Not listed |
| Keyword search within articles | Yes | Not listed | Not listed |
| Date range filter | Yes | Not listed | Not listed |
| Up to 1,000,000 articles per run | Yes | Not listed | Not listed |
Configure the run
Drive the Actor from a search keyword, a freight category, and a date range, alone or together, and filters run as each article is read so only matches reach your dataset. The Input tab lists every parameter.
A first run with the defaults:
{
"maxItems": 10
}
A larger pull:
{
"maxItems": 200
}
Pricing
Pay-per-result: $0.03199 per result collected. You pay only for the results written to your dataset.
| Results collected | Approximate cost |
|---|---|
| 100 results | $3.20 |
| 1,000 results | $31.99 |
| 10,000 results | $319.90 |
New Apify accounts start with $5 in free credit.
Free users
Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.
Run it
- Create a free Apify account with $5 in credit.
- Open the FreightWaves News Scraper.
- Set your inputs and any filters, then click Start.
- Export the results as CSV, Excel, JSON, or XML from the Dataset tab.
Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.
Use with AI agents (MCP)
Give an AI agent live access to FreightWaves through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:
claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/freightwaves-scraper"
Then prompt it in plain language to run the scraper and read back the results.
Troubleshooting
Why am I getting no results?
Check that your keyword or category combination returns articles on the live FreightWaves site. Also verify your date range is not too narrow or set in the future.
The Actor is running but collecting fewer articles than my maxItems setting.
This is normal when there are not enough articles matching your filters. Try broadening your date range, removing the keyword, or selecting a less specific category.
Some article body text looks truncated or incomplete.
The Actor captures the full text displayed on the public article page. If FreightWaves truncates an article behind a 'read more' paywall, that portion is not accessible.
I get an error about the date format.
The Date From and Date To fields require the exact format YYYY-MM-DD, for example 2024-06-15. Make sure you include the hyphens and use two digits for month and day.
The run takes a long time with a high maxItems value.
Scraping many articles requires polite delays between requests. Reduce the maxItems count or narrow your filters to speed up the run.
FAQ
| Question | Answer |
|---|---|
| Does this scraper need a FreightWaves subscription or login? | No. It reads the public news pages that anyone can view in a browser. You do not need a FreightWaves account, and it does not access SONAR or subscriber-only content. |
| What data fields does each article row include? | The exact field list is shown in the sample output on the Actor's page. It typically includes the headline, author, publication date, category, and the full body text of the article. |
| Can I scrape articles from a specific date range? | Yes. Set the Date From and Date To inputs in YYYY-MM-DD format, and the Actor will return only articles published within that window. |
| How many articles can I collect in one run? | You can set the maximum up to 1,000,000 articles. The Actor will stop when it hits that number or when no more matching articles are found. |
| Can I search for a specific topic across all categories? | Yes. Enter a keyword like 'intermodal' or 'fuel surcharge' in the search field, and the Actor will return articles matching that term from any category. |
| What export formats are supported? | You can export your dataset as CSV, JSON, Excel, or XML directly from the Apify platform. |
| Does this Actor scrape SONAR data or subscriber-only articles? | No. It only collects articles from the publicly accessible FreightWaves news sections. Paywalled content and SONAR market data are not included. |
| Can I combine a category filter with a keyword search? | Yes. All input filters work together. For example, you can set the category to 'trucking' and the keyword to 'driver shortage' to narrow results. |
| Is this an official FreightWaves API? | No. This is an independent web scraper that extracts data from the public FreightWaves website. It is not affiliated with or endorsed by FreightWaves, Inc. |
Related actors
Browse the full ParseForge collection for more scrapers.
🆘 Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.
⚠️ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by FreightWaves, Inc. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.
Input
| Field | Type | What it does | Default |
|---|---|---|---|
| maxItems | integer | How many articles to collect per run. | 10 |
| searchKeyword | string | Search for specific freight or logistics topics | not set |
| category | string (15 options) | Filter by freight category or industry sector | not set |
| dateFrom | string | Start date for filtering articles (YYYY-MM-DD) | not set |
| dateTo | string | End date for filtering articles (YYYY-MM-DD) | not set |
Pricing
from $23.99 per 1,000 results
| Charged for | What it is | Price each |
|---|---|---|
| Actor Start | Charged once when the run starts. | $0.005 |
| Result Item | Charged once per result collected. | $0.02399 to $0.03199 |
Tiered: the lower figure is the price on a higher Apify plan. Billing and the free credit live on Apify.
API
One POST returns the dataset directly. Same shape for every scraper in the library, so swapping the slug is the only change.
curl -X POST "https://api.apify.com/v2/acts/parseforge~freightwaves-scraper/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
-H "Content-Type: application/json" \
-d '{
"helloWorld": 123
}' Examples
Input that runs as-is.
{
"helloWorld": 123
} Reviews
Rated 5.0 out of 5 across 1 review. Read them on Apify.
Issues
We build and maintain this scraper, so a problem with it comes to us. Report it on the Apify listing and the thread stays attached to the scraper where the next person can find it: open an issue.
Broken and urgent, or you would rather not post in public? Write to parseforge@protonmail.com and it reaches the people who wrote it.