Politico News Scraper
parseforge/politico-news-scraper
News & mediaDeveloper toolsAutomation
Scrapes Politico articles from official section RSS feeds or custom Politico RSS URLs. Returns each article with headline, author, publication date, and full body text as a flat row.
- Total users
- 1
- Monthly active
- 1
- Total runs
- 70
- Bookmarked
- 0
- Rating
- Not rated yet
- Last modified
- 12 days ago
Overview
Politico News Scraper
Scrape Politico articles from any section or RSS feed, up to a million per run. Every article comes with its headline, author, publication date, and full body text. No login or API key. Export to CSV, JSON, Excel, or XML.
Politico's coverage spans Congress, the White House, defense, health care, and a dozen other policy verticals, but reading across all of them by hand is slow. This Actor reads the official Politico RSS feeds directly, so you collect articles from the sections you care about, or from any custom Politico feed URL, in one fixed schema.\n\nNo browser, no credentials, and no manual clicking. Pick your sections, set a limit, and get structured rows back.
| Who uses it | What they scrape Politico for |
|---|---|
| Policy analysts | Monitor legislative and regulatory developments across multiple policy areas in one feed. |
| Communications professionals | Track how a specific issue or elected official is being covered by the DC press corps. |
| Data journalists | Build a corpus of Politico articles for a long-term investigation or quantitative analysis. |
| Academic researchers | Collect a structured dataset of political news coverage for a study on media framing. |
What it does
This Actor collects Politico articles from the official section RSS feeds or from custom Politico RSS URLs, and returns each article as a flat row.
- ๐ก Pre-built sections: Choose from 14 Politico sections, including Congress, White House, Defense, Health Care, and Playbook.
- ๐ Custom RSS feeds: Paste any valid Politico RSS feed URL to scrape a topic or author feed not in the section list.
- ๐ Flexible limits: Collect as few as one article for a quick check, or up to a million for a full archive.
Results export to CSV, JSON, Excel, or XML, or straight from the API.
What you can do with Politico data
๐ Monitor a policy beat.
A policy analyst runs the Actor daily on the Congress and Health Care sections to catch every hearing mention and bill markup before the morning meeting.
๐ฐ Build a press clipping pipeline.
A communications director feeds the White House and Politics sections into a spreadsheet so the team sees every mention of their principal within an hour of publication.
๐๏ธ Archive coverage for research.
An academic researcher collects a year of Defense and Energy articles to study how national security language shifted across two administrations.
๐ Power a news dashboard.
A developer pulls the Technology and Trade feeds into a live dashboard that tracks policy news alongside market data for a trading desk.
Why choose this scraper
| What you get | |
|---|---|
| No API key needed | Reads the same public RSS feeds your browser does, with no registration or token management. |
| Structured output | Every article lands in your dataset with a consistent schema, ready for analysis or a database. |
| Multi-section in one run | Combine Congress, White House, and Technology in a single run instead of checking each feed separately. |
How it compares
No other Store actor targets Politico the same way, so the honest comparison is with the alternatives teams actually weigh.
| Politico News Scraper | Build it in-house | By hand | |
|---|---|---|---|
| Setup | Run it now, zero config | Days of engineering | None, but hours per pull |
| When Politico changes | Maintained for you | You fix it | You re-learn the page |
| Proxies, retries, anti-bot | Built in | Your problem | Browser only |
| Output | Fixed JSON schema, CSV/Excel export | Whatever you build | Copy-paste |
| Cost | Pay per result | Engineering time | Analyst hours |
Configure the run
Drive the Actor from the built-in section list, custom Politico RSS feed URLs, or both together, and set a maximum article count that applies across all feeds. The Input tab lists every parameter.
A first run with the defaults:
{
"maxItems": 10
}
A larger pull:
{
"maxItems": 200
}
Pricing
Pay-per-result: $0.0075 per result collected. You pay only for the results written to your dataset.
| Results collected | Approximate cost |
|---|---|
| 100 results | $0.75 |
| 1,000 results | $7.50 |
| 10,000 results | $75.00 |
New Apify accounts start with $5 in free credit.
Free users
Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.
Run it
- Create a free Apify account with $5 in credit.
- Open the Politico News Scraper.
- Set your inputs and any filters, then click Start.
- Export the results as CSV, Excel, JSON, or XML from the Dataset tab.
Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.
Use with AI agents (MCP)
Give an AI agent live access to Politico through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:
claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/politico-news-scraper"
Then prompt it in plain language to run the scraper and read back the results.
Troubleshooting
Why am I getting no results?
Check that you have selected at least one section or entered at least one valid Politico RSS feed URL. Also verify that your maximum articles count is set to 1 or higher. If the feeds have no new articles since your last run, the output will be empty.
Why are some articles missing the author or body text?
Some Politico articles, particularly briefs or live updates, may not have a byline or may have a different page structure. The Actor extracts what is available and leaves fields empty when the data is not present on the page.
The run timed out. What should I do?
Lower your maximum articles count or reduce the number of feeds you are scraping in one run. You can split a large backfill across multiple runs by date range or section.
I pasted a feed URL but it is not being scraped.
Make sure the URL is a valid Politico RSS feed that starts with https://rss.politico.com/. The Actor only processes URLs from the Politico RSS domain.
Can I get articles older than what the RSS feed shows?
RSS feeds typically show only the most recent articles, usually the last 20 to 50. The Actor collects whatever the feed returns at the time of the run. For older articles, you would need to run the Actor repeatedly over time to build an archive.
FAQ
| Question | Answer |
|---|---|
| Does this Actor scrape the full article text? | Yes. It follows the link from each RSS item and extracts the full body text of the article, along with the headline, author, and publication date. |
| Can I scrape a Politico section that is not in the dropdown? | Yes. Use the custom RSS feed URLs field to paste any valid Politico RSS feed, such as a topic page or an author feed, and the Actor will collect articles from it. |
| How many articles can I collect in one run? | You set the limit. The maximum is one million articles per run, which is enough to backfill years of coverage across multiple sections. |
| Do I need a Politico subscription or login? | No. The Actor reads the publicly available RSS feeds, which do not require a subscription or authentication. |
| How often are the RSS feeds updated? | Politico updates its RSS feeds continuously throughout the day. Running the Actor on a schedule gives you near-real-time collection of new articles. |
| What output formats are supported? | You can export your dataset as CSV, JSON, Excel, or XML from the Apify platform, or push it directly to an external service via an integration. |
| Can I filter articles by keyword or date? | The Actor collects all articles from the feeds you select, up to your maximum count. You can filter the resulting dataset by any field after the run completes, using Apify's dataset tools or your own scripts. |
| Does this Actor handle Politico's paywalled content? | The Actor reads what is available in the public RSS feed and on the public article page. It does not bypass paywalls or access subscriber-only content. |
| Can I run this on a schedule? | Yes. Apify supports scheduled runs, so you can set the Actor to collect new Politico articles every hour, every morning, or on any cron schedule you need. |
| What is the difference between the sections and the custom feed URLs? | The sections dropdown is a convenience list of the most popular Politico RSS feeds. The custom feed URLs field lets you add any other Politico RSS feed on top of, or instead of, the built-in list. |
Related actors
Browse the full ParseForge collection for more scrapers.
๐ Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.
โ ๏ธ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by POLITICO LLC. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.
Input
| Field | Type | What it does | Default |
|---|---|---|---|
| sections | array | Politico sections to scrape. Each section maps to an official Politico RSS feed. | ["congress"] |
| feedUrls | array | Optional. Full Politico RSS feed URLs (e.g. https://rss.politico.com/congress.xml). Added on top of the selected sections. | not set |
| maxItems | integer | How many articles to collect per run. | 10 |
Pricing
from $6.79 per 1,000 results
| Charged for | What it is | Price each |
|---|---|---|
| result | Single result in the default dataset. | $0.00679 to $0.0075 |
Tiered: the lower figure is the price on a higher Apify plan. Billing and the free credit live on Apify.
API
One POST returns the dataset directly. Same shape for every scraper in the library, so swapping the slug is the only change.
curl -X POST "https://api.apify.com/v2/acts/parseforge~politico-news-scraper/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
-H "Content-Type: application/json" \
-d '{
"helloWorld": 123
}' Examples
Input that runs as-is.
{
"helloWorld": 123
} Reviews
No reviews yet. Be the first.
Issues
We build and maintain this scraper, so a problem with it comes to us. Report it on the Apify listing and the thread stays attached to the scraper where the next person can find it: open an issue.
Broken and urgent, or you would rather not post in public? Write to parseforge@protonmail.com and it reaches the people who wrote it.
