Beehiiv Newsletter Archive Scraper

Beehiiv Newsletter Archive Scraper

Scrape Beehiiv newsletter archives from any custom domain or beehiiv.com URL, up to a million posts per run. Every post comes with its full text, author, date, and metadata. No login or API key. Export to CSV, JSON, Excel, or XML.

Beehiiv's official API needs an account and API key, and it rate-limits you. This reads the public newsletter archives directly, filtered by keyword, and returns each matching post in one fixed schema. It works with custom domains like therundown.ai and morningbrew.com, and with standard beehiiv.com subdomains.

Who uses it	What they scrape Beehiiv for
Content marketers	Monitor competitor newsletters for topic ideas and publishing cadence.
Market researchers	Track which stories and angles a niche newsletter is covering each week.
Data analysts	Build a structured dataset of newsletter posts for trend analysis.
AI developers	Collect clean newsletter text to fine-tune or prompt language models.

What it does

This Actor collects Beehiiv newsletter posts by newsletter URL and returns each one as a flat row with full text and metadata.

• 🔗 Multiple newsletters per run: paste one URL or a list, and the scraper fans across them until it reaches your maxItems.
• 🔍 Keyword filter: return only posts whose URL slug contains your keyword, so you skip irrelevant issues.
• 📄 Full post text: each row includes the complete body text, ready for analysis or storage.
• 🌐 Custom domains supported: works with any Beehiiv-powered site, not *.beehiiv.com.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

What you can do with Beehiiv data

📈 Monitor competitor newsletters.

A content marketer adds five competitor Beehiiv URLs and gets every post from the last month, then compares topics and frequency to plan their own editorial calendar.

🧠 Build an AI training corpus.

An AI developer scrapes a set of niche newsletters with the keyword filter, collects clean full-text posts, and uses them to fine-tune a domain-specific model.

📊 Track industry trends.

A market researcher runs the scraper weekly on a list of industry newsletters and feeds the dataset into a dashboard to spot rising themes.

🗂️ Archive newsletter history.

A data analyst collects the complete archive of a newsletter into a single CSV for long-term storage and offline analysis.

Why choose this scraper

	What you get
No API key	Scrapes public archives directly, no Beehiiv account needed.
Custom domains	Works with therundown.ai, morningbrew.com, and any Beehiiv-powered site.
High volume	Collect up to 1,000,000 posts per run across multiple newsletters.
Fixed schema	Every post returns the same flat fields, so your pipeline stays stable.

How it compares

This table compares the Beehiiv Newsletter Archive Scraper with other newsletter scrapers that also target Beehiiv, based on their public listings.

Feature	ParseForge	Newsletter Scraper - Substack Archives, LLM-Ready	Newsletter Scraper - Substack, Beehiiv & Ghost	Beehiiv Newsletter Scraper
Scrapes Beehiiv newsletters	Yes	Yes	Yes	Yes
Supports custom domains	Yes	Not listed	Not listed	Yes
Keyword filtering	Yes	Not listed	Not listed	Yes
Full post text	Yes	Yes	Yes	Yes
Markdown output	Not listed	Yes	Not listed	Not listed
Token counts for AI	Not listed	Yes	Not listed	Not listed
Scheduled runs	Yes	Not listed	Not listed	Yes

Configure the run

Drive the Actor from one or many Beehiiv newsletter URLs, and the keyword filter runs as each post is read so only matches reach your dataset. The Input tab lists every parameter.

A first run with the defaults:

{
 "maxItems": 10,
 "newsletterUrls": [
 "https://www.therundown.ai",
 "https://www.morningbrew.com",
 "https://newsletter.theaibreak.com",
 "https://www.milkroad.com",
 "https://www.bensbites.co",
 "https://aiweekly.com"
 ]
}

A larger pull:

{
 "maxItems": 200,
 "newsletterUrls": [
 "https://www.therundown.ai",
 "https://www.morningbrew.com",
 "https://newsletter.theaibreak.com",
 "https://www.milkroad.com",
 "https://www.bensbites.co",
 "https://aiweekly.com"
 ]
}

Pricing

Pay-per-result: $0.011 per result collected. You pay only for the results written to your dataset.

Results collected	Approximate cost
100 results	$1.10
1,000 results	$11.00
10,000 results	$110.00

New Apify accounts start with $5 in free credit.

Free users

Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.

Run it

1. Create a free Apify account with $5 in credit.
2. Open the Beehiiv Newsletter Archive Scraper.
3. Set your inputs and any filters, then click Start.
4. Export the results as CSV, Excel, JSON, or XML from the Dataset tab.

Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.

Use with AI agents (MCP)

Give an AI agent live access to Beehiiv through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/beehiiv-newsletter-scraper"

Then prompt it in plain language to run the scraper and read back the results.

Troubleshooting

Why am I getting no results?

Check that the newsletter URL is correct and publicly accessible. If you set a keywordFilter, try removing it to see if posts are returned without filtering.

Why did the run stop before reaching maxItems?

The scraper stops when it has read all available posts from the provided URLs. Add more newsletter URLs to reach higher item counts.

Why are some posts missing?

The scraper relies on each newsletter's sitemap. If a post is not in the sitemap, it cannot be discovered. Check the sitemap directly to confirm.

Can I scrape a newsletter that requires login?

No. The scraper only accesses public pages. If a newsletter is behind a paywall or login, those posts will not be collected.

Why is the keyword filter not matching?

The filter checks the URL slug, not the post title or body. Make sure your keyword appears in the slug, or remove the filter and filter the dataset afterward.

FAQ

Question	Answer
Do I need a Beehiiv API key?	No. The scraper reads the public newsletter archive pages directly, so no account or key is required.
Can I scrape a newsletter on a custom domain?	Yes. Any Beehiiv-powered site works, whether it uses a custom domain like therundown.ai or a standard beehiiv.com subdomain.
How many posts can I get in one run?	You can set maxItems up to 1,000,000. The scraper fans across all provided newsletter URLs until it reaches that number.
What does the keyword filter do?	It checks the URL slug of each post and returns only those containing your keyword, case-insensitive. It does not search the post body.
What output formats are supported?	You can export the dataset as CSV, JSON, Excel, or XML from the Apify platform.
Can I schedule this scraper to run automatically?	Yes. Use Apify Schedules to run it daily, weekly, or at any interval, and get fresh posts without manual triggers.
Does it scrape subscriber counts or email addresses?	No. It only collects publicly visible post data: text, author, date, and metadata. No private or subscriber information is accessed.
Is this legal to use?	You are responsible for complying with the target website's terms of service and applicable laws. The scraper only accesses publicly available pages.
Can I filter by author or date?	The current input only supports keyword filtering on the URL slug. For author or date filtering, you can post-process the dataset.
What if a newsletter has very few posts?	Add multiple newsletter URLs in the same run. The scraper will combine posts from all of them until maxItems is reached.

Related actors

Browse the full ParseForge collection for more scrapers.

🆘 Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.

⚠️ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Beehiiv, Inc. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.