SEC Investment Adviser (IAPD) Scraper

SEC Investment Adviser (IAPD) Scraper

Scrape SEC-registered investment adviser firms and individual representatives from the IAPD database. Get firm names, CRD numbers, registration status, and disclosure history for up to a million records per run. Export to CSV, JSON, Excel, or XML.

The SEC's IAPD website lets you look up one adviser at a time, but bulk research means hours of manual clicking. This Actor searches the public Investment Adviser Public Disclosure database by firm name, individual name, or CRD number, and returns every matching record in a structured dataset. No API key, no browser extension, no copy-paste.

Who uses it	What they scrape SEC Investment Adviser Public Disclosure (IAPD) for
Compliance officers	Audit a list of RIA firms for active registration and disciplinary disclosures.
Investor advocates	Screen financial advisers for past regulatory actions before recommending them.
Lead generation teams	Build a prospecting list of newly registered or recently disclosed advisory firms.
Financial journalists	Pull disclosure histories on firms tied to a breaking investigation.

What it does

This Actor searches the SEC IAPD database for investment adviser firms or individuals and returns each match as a flat row with registration status, CRD number, and disclosure flags.

• 🏢 Firm or individual search: toggle between searching adviser firms (RIAs) and individual investment adviser representatives.
• 🔢 CRD number lookup: enter a known CRD number to pull the exact record for one firm or person.
• ✅ Active-only filter: restrict results to currently registered advisers, skipping terminated or withdrawn registrations.
• 📦 Bulk collection: set a high maxItems value to pull thousands of records in one scheduled run.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

What you can do with SEC Investment Adviser Public Disclosure (IAPD) data

📋 Verify adviser credentials.

A compliance team runs a nightly search for their firm's CRD number to confirm registration status and catch any new disclosures.

🔍 Screen a list of prospects.

A wealth management recruiter searches individual adviser names in bulk to filter out candidates with disciplinary histories.

📊 Monitor industry disclosures.

A financial newsroom schedules weekly runs for large advisory firms to flag new regulatory events for investigative reporting.

🏗️ Build an RIA directory.

A data vendor scrapes all active firms by searching common keywords, then enriches their internal CRM with CRD numbers and statuses.

Why choose this scraper

	What you get
No API required	Reads the public IAPD search results directly, no SEC account or API key needed.
Fixed flat schema	Every adviser row comes with the same fields: name, CRD number, status, and disclosure indicators.
Active-only toggle	Filter out terminated firms and advisers so you only see currently registered entities.
Runs on Apify	Schedule daily checks, set webhooks, and store results in Apify's cloud without managing servers.

How it compares

No other Store actor targets SEC Investment Adviser Public Disclosure (IAPD) the same way, so the honest comparison is with the alternatives teams actually weigh.

	SEC Investment Adviser (IAPD) Scraper	Build it in-house	By hand
Setup	Run it now, zero config	Days of engineering	None, but hours per pull
When SEC Investment Adviser Public Disclosure (IAPD) changes	Maintained for you	You fix it	You re-learn the page
Proxies, retries, anti-bot	Built in	Your problem	Browser only
Output	Fixed JSON schema, CSV/Excel export	Whatever you build	Copy-paste
Cost	Pay per result	Engineering time	Analyst hours

Configure the run

Drive the Actor with a firm name, individual name, or CRD number, and narrow results to active registrations only so your dataset contains only currently relevant records. The Input tab lists every parameter.

A first run with the defaults:

{
  "query": "goldman",
  "maxItems": 10,
  "searchType": "Firm"
}

A larger pull:

{
  "query": "goldman",
  "maxItems": 200,
  "searchType": "Firm"
}

Pricing

Pay-per-result: $0.021 per result collected. You pay only for the results written to your dataset.

Results collected	Approximate cost
100 results	$2.10
1,000 results	$21.00
10,000 results	$210.00

New Apify accounts start with $5 in free credit.

Free users

Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.

Run it

1. Create a free Apify account with $5 in credit.
2. Open the SEC Investment Adviser (IAPD) Scraper.
3. Set your inputs and any filters, then click Start.
4. Export the results as CSV, Excel, JSON, or XML from the Dataset tab.

Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.

Use with AI agents (MCP)

Give an AI agent live access to SEC Investment Adviser Public Disclosure (IAPD) through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/sec-investment-adviser-scraper"

Then prompt it in plain language to run the scraper and read back the results.

Troubleshooting

Why am I getting no results?

Check your query spelling. The IAPD search is exact on names. Try a shorter keyword or a partial firm name. Also confirm you have the correct searchType selected (Firm vs Individual).

The Actor returns fewer results than expected.

The activeOnly filter may be excluding terminated registrations. Disable it to see all historical records. Also note that IAPD pagination may cap at a certain depth for very broad searches.

I'm getting blocked or seeing captchas.

The SEC site may throttle aggressive scraping. Reduce your maxItems, add a longer delay between runs, or use Apify's proxy rotation to distribute requests across IPs.

The CRD number search returns the wrong entity.

Ensure you are entering the full CRD number without dashes or spaces. If the number belongs to an individual but searchType is set to Firm, switch it to Individual and retry.

Some fields are empty in my dataset.

Empty fields mean the IAPD listing did not contain that data for the specific adviser. This is normal. Not all advisers have disclosures, and some older records have less detail.

FAQ

Question	Answer
What is the IAPD database?	The Investment Adviser Public Disclosure (IAPD) database is the SEC's official public registry of investment adviser firms and individuals. It contains registration status, Form ADV filings, and disciplinary disclosures.
Can I scrape both firms and individual advisers?	Yes. Use the searchType input to switch between 'Firm' and 'Individual' searches. Each run targets one type, so run the Actor twice to collect both.
What does the activeOnly filter do?	When enabled, it returns only advisers and firms with an active registration status. Terminated, withdrawn, and cancelled registrations are excluded from results.
How do I search by CRD number?	Enter the CRD number in the query field. The IAPD search treats numeric queries as CRD lookups, returning the matching firm or individual directly.
Does this Actor return Form ADV details?	This Actor returns the search result listing from IAPD, which includes registration status and disclosure flags. Full Form ADV text is not included in the search results page.
Is there a rate limit on the SEC website?	The SEC's public site may throttle rapid requests. If you are collecting thousands of records, the Actor paces requests to avoid blocks. Running from Apify's US-based IPs helps with access.
Can I schedule this to run daily?	Yes. Apify's scheduler lets you set a cron expression to run the Actor daily, weekly, or on any interval. Combine it with a webhook to get alerts when new disclosures appear.
What export formats are supported?	You can export results to CSV, JSON, Excel, XML, or RSS from the Apify dataset tab. The schema is consistent across all formats.
Do I need an SEC account or API key?	No. This Actor reads the public IAPD website directly. No registration, no API key, and no EDGAR access credentials are required.
How many records can I scrape in one run?	Set maxItems up to 1,000,000. The actual number returned depends on how many results match your search query on IAPD.

Related actors

Browse the full ParseForge collection for more scrapers.

🆘 Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.

⚠️ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by U.S. Securities and Exchange Commission. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.