RDAP Domain Lookup Scraper

RDAP Domain Lookup Scraper

Look up RDAP registration data for any domain, any TLD, in bulk. Get registrar details, creation and expiry dates, nameservers, domain status, and registrant info. No API key or registration required. Export to CSV, JSON, Excel, or XML.

WHOIS is being replaced by RDAP, but querying it across hundreds of TLDs means hitting different registry servers with different rate limits. This Actor uses IANA's bootstrap to route every domain to its authoritative RDAP server, so you get structured registration data for.com.org.io, and every other TLD from one run. Feed it a list of domains and it returns each lookup as a flat row.

Who uses it	What they scrape RDAP Domain Lookup Scraper for
Cybersecurity analysts	Audit domain registration details across a list of suspicious domains to spot patterns in registrars or creation dates.
Domain investors	Check expiry dates and registrar info for hundreds of domains to prioritize acquisition targets.
Brand protection teams	Monitor newly registered domains that match a brand name and extract their registration metadata.
Lead generation specialists	Enrich company domain lists with registrar and creation date data for prospecting.

What it does

This Actor collects RDAP registration data for a list of domains and returns each lookup as a flat row with registrar, dates, nameservers, and status.

• 🌐 Any TLD supported: IANA bootstrap routes.com.org.io.ai, and every other TLD to the correct registry server automatically.
• 📋 Bulk domain input: Paste up to a million domains per run, one per line, and get a structured row back for each.
• ⚙️ Configurable concurrency: Set parallel requests from 1 to 20 to stay under registry rate limits during large lookups.
• 📤 Multiple export formats: Download results as CSV, JSON, Excel, or XML for integration with your existing tools.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

What you can do with RDAP Domain Lookup Scraper data

🔍 Investigate suspicious domains.

A security analyst feeds a list of phishing domains into the Actor and reviews registrar and creation date patterns to link campaigns.

📅 Find expiring domains.

A domain investor runs a portfolio of 5,000 names through the Actor and filters by expiry date to decide which to renew or drop.

🛡️ Monitor brand infringements.

A brand protection team scrapes newly registered domains containing their trademark and extracts registrant metadata for enforcement.

📊 Enrich lead lists.

A sales ops person takes a CSV of company domains and runs them through the Actor to add registrar and domain age columns before outreach.

Why choose this scraper

	What you get
Any TLD	IANA bootstrap maps every domain to its authoritative RDAP server, so.com.org.io, and new TLDs all work.
No API key	RDAP is a public protocol. No registration, no OAuth, no rate-limit tokens to manage.
Structured output	Every lookup returns a flat row with registrar, creation date, expiry date, nameservers, and domain status codes.
Bulk scale	Look up to a million domains per run with configurable concurrency to respect registry rate limits.

How it compares

This Actor focuses on pure RDAP lookups across any TLD with no API key, while competitors bundle WHOIS with other data or require third-party services.

Feature	ParseForge	SimilarWeb Website Scraper - Traffic, WHOIS & Ranking	Domain Availability Checker	WHOIS Domain Lookup: Operational Domain Intelligence
Pure RDAP lookups without API key	Yes	Not listed	Not listed	Not listed
Any TLD support via IANA bootstrap	Yes	Not listed	Not listed	Not listed
Bulk domain input up to 1 million	Yes	Not listed	Yes	Yes
Configurable concurrency for rate limits	Yes	Not listed	Not listed	Not listed
Domain availability checking	Not listed	Not listed	Yes	Not listed
Traffic analytics and rankings	Not listed	Yes	Not listed	Not listed

Configure the run

Drive the Actor from a list of domain names, one per line, and set a maximum number of lookups per run. Concurrency controls how many parallel RDAP requests are made. The Input tab lists every parameter.

A first run with the defaults:

{
 "domains": [
 "apify.com",
 "wikipedia.org",
 "github.io"
 ],
 "maxItems": 10,
 "concurrency": 5
}

A larger pull:

{
 "domains": [
 "apify.com",
 "wikipedia.org",
 "github.io"
 ],
 "maxItems": 200,
 "concurrency": 5
}

Pricing

Pay-per-result: $0.036 per result collected. You pay only for the results written to your dataset.

Results collected	Approximate cost
100 results	$3.60
1,000 results	$36.00
10,000 results	$360.00

New Apify accounts start with $5 in free credit.

Free users

Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.

Run it

1. Create a free Apify account with $5 in credit.
2. Open the RDAP Domain Lookup Scraper.
3. Set your inputs and any filters, then click Start.
4. Export the results as CSV, Excel, JSON, or XML from the Dataset tab.

Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.

Use with AI agents (MCP)

Give an AI agent live access to RDAP Domain Lookup Scraper through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/rdap-domain-lookup-scraper"

Then prompt it in plain language to run the scraper and read back the results.

Troubleshooting

Why am I getting no results for some domains?

The domain may not be registered, or the registry's RDAP server may be unreachable. Check the domain in a browser first. If it is registered, lower the concurrency to 1 and retry to avoid rate limiting.

Why does the run fail with a timeout error?

Some registry RDAP servers are slow or enforce strict rate limits. Reduce the concurrency setting to 1 or 2 and increase the run timeout in your Apify actor settings.

Why are some fields empty in the output?

Not all registries return the same RDAP fields. Registrant contact info is often redacted for privacy. The Actor returns whatever the registry provides in its RDAP response.

Why do I get an error for a valid domain?

The registry's RDAP server may return a non-standard response or be temporarily down. Try the domain again in a separate run with low concurrency. If it persists, the registry may not fully support RDAP yet.

FAQ

Question	Answer
What is RDAP and how is it different from WHOIS?	RDAP is the modern replacement for WHOIS, returning domain registration data in a structured JSON format instead of free text. It is standardized by the IETF and supported by all major registries.
Does this work for any TLD?	Yes. The Actor uses IANA's RDAP bootstrap file to find the authoritative server for every TLD, including.com.org.io.ai, and country-code TLDs.
Do I need an API key or registration?	No. RDAP is a public protocol and this Actor queries registry servers directly. You do not need to sign up for any third-party service.
How many domains can I look up in one run?	You can set a maximum of up to one million domains per run. The concurrency setting controls how many parallel requests are made to stay within registry rate limits.
What fields does the output include?	Each row includes the domain name, registrar, creation date, expiry date, nameservers, domain status codes, and registrant contact information when available.
Why am I getting rate limited or empty results?	Some registries enforce strict rate limits. Lower the concurrency setting to 1 or 2 and try again. Empty results can also happen if the domain has no RDAP server or the registry returns a non-standard response.
Can I use this for domain availability checks?	RDAP returns data for registered domains. If a domain is not registered, the registry will return a 404 error, which the Actor captures as an empty or error row.
What export formats are supported?	Results can be downloaded as CSV, JSON, Excel, or XML from the Apify dataset tab.

Related actors

Browse the full ParseForge collection for more scrapers.

🆘 Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.

⚠️ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by IANA. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.