ParseForge
Ansible Galaxy Roles Scraper
parseforge/ansible-galaxy-roles-scraper
Developer toolsAutomationOther
Scrapes Ansible Galaxy roles by keyword search or full catalog browse. Returns each role as a flat row with name, description, tags, and download counts.
- Total users
- 2
- Monthly active
- 1
- Total runs
- 44
- Bookmarked
- 0
- Rating
- Not rated yet
- Last modified
- 12 days ago
Overview
Ansible Galaxy Roles Scraper
Scrape Ansible Galaxy roles by keyword or browse the full catalog, up to a million per run. Each role comes with its name, description, tags, and download counts. No login or API key. Export to CSV, JSON, Excel, or XML.
Ansible Galaxy's official API requires authentication and rate-limits you. This reads the public role list directly, filtered by keyword, and returns each match in one fixed schema. Search for docker, nginx, kubernetes, or any role name, and get the data you need for your automation projects.
| Who uses it | What they scrape Ansible Galaxy for |
|---|---|
| DevOps engineers | Find the most popular roles for a technology stack before writing playbooks |
| Automation architects | Audit which community roles exist for a given service or platform |
| Security teams | Review role metadata and download counts to assess adoption and maintenance |
| Market researchers | Track which Ansible roles are trending in the infrastructure automation space |
What it does
This Actor collects Ansible Galaxy roles by keyword search or full catalog browse, and returns each role as a flat row.
- 🔍 Keyword search: filter roles by name, description, or tags, for example docker, nginx, or kubernetes.
- 📚 Full catalog browse: leave the search query empty to collect every role in Ansible Galaxy, up to a million per run.
- 📊 Flat row output: each role is returned as a single record with its name, description, tags, and download counts.
- 📁 Multiple export formats: download your dataset as CSV, JSON, Excel, or XML.
Results export to CSV, JSON, Excel, or XML, or straight from the API.
What you can do with Ansible Galaxy data
🔍 Find roles for a technology.
A DevOps engineer searches for 'kubernetes' to see all available roles, their descriptions, and download counts, then picks the most maintained one for a new playbook.
📊 Audit role adoption.
A security team browses the full catalog to list every role related to a specific service, then reviews download counts to identify widely used or abandoned roles.
📈 Track automation trends.
A market researcher runs the scraper weekly with different keywords to see which Ansible roles are gaining traction in the infrastructure automation community.
🗂️ Build an internal catalog.
An automation architect collects all roles matching their company's tech stack, exports the data to CSV, and imports it into an internal tool for team reference.
Why choose this scraper
| What you get | |
|---|---|
| No API key | Scrape public role data without registering an application or dealing with OAuth. |
| Keyword filtering | Search by role name, description, or tags to get only the roles you care about. |
| Scalable | Collect up to a million roles per run, enough for full catalog analysis. |
| Fixed schema | Every role is returned in the same flat structure, ready for analysis or export. |
How it compares
This Actor focuses on Ansible Galaxy roles only, while the competitor also scrapes collections and specific collection slugs.
| Feature | ParseForge | Ansible Galaxy Scraper |
|---|---|---|
| Scrape roles by keyword | Yes | Yes |
| Browse full role catalog | Yes | Not listed |
| Scrape collections | No | Yes |
| Fetch specific collection by slug | No | Yes |
| Return download counts | Yes | Yes |
| Return tags and descriptions | Yes | Yes |
Configure the run
Drive the Actor from a keyword search or leave it empty to browse the full role list, and set the maximum number of roles to collect per run. The Input tab lists every parameter.
A first run with the defaults:
{
"maxItems": 10
}
A larger pull:
{
"maxItems": 200
}
Pricing
Pay-per-result: $0.021 per result collected. You pay only for the results written to your dataset.
| Results collected | Approximate cost |
|---|---|
| 100 results | $2.10 |
| 1,000 results | $21.00 |
| 10,000 results | $210.00 |
New Apify accounts start with $5 in free credit.
Free users
Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.
Run it
- Create a free Apify account with $5 in credit.
- Open the Ansible Galaxy Roles Scraper.
- Set your inputs and any filters, then click Start.
- Export the results as CSV, Excel, JSON, or XML from the Dataset tab.
Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.
Use with AI agents (MCP)
Give an AI agent live access to Ansible Galaxy through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:
claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/ansible-galaxy-roles-scraper"
Then prompt it in plain language to run the scraper and read back the results.
Troubleshooting
Why am I getting no results?
Your searchQuery may be too specific or misspelled. Try a broader keyword or leave it empty to browse the full catalog.
Why did the run stop before reaching maxItems?
Ansible Galaxy may have fewer roles than your maxItems value, or the public list may be temporarily limited. Check the run log for details.
Why are some roles missing from my results?
The scraper reads the public role list, which may not include every role if Ansible Galaxy paginates or filters results. Try a more specific search.
Can I get more fields than what is returned?
The Actor returns the fields available in the public role list. If you need additional data, consider using the Ansible Galaxy API directly.
FAQ
| Question | Answer |
|---|---|
| Do I need an Ansible Galaxy account or API key? | No. This Actor reads the public role list directly, so no authentication is required. |
| Can I search by role name or keyword? | Yes. Use the searchQuery input to filter roles by name, description, or tags. Leave it empty to browse the full catalog. |
| What data does each role include? | Each role is returned as a flat row with its name, description, tags, and download counts, among other fields from the public listing. |
| How many roles can I collect in one run? | You can set maxItems up to 1,000,000 roles per run. The default is 10. |
| What export formats are supported? | You can export your dataset as CSV, JSON, Excel, or XML. |
| Does this scrape Ansible Galaxy collections too? | No, this Actor focuses on roles only. For collections, consider a different scraper. |
| Is the data live? | Yes, each run fetches the current public role list from Ansible Galaxy. |
| Can I schedule this scraper to run regularly? | Yes, you can set up a schedule in Apify to run it daily, weekly, or at any interval you need. |
| What if I get no results for my search? | Check your keyword spelling or try a broader term. You can also leave the search empty to browse all roles. |
| Is there a limit on how often I can run this? | No, you can run it as often as you like, subject to your Apify plan limits. |
Related actors
Browse the full ParseForge collection for more scrapers.
🆘 Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.
⚠️ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Red Hat, Inc. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.
Input
| Field | Type | What it does | Default |
|---|---|---|---|
| searchQuery | string | Optional. Keyword to search Ansible Galaxy roles by name, description, or tags (for example docker, nginx, kubernetes). Leave empty to browse the full role list. | not set |
| maxItems | integer | How many roles to collect per run. | 10 |
Pricing
from $19.00 per 1,000 results
| Charged for | What it is | Price each |
|---|---|---|
| result | Single result in the default dataset. | $0.019 to $0.021 |
Tiered: the lower figure is the price on a higher Apify plan. Billing and the free credit live on Apify.
API
One POST returns the dataset directly. Same shape for every scraper in the library, so swapping the slug is the only change.
curl -X POST "https://api.apify.com/v2/acts/parseforge~ansible-galaxy-roles-scraper/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
-H "Content-Type: application/json" \
-d '{
"helloWorld": 123
}' Examples
Input that runs as-is.
{
"helloWorld": 123
} Reviews
No reviews yet. Be the first.
Issues
We build and maintain this scraper, so a problem with it comes to us. Report it on the Apify listing and the thread stays attached to the scraper where the next person can find it: open an issue.
Broken and urgent, or you would rather not post in public? Write to parseforge@protonmail.com and it reaches the people who wrote it.