ParseForge Scrapers

BidNet Direct Government Bids Scraper

parseforge/governmentbids-scraper

BusinessAutomationDeveloper tools

Collect public government bid listings from BidNetDirect using direct listing URLs or live search filters such as keywords, status, category, location, publish date, and agency type.

Run this scraper See the API call
Total users
84
Monthly active
10
Total runs
6.3K
Bookmarked
0
Last modified
2 days ago

This scraper was last updated on .

What does the BidNet Direct Government Bids Scraper return?

ParseForge

BidNet Direct Government Bids Scraper

Scrape government bids and RFPs from BidNet Direct with keyword, location, agency type, and date filters. Each row returns the solicitation title, URL, status, publication and closing dates, and optional detail fields. No login or API key. Export to CSV, JSON, Excel, or XML.

Low minimum charge: $0.005 to start a run, then you only pay for the results you get.

BidNet Direct lists thousands of open and closed government solicitations across US states, counties, and federal agencies, but manually checking the portal for new opportunities eats hours. This Actor reads the public listing pages directly, applies your filters as it goes, and returns every matching bid in one flat row. Use it to monitor new RFPs, build a bid pipeline, or feed your own database.

Who uses it What they scrape BidNet Direct for
Government contractors Find open bids in their industry and location before the deadline
Bid consultants Monitor new RFPs for multiple clients across different agencies
Market researchers Analyze public procurement trends by category, agency, or region
Sales teams Build a list of government buyers actively soliciting services
Procurement analysts Track closed bids to study award patterns and competitor activity

What it does

This Actor collects government bid solicitations from BidNet Direct by direct URL or search filters, and returns each one as a flat row with title, URL, status, dates, and optional detail fields.

  • ๐Ÿ”Ž Search filters: keywords (a comma list matches any of them), bid status, category, state, publication date, agency type, and sort order.
  • ๐Ÿ”— Direct URLs: paste any BidNet Direct listing page URL and collect from it.
  • ๐Ÿ“‹ Detail fields: optionally open each bid page to add AI overview and detail timestamps.
  • ๐Ÿ“Š Flat output: every bid is one row, ready for CSV, JSON, Excel, or XML export.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

What you can do with BidNet Direct data

๐Ÿ“ฌ Monitor new RFPs daily.

A government contractor sets the keyword to their service, bidStatus to open, and publishDate to Last 24 Hours, then schedules the Actor to run every morning and exports new bids to a spreadsheet.

๐Ÿ“ Find local opportunities.

A small business owner enters their state and a category to see only open bids in their region, sorted by closing date.

๐Ÿ“Š Analyze closed bid history.

A market researcher collects closed bids for a category over the past year to study which agencies buy the most and what they pay.

๐Ÿ›๏ธ Track federal vs. state spending.

A procurement analyst runs the Actor with agencyType set to Federal Bids and then State & Local Bids to compare solicitation volume and deadlines.

๐Ÿ”— Scrape a specific listing page.

A consultant pastes the URL of a BidNet Direct search result page into startUrl to collect exactly the bids they already see in the browser.

Why choose this scraper

What you get
No login or API key Reads the public listing pages directly, so you can start scraping in minutes.
Filter before you download Keyword, status, category, location, date, and agency type filters reduce noise.
Open and closed bids Collect current opportunities or historical awards for analysis.
Optional detail fields Enable includeDetails to get AI overview and detail timestamps from each bid page.
Flexible input Use a direct URL or let the Actor build the search URL from your filters.

How it compares

This Actor offers the same core BidNet Direct scraping as the competitors below, with additional filters for agency type, category codes, and sort options, plus optional detail fields.

Feature ParseForge BidNet Direct Government Bids Scraper BidNet Direct [Closed ๐Ÿ”ด] Bid Opportunities Scraper BidNet Direct [Open โœ…] Bid Opportunities Scraper
Keyword search filter Yes Yes Not listed Not listed
Location filter Yes Yes Not listed Not listed
Category code filter Yes Not listed Not listed Not listed
Agency type filter Yes Not listed Not listed Not listed
Sort options Yes Not listed Not listed Not listed
Optional detail fields (AI overview, timestamps) Yes Not listed Not listed Not listed
Open and closed bids in one actor Yes Yes Closed only Open only

Configure the run

Drive the Actor from direct BidNet Direct URLs or search filters, and filters run as each listing is read so only matches reach your dataset. The Input tab lists every parameter.

A first run with the defaults:

{
  "startUrl": [
    {
      "url": "https://www.bidnetdirect.com/public/solicitations/open"
    }
  ],
  "maxItems": 10
}

A larger pull:

{
  "startUrl": [
    {
      "url": "https://www.bidnetdirect.com/public/solicitations/open"
    }
  ],
  "maxItems": 200
}

With search filters instead of a URL. Commas between keywords mean "any of these", and states can be names, two-letter codes or BidNet location IDs:

{
  "keywords": "sidewalk, trip hazard, concrete, ADA",
  "locations": "ohio, california, TX",
  "categories": "construction",
  "bidStatus": "open",
  "publishDate": "WEEK_1",
  "sortOption": "publicationDateDesc",
  "maxItems": 100
}

Free users

Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.

Run it

  1. Create a free Apify account with $5 in credit.
  2. Open the BidNet Direct Government Bids Scraper.
  3. Set your inputs and any filters, then click Start.
  4. Export the results as CSV, Excel, JSON, or XML from the Dataset tab.

Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.

Use with AI agents (MCP)

Give an AI agent live access to BidNet Direct through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/governmentbids-scraper"

Then prompt it in plain language to run the scraper and read back the results.

Troubleshooting

Why am I getting no results?

Check that your filters are not too restrictive. Try removing categories or locations, or set publishDate to All. Keywords written with spaces and no commas must all appear in the bid, so road sidewalk repair is narrower than road, sidewalk, repair. If a run with 0 results says no bids match, the search itself returned nothing; if the site could not be reached, the run ends as Failed with the reason.

Why did the run stop at 10 items?

Free Apify accounts are limited to 10 items per run as a preview. Upgrade to a paid plan to increase maxItems up to 1,000,000.

Why are some fields empty in the output?

Some fields, like AI overview or detail timestamps, are only populated when includeDetails is enabled. Enable that option and rerun.

Why is the Actor slow when includeDetails is on?

Opening each bid detail page takes extra time. If you do not need the detail fields, disable includeDetails for faster runs.

Can I use both startUrl and search filters?

You can leave both filled in, but only one is used: when any search filter (keywords, categories, locations, publishDate or agencyType) is set, the Actor runs the search and ignores startUrl, and the log says so. To collect a startUrl, clear the search filters. bidStatus and sortOption never override a startUrl.

Why did I get an error saying BidNet Direct does not recognize a location or category?

The Actor checks every location and category before searching, because BidNet Direct answers an unknown value with an error page. The message lists the values it could not match. Locations take US state and territory names (ohio, new york), two-letter codes (OH, NY) or BidNet location IDs (229). Categories take the category name (construction) or its BidNet code (320204).

FAQ

Question Answer
Do I need a BidNet Direct account or API key? No. The Actor reads the public listing pages on BidNet Direct, so no login or API key is required.
Can I scrape both open and closed bids? Yes. Set bidStatus to Open Bids or Closed Bids, or run the Actor twice with different settings.
How do I filter by location? Use the locations field with comma-separated US states or territories, written as names (florida, texas), two-letter codes (FL, TX) or BidNet location IDs (73, 277).
How do I filter by category? Enter one or more of BidNet Direct's categories, comma-separated, by name (construction, utilities) or by code (320204, 320179).
How do several keywords combine? Separate keywords with commas to get bids that match any of them, for example sidewalk, trip hazard, concrete. Words inside one keyword, like trip hazard, must all appear.
Can I sort the results? Yes. Use sortOption to order by publication date, closing date, solicitation title, or location, in ascending or descending order.
What does includeDetails do? When enabled, the Actor opens each bid detail page and adds public fields such as AI overview and detail timestamps to the output.
How many bids can I scrape? Free Apify users are limited to 10 bids per run. Paid users can set maxItems up to 1,000,000.
Can I use a direct URL instead of search filters? Yes. Paste any BidNet Direct listing page URL into startUrl and leave the search filters empty. If a search filter is set, the filters are used instead.
What export formats are supported? You can export the results to CSV, JSON, Excel, or XML from the Apify dataset.
Does this Actor handle pagination? Yes, it follows pagination on the listing pages until it reaches maxItems or no more results.
Can I schedule this Actor to run automatically? Yes, you can schedule it in Apify to run daily, hourly, or on a custom cron schedule.
Is this Actor affiliated with BidNet Direct? No, this is an independent scraper built by ParseForge. It is not affiliated with or endorsed by BidNet Direct.

๐Ÿ†˜ Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.

โš ๏ธ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by BidNet Direct. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.

What input does the BidNet Direct Government Bids Scraper accept?

FieldTypeWhat it doesDefault
startUrl array BidNet Direct listing URLs to collect from. National listing pages are followed across pages up to Maximum bids. If any search filter below is set (keywords, categories, location, published date or agency type), the filters are used and these URLs are ignored. [{"url":"https://www.bidnetdirect.com/pu
maxItems integer Free users: Limited to 10. Paid users: Optional, max 1,000,000. 10
keywords string Search by keyword or bid title. Separate several keywords with commas to get bids that match any of them, for example: sidewalk, trip hazard, concrete. When set, Start URL above is ignored. not set
bidStatus string (2 options) Choose whether to collect open bids or closed bids. not set
categories string Optional comma-separated categories, by name or BidNet code, for example: construction, utilities or 320204, 320179. not set
locations string Optional comma-separated US states or territories, as names, two-letter codes or BidNet location IDs, for example: ohio, california or OH, CA or 229, 43. not set
publishDate string (3 options) Limit results by recent publication date. not set
agencyType string (4 options) Filter by the BidNetDirect agency group shown in the listing search UI. not set
sortOption string (8 options) Choose the same ordering options available in the BidNetDirect listing page. not set
includeDetails boolean When enabled, the actor opens each bid detail page and adds public detail fields such as AI overview and detail timestamps. not set

How much does the BidNet Direct Government Bids Scraper cost?

from $12.99 per 1,000 results

Charged forWhat it isPrice each
Result Item Charged once per result collected. $0.01299 to $0.01734
Bid details The solicitation's own page: overview, exact publication and closing times, and for federal notices the SAM.gov record. Charged once per bid, and only when the detail page loaded. $0.006 to $0.008

Tiered: the lower figure is the price on a higher Apify plan. Billing and the free credit live on Apify.

How do I call the BidNet Direct Government Bids Scraper API?

One POST returns the dataset directly. Same shape for every scraper in the library, so swapping the slug is the only change.

POST ยท run and get results
curl -X POST "https://api.apify.com/v2/acts/parseforge~governmentbids-scraper/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "startUrl": [
      {
        "url": "https://www.bidnetdirect.com/public/solicitations/open"
      }
    ],
    "maxItems": 10
  }'

What example inputs can I use?

Use these inputs to see how a run is configured.

input.json
{
  "startUrl": [
    {
      "url": "https://www.bidnetdirect.com/public/solicitations/open"
    }
  ],
  "maxItems": 10
}

What do users say about the BidNet Direct Government Bids Scraper?

No reviews yet. Be the first.

How do I report an issue with the BidNet Direct Government Bids Scraper?

We build and maintain this scraper, so a problem with it comes to us. Report it on the Apify listing and the thread stays attached to the scraper where the next person can find it: open an issue.

Broken and urgent, or you would rather not post in public? Write to parseforge@protonmail.com and it reaches the people who wrote it.

What related scrapers can I use?

Run BidNet Direct Government Bids Scraper on Apify All scrapers