ParseForge Scrapers

DOAJ Subject Classification Scraper

parseforge/doaj-subject-classification-scraper

Education

Run this scraper See the API call
Total users
2
Monthly active
1
Total runs
13
Bookmarked
0
Rating
Not rated yet
Last modified
3 days ago

Overview

ParseForge Banner

πŸ“š DOAJ Journals & Subject Classification Scraper

πŸš€ Export every open-access journal in the Directory of Open Access Journals, with its subject classification, in seconds.

This Actor pulls open-access journals straight from the official DOAJ API and returns each journal with its full LCC (Library of Congress Classification) subject list, ISSNs, publisher, country, license, language, and article-processing-charge policy. No login, no key, no HTML scraping: it reads the same public API that powers doaj.org.

The Directory of Open Access Journals indexes more than 23,000 vetted, peer-reviewed open-access journals from over 130 countries. This scraper turns that catalog into a clean, structured dataset you can filter, join, and analyse.

For Use it to
Researchers & librarians Map research fields, build reading lists, audit OA coverage by subject
Publishers & analysts Benchmark APC policies, licenses, and country distribution
Data teams Enrich journal metadata with standardized subject codes and ISSNs

πŸ“‹ What it does

  • Queries the DOAJ journals API with any full-text search (title, subject, ISSN, publisher, keyword), or * for the entire catalog.
  • Returns one row per journal with its subject classifications and core metadata.
  • Paginates automatically up to your maxItems.

πŸ’‘ Why it matters: the DOAJ website blocks bulk HTML scraping, but its API is open. This Actor uses the API, so runs are fast, complete, and never return a challenge page.

πŸ“Š Output

Field Description
πŸ“• title Journal title
πŸ”— url DOAJ table-of-contents URL
πŸ†” journalId DOAJ journal id
🏷️ primarySubject First LCC subject term
πŸ—‚οΈ subjects All classifications: { scheme, code, term }
πŸ”‘ subjectCodes LCC codes only
#️⃣ issns Print and electronic ISSNs
🏒 publisher Publisher name
🌍 country Publisher country (ISO code)
πŸ—£οΈ languages Publication languages
πŸ”‘ keywords Journal keywords
πŸ“„ licenses License types (e.g. CC BY)
πŸ’³ apcCharges Whether the journal charges an APC
πŸ“… oaStartYear Year open access began
πŸ•’ lastUpdated DOAJ record last-updated timestamp
πŸ•“ scrapedAt When this row was collected

Sample record:

{
  "title": "Revista de PsicologΓ­a",
  "url": "https://doaj.org/toc/0719-0581",
  "primarySubject": "Psychology",
  "subjects": [{ "scheme": "LCC", "code": "BF1-990", "term": "Psychology" }],
  "subjectCodes": ["BF1-990"],
  "issns": ["0719-0581", "0716-8039"],
  "publisher": "Universidad de Chile",
  "country": "CL",
  "licenses": ["CC BY-NC"],
  "apcCharges": false,
  "oaStartYear": 2007
}

πŸš€ How to use

  1. Create a free account w/ $5 credit.
  2. Open the Actor, set a query (or leave * for everything) and maxItems.
  3. Run it and download the dataset as JSON, CSV, Excel, or XML.

❓ FAQ

Do I need a DOAJ API key? No. The Actor uses the public DOAJ API.

Can I get every journal? Yes. Use query: "*" and raise maxItems; the catalog is ~23,000 journals.

What does the subject code mean? DOAJ classifies journals with the Library of Congress Classification (LCC). subjectCodes holds the codes; subjects holds the human-readable terms and scheme.

How fresh is the data? Every run reads the DOAJ API live, so it reflects the current catalog.

πŸ”— Recommended Actors

πŸ’‘ Pro Tip: browse the complete ParseForge collection for more research and data-enrichment Actors.


This Actor is not affiliated with DOAJ. It reads publicly available data from the DOAJ API for research and analysis. Respect DOAJ's terms and cite the source where appropriate.

Input

FieldTypeWhat it doesDefault
query string Full-text query against the DOAJ journals API (title, subject, ISSN, publisher, keywords). Use * for every indexed open-access journal. *
maxItems integer Free users: Limited to 10 items (preview). Paid users: Optional, max 1,000,000 10

Pricing

from $3.62 per 1,000 results

Charged forWhat it isPrice each
result Single result in the default dataset. $0.00362 to $0.004

Tiered: the lower figure is the price on a higher Apify plan. Billing and the free credit live on Apify.

API

One POST returns the dataset directly. Same shape for every scraper in the library, so swapping the slug is the only change.

POST Β· run and get results
curl -X POST "https://api.apify.com/v2/acts/parseforge~doaj-subject-classification-scraper/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "helloWorld": 123
  }'

Examples

Input that runs as-is.

input.json
{
  "helloWorld": 123
}

Reviews

No reviews yet. Be the first.

Issues

We build and maintain this scraper, so a problem with it comes to us. Report it on the Apify listing and the thread stays attached to the scraper where the next person can find it: open an issue.

Broken and urgent, or you would rather not post in public? Write to parseforge@protonmail.com and it reaches the people who wrote it.

Related scrapers

Run DOAJ Subject Classification Scraper on Apify All scrapers