ParseForge Scrapers

Shanghai ARWU Rankings Scraper

parseforge/shanghai-arwu-rankings-scraper

AIOther

Scrapes the Shanghai ARWU university ranking for a given year and returns each university as a flat row with world rank, national rank, total score, and indicator values.

Run this scraper See the API call
Total users
2
Monthly active
1
Total runs
94
Bookmarked
0
Rating
Not rated yet
Last modified
12 days ago

Overview

ParseForge

Shanghai ARWU University Rankings Scraper

Scrape the full Academic Ranking of World Universities from any year since 2003. Every university comes with its global rank, national rank, total score, and indicator scores. Export to CSV, JSON, Excel, or XML.

The Shanghai ARWU rankings are the definitive global benchmark for university research performance, but the official site offers no bulk export and manual copying is slow. This Actor reads the published ranking table for any year you choose and returns each university as a structured row, ready for analysis.

Who uses it What they scrape ShanghaiRanking ARWU for
Higher education analysts Tracking how a country's universities move in the global top 500 over a decade.
University strategy offices Benchmarking their institution against peer universities on the six ARWU indicators.
Recruitment and admissions teams Building a ranked prospect list of target universities for partnership or student exchange.
Data journalists Compiling multi-year ARWU data to report on national research investment trends.

What it does

This Actor collects the Shanghai ARWU university ranking table for a specified year and returns each ranked institution as one flat row.

  • ๐Ÿ“… Any year since 2003: pick the ranking edition you need, from the inaugural 2003 table to the latest release.
  • ๐Ÿ”ข Capped collection: set a maximum number of universities to fetch, from the top 10 to the full global list.
  • ๐Ÿ“Š All six indicators: each row includes the Alumni, Award, HiCi, N&S, PUB, and PCP scores that make up the total.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

What you can do with ShanghaiRanking ARWU data

๐Ÿ“ˆ Monitor national research performance.

A higher education ministry scrapes the full ARWU table each year to count how many of its universities appear in the top 100, 200, and 500, and reports the trend to parliament.

๐Ÿซ Benchmark a university against its peers.

A strategy director scrapes the top 50 universities plus their own institution to compare indicator scores and identify where to invest for a higher rank.

๐Ÿ“ฐ Build a multi-year ranking dataset for a story.

A data journalist scrapes every ARWU edition from 2010 to 2024, merges the datasets, and visualizes which countries gained or lost top-500 universities.

๐ŸŽ“ Qualify partner universities for exchange programs.

An international office scrapes the top 200 universities and filters by country to create a shortlist of potential exchange partners ranked by research output.

Why choose this scraper

What you get
Year selection Choose any ranking year from 2003 to the present
Global rank The university's position in the worldwide ARWU table
National rank The university's position within its own country
Total score The composite ARWU score out of 100
Indicator breakdown Individual scores for Alumni, Award, HiCi, N&S, PUB, and PCP

How it compares

No other Store actor targets ShanghaiRanking ARWU the same way, so the honest comparison is with the alternatives teams actually weigh.

Shanghai ARWU University Rankings Scraper Build it in-house By hand
Setup Run it now, zero config Days of engineering None, but hours per pull
When ShanghaiRanking ARWU changes Maintained for you You fix it You re-learn the page
Proxies, retries, anti-bot Built in Your problem Browser only
Output Fixed JSON schema, CSV/Excel export Whatever you build Copy-paste
Cost Pay per result Engineering time Analyst hours

Configure the run

Drive the Actor by year and a maximum item count, and only the universities within that limit reach your dataset. The Input tab lists every parameter.

A first run with the defaults:

{
 "year": 2024,
 "maxItems": 10
}

A larger pull:

{
 "year": 2024,
 "maxItems": 200
}

Pricing

Pay-per-result: $0.021 per result collected. You pay only for the results written to your dataset.

Results collected Approximate cost
100 results $2.10
1,000 results $21.00
10,000 results $210.00

New Apify accounts start with $5 in free credit.

Free users

Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.

Run it

  1. Create a free Apify account with $5 in credit.
  2. Open the Shanghai ARWU University Rankings Scraper.
  3. Set your inputs and any filters, then click Start.
  4. Export the results as CSV, Excel, JSON, or XML from the Dataset tab.

Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.

Use with AI agents (MCP)

Give an AI agent live access to ShanghaiRanking ARWU through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/shanghai-arwu-rankings-scraper"

Then prompt it in plain language to run the scraper and read back the results.

Troubleshooting

Why am I getting no results?

Check that the year you entered is 2003 or later. The ARWU ranking started in 2003, and years before that return an empty page. Also confirm the year's ranking has been published on the official site.

The Actor returns fewer universities than I set in maxItems.

The ARWU table for that year may contain fewer ranked institutions than your limit. The Actor collects every university on the page and stops when the table ends.

Some indicator scores are missing or blank.

ShanghaiRanking does not always publish every indicator score for every university, especially for institutions ranked lower in the table. Blank values reflect what the official page shows.

The run fails with a timeout error.

The ShanghaiRanking site may be slow or temporarily unavailable. Retry the run after a few minutes. If the problem persists, increase the timeout in the Actor's advanced settings.

Can I scrape multiple years in one run?

No, each run scrapes one year. To collect multiple years, run the Actor once per year, or set up a task for each year and run them sequentially.

FAQ

Question Answer
What is the Shanghai ARWU ranking? The Academic Ranking of World Universities, published by ShanghaiRanking Consultancy since 2003, ranks universities worldwide by research performance using six objective indicators including Nobel Prizes, highly cited researchers, and papers published in Nature and Science.
Which years can I scrape? You can scrape any year from 2003, the first edition, up to the most recent release. Set the year in the input and the Actor fetches that edition's table.
Does this Actor require an API key or login? No. It reads the publicly available ranking pages on the ShanghaiRanking website directly, so no registration or API key is needed.
What data does each row contain? Each row includes the university name, global rank, national or regional rank, total score, and the six indicator scores: Alumni, Award, HiCi, N&S, PUB, and PCP.
Can I limit how many universities are scraped? Yes. Set the maximum universities input to any number from 1 up, and the Actor stops after collecting that many ranked institutions.
What export formats are supported? You can export the dataset to CSV, JSON, Excel, or XML from the Apify dataset tab after the run completes.
How long does a full scrape take? The ARWU ranking page loads quickly, so even fetching the full list of 1,000 universities completes in under a minute.
Can I schedule this Actor to run every year? Yes. Use Apify's scheduler to run the Actor once a year after the new ARWU edition is published, and your dataset stays current automatically.
Does the Actor handle the Chinese-language version of the site? The Actor reads the English edition of the ranking table. If you need the Chinese-language version, contact support for a custom variant.
What is the difference between global rank and national rank? Global rank is the university's position among all ranked institutions worldwide. National or regional rank is its position within its own country or region.

Related actors

Browse the full ParseForge collection for more scrapers.

๐Ÿ†˜ Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.

โš ๏ธ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by ShanghaiRanking Consultancy. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.

Input

FieldTypeWhat it doesDefault
year integer Year 2024
maxItems integer How many universities to collect per run. 10

Pricing

from $19.00 per 1,000 results

Charged forWhat it isPrice each
Result item Each result row pushed to the dataset. $0.019 to $0.021

Tiered: the lower figure is the price on a higher Apify plan. Billing and the free credit live on Apify.

API

One POST returns the dataset directly. Same shape for every scraper in the library, so swapping the slug is the only change.

POST ยท run and get results
curl -X POST "https://api.apify.com/v2/acts/parseforge~shanghai-arwu-rankings-scraper/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "helloWorld": 123
  }'

Examples

Input that runs as-is.

input.json
{
  "helloWorld": 123
}

Reviews

No reviews yet. Be the first.

Issues

We build and maintain this scraper, so a problem with it comes to us. Report it on the Apify listing and the thread stays attached to the scraper where the next person can find it: open an issue.

Broken and urgent, or you would rather not post in public? Write to parseforge@protonmail.com and it reaches the people who wrote it.

Related scrapers

Run Shanghai ARWU Rankings Scraper on Apify All scrapers