ParseForge Scrapers

Wikimedia Commons File Talk Scraper

parseforge/wikimedia-commons-file-talk-scraper

Education

Pull discussion pages for files on Wikimedia Commons via the official API. Retrieve page IDs, namespace numbers, titles, and full talk page content including discussion threads, timestamps, and user comments. Ideal for monitoring file-related discussions or archiving talk page history.

Run this scraper See the API call
Total runs
104
Bookmarked
0
Last modified
24 days ago

This scraper was last updated on .

What does the Wikimedia Commons File Talk Scraper return?

ParseForge

Wikimedia Commons File Talk Scraper

Scrape discussion pages from Wikimedia Commons file talk pages.

Features

  • Filter file talk pages by title prefix, resume from any title, sort A to Z or Z to A
  • Extract section headings, comments, timestamps (ISO 8601), and signatures from the page wikitext
  • Structured threads: each section with its comments, author, and timestamp
  • Linked file details: direct image URL, MIME type, dimensions, and file size
  • Last revision ID, date, and editor, plus the templates used on the page (for example deletion-request notices)
  • Optional raw wikitext and an option to keep only pages with signed comments
  • Configurable maximum items (up to 1,000,000 for paid users)
  • Paginated results via the official MediaWiki API, 50 pages per request

Usage

  1. Provide a search term in the input to filter file talk pages by title.
  2. Set the maximum number of items to scrape.
  3. Run the actor and get structured data.

Input

Field Type Description
maxItems Integer Maximum number of items to scrape. Free users limited to 10.
search String Only pages whose file name starts with this text (the "File talk:" prefix is optional).
startFrom String Resume the alphabetical listing at this file name.
sortDirection String ascending (A to Z, default) or descending (Z to A).
onlyWithComments Boolean Skip pages that only hold banners and keep those with at least one signed comment. Default false.
includeWikitext Boolean Add the full wikitext of the talk page. Default true.

Output

Each output item contains:

  • pageId - Wikimedia page ID
  • title - Page title
  • namespace - Namespace number (7 for file talk)
  • discussionPageUrl - URL to the discussion page
  • fileTitle / filePageUrl - The file the discussion is about
  • fileExists - Whether the file still exists on Commons
  • imageUrl - Direct URL of the original file (null if the file was deleted)
  • fileMime, fileWidth, fileHeight, fileSizeBytes - File details
  • sectionHeadings - Array of section headings
  • comments - Array of comment texts
  • timestamps - Array of comment timestamps (ISO 8601)
  • signatures - Array of comment authors, one per signed comment
  • participants - Unique comment authors
  • commentCount - Number of signed comments
  • threads - Sections with their comments (text, user, timestamp)
  • templates - Templates used on the page
  • lastRevisionId, lastEditedAt, lastEditor - Latest revision of the talk page
  • pageLengthBytes - Page size
  • wikitext - Raw page content (when includeWikitext is on)
  • scrapedAt - ISO timestamp of when the item was scraped

Limits

  • Free users: maximum 10 items
  • Paid users: up to 1,000,000 items

Sign Up

Upgrade to a paid plan for higher limits.

What input does the Wikimedia Commons File Talk Scraper accept?

FieldTypeWhat it doesDefault
maxItems integer Free users: Limited to 10 items (preview). Paid users: Optional, max 1,000,000 10
search string Only file talk pages whose file name starts with this text, e.g. "Mona Lisa". The "File talk:" prefix is optional. Case-sensitive after the first letter. not set
startFrom string Resume the alphabetical listing at this file name (inclusive). Useful to continue a previous run. not set
sortDirection string (2 options) Alphabetical order of the listing. ascending
onlyWithComments boolean Skip talk pages that only hold banners (for example deletion-request "kept" notices) and keep those with at least one signed comment. false
includeWikitext boolean Add the full wikitext of the talk page to each result. true

How much does the Wikimedia Commons File Talk Scraper cost?

from $2.90 per 1,000 results

Charged forWhat it isPrice each
result Single result in the default dataset. $0.002896 to $0.004

Tiered: the lower figure is the price on a higher Apify plan. Billing and the free credit live on Apify.

How do I call the Wikimedia Commons File Talk Scraper API?

One POST returns the dataset directly. Same shape for every scraper in the library, so swapping the slug is the only change.

POST · run and get results
curl -X POST "https://api.apify.com/v2/acts/parseforge~wikimedia-commons-file-talk-scraper/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "maxItems": 10,
    "sortDirection": "ascending",
    "onlyWithComments": false,
    "includeWikitext": true
  }'

What example inputs can I use?

Use these inputs to see how a run is configured.

input.json
{
  "maxItems": 10,
  "sortDirection": "ascending",
  "onlyWithComments": false,
  "includeWikitext": true
}

What do users say about the Wikimedia Commons File Talk Scraper?

No reviews yet. Be the first.

How do I report an issue with the Wikimedia Commons File Talk Scraper?

We build and maintain this scraper, so a problem with it comes to us. Report it on the Apify listing and the thread stays attached to the scraper where the next person can find it: open an issue.

Broken and urgent, or you would rather not post in public? Write to parseforge@protonmail.com and it reaches the people who wrote it.

What related scrapers can I use?

Run Wikimedia Commons File Talk Scraper on Apify All scrapers