ParseForge Scrapers

Yale LUX Cultural Objects Scraper

parseforge/yale-lux-collections-scraper

Developer toolsAutomationOther

Searches the Yale LUX cross-collection catalog by keyword and optional object type, and returns each matching cultural object record as a flat row with its title, maker, date, medium, and linked images.

Run this scraper See the API call
Total users
2
Monthly active
1
Total runs
60
Bookmarked
0
Rating
Not rated yet
Last modified
12 days ago

Overview

ParseForge

Yale LUX Cultural Objects Scraper

Scrape Yale LUX cultural object records by search term, object type, and up to a million items per run. Every record returns its title, maker, date, medium, and linked images. No API key or authentication required. Export to CSV, JSON, Excel, or XML.

Yale University's LUX cross-collection catalog unites millions of objects from its museums, libraries, and archives, but browsing the web interface is slow and manual. This Actor searches the public catalog directly by keyword and optional object type, then returns every matching record in a flat, structured row. It is built for researchers, curators, and data analysts who need bulk exports of cultural heritage metadata without writing code.

Who uses it What they scrape Yale LUX for
Art historians Gathering metadata on all works by a specific artist or from a particular period for a research corpus.
Digital humanities scholars Building a dataset of cultural objects to analyze trends in materials, makers, or classifications across centuries.
Museum curators Comparing Yale's holdings with their own collection for loan or exhibition planning.
Antiquarian book dealers Checking provenance and cataloging details of rare manuscripts and early printed books.
Genealogists Finding portraits, documents, or personal artifacts linked to a family name or historical figure.

What it does

This Actor searches Yale LUX cultural object records by free-text query and optional classification filter, and returns each matching record as a flat row with its descriptive metadata.

  • ๐Ÿ” Free-text search: any keyword matches across titles, makers, classifications, and descriptions, from 'Van Gogh' to 'cuneiform tablet'.
  • ๐Ÿท๏ธ Object type filter: narrow results to a specific classification like 'paintings', 'photographs', 'manuscripts', or 'sculpture'.
  • ๐Ÿ“ฆ Bulk export: collect up to one million records per run and download as CSV, JSON, Excel, or XML.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

What you can do with Yale LUX data

๐Ÿ“š Build a research corpus.

A digital humanities scholar searches for 'manuscript' with object type 'manuscripts' and exports 5,000 records to analyze production dates and places.

๐Ÿ–ผ๏ธ Audit an artist's catalog.

An art historian queries 'Rembrandt' across all object types and downloads every attributed work with its medium, date, and accession number for a catalogue raisonnรฉ project.

๐Ÿ›๏ธ Plan an exhibition.

A curator searches for 'Japanese print' and filters to 'prints' to review Yale's holdings and identify potential loan objects for an upcoming show.

๐Ÿ“– Trace family history.

A genealogist searches a surname and collects portraits, letters, and personal artifacts that mention the family, then cross-references dates and locations.

Why choose this scraper

What you get
No API key needed Reads the public LUX catalog directly, no registration or authentication required.
Cross-collection search Searches across the Yale University Art Gallery, Yale Center for British Art, Yale Peabody Museum, and Yale Library special collections in one query.
Structured output Every record arrives as a flat row with consistent fields, ready for analysis in any spreadsheet or database.
Scalable collection Set a maximum from one record to one million, and the Actor stops cleanly when the limit is reached.

How it compares

No other Store actor targets Yale LUX the same way, so the honest comparison is with the alternatives teams actually weigh.

Yale LUX Cultural Objects Scraper Build it in-house By hand
Setup Run it now, zero config Days of engineering None, but hours per pull
When Yale LUX changes Maintained for you You fix it You re-learn the page
Proxies, retries, anti-bot Built in Your problem Browser only
Output Fixed JSON schema, CSV/Excel export Whatever you build Copy-paste
Cost Pay per result Engineering time Analyst hours

Configure the run

Drive the Actor with a free-text search query and an optional object type filter. Both filters are applied as the catalog is read, so only matching records reach your dataset. The Input tab lists every parameter.

A first run with the defaults:

{
  "query": "painting",
  "maxItems": 10
}

A larger pull:

{
  "query": "painting",
  "maxItems": 200
}

Pricing

Pay-per-result: $0.009 per result collected. You pay only for the results written to your dataset.

Results collected Approximate cost
100 results $0.90
1,000 results $9.00
10,000 results $90.00

New Apify accounts start with $5 in free credit.

Free users

Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.

Run it

  1. Create a free Apify account with $5 in credit.
  2. Open the Yale LUX Cultural Objects Scraper.
  3. Set your inputs and any filters, then click Start.
  4. Export the results as CSV, Excel, JSON, or XML from the Dataset tab.

Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.

Use with AI agents (MCP)

Give an AI agent live access to Yale LUX through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/yale-lux-collections-scraper"

Then prompt it in plain language to run the scraper and read back the results.

Troubleshooting

Why am I getting no results?

Check that your search query is spelled correctly and is not too narrow. Try a broader term first, then add the object type filter. Some very specific queries may match no records in the catalog.

The Actor stopped before reaching my maxItems limit.

The Actor stops when the catalog returns no more matching records. Your query and filter combination may have fewer total results than the limit you set. Try broadening your search term or removing the object type filter.

Some records are missing fields like maker or date.

This is expected. Not every cultural object record in LUX has complete metadata. Older or less-documented objects may lack certain fields. The Actor returns whatever data is publicly available.

The run is taking a long time.

Large maxItems values mean more records to collect. The Actor respects the source website's response time. Reduce your maxItems or narrow your query to speed up the run.

FAQ

Question Answer
What is Yale LUX? Yale LUX is a cross-collection search platform that unites digitized records from Yale's museums, libraries, and archives, including the University Art Gallery, Center for British Art, Peabody Museum, and Beinecke Library.
Do I need a Yale login or API key to scrape LUX? No. This Actor reads the public LUX catalog interface directly. No Yale affiliation, login, or API key is required.
What data fields does each record include? Each record returns the object title, maker or creator, production date, medium or materials, classification, accession number, and any linked image URLs, among other descriptive metadata fields.
Can I search for a specific artist or maker? Yes. The search query matches against maker and creator fields, so a query like 'Van Gogh' or 'Hokusai' returns objects attributed to that person.
How do I filter by object type? Use the optional object type filter with a classification term such as 'paintings', 'photographs', 'sculpture', or 'manuscripts'. Leave it empty to search all types.
How many records can I collect in one run? You can set the maximum from 1 up to 1,000,000 records. The Actor stops when it reaches your limit or when no more results match.
What export formats are supported? You can export your dataset as CSV, JSON, Excel, or XML from the Apify platform after the run completes.
Does this Actor download the actual images? No. It collects the image URLs linked to each record. You can use a separate Apify Actor or script to download the images from those URLs if needed.
Can I search in languages other than English? The LUX catalog contains records primarily in English, but you can search using non-English terms that appear in titles or descriptions, such as artist names or foreign-language object titles.
Is this Actor affiliated with Yale University? No. This is an independent tool built on the Apify platform that reads publicly accessible data from the Yale LUX website. It is not endorsed by or affiliated with Yale University.

Related actors

Browse the full ParseForge collection for more scrapers.

๐Ÿ†˜ Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.

โš ๏ธ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Yale University. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.

Input

FieldTypeWhat it doesDefault
query string Free-text search across Yale LUX cultural objects, for example 'painting', 'dog', 'manuscript', or 'Van Gogh'. Matches titles, makers, classifications, and descriptions. painting
objectType string Optional classification term to narrow results, for example 'paintings', 'photographs', 'manuscripts', or 'sculpture'. Leave empty to search every object type. not set
maxItems integer How many collection records to collect per run. 10

Pricing

from $4.07 per 1,000 results

Charged forWhat it isPrice each
result Single result in the default dataset. $0.00407 to $0.0045
result details Detailed result with additional fields. $0.00814 to $0.009

Tiered: the lower figure is the price on a higher Apify plan. Billing and the free credit live on Apify.

API

One POST returns the dataset directly. Same shape for every scraper in the library, so swapping the slug is the only change.

POST ยท run and get results
curl -X POST "https://api.apify.com/v2/acts/parseforge~yale-lux-collections-scraper/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "helloWorld": 123
  }'

Examples

Input that runs as-is.

input.json
{
  "helloWorld": 123
}

Reviews

No reviews yet. Be the first.

Issues

We build and maintain this scraper, so a problem with it comes to us. Report it on the Apify listing and the thread stays attached to the scraper where the next person can find it: open an issue.

Broken and urgent, or you would rather not post in public? Write to parseforge@protonmail.com and it reaches the people who wrote it.

Related scrapers

Run Yale LUX Cultural Objects Scraper on Apify All scrapers