arXiv Scraper - Papers, Abstracts & PDF Links
Give your AI a live line into arXiv. Ask for papers on a topic and it reads back real rows rather than citing from memory.
arXiv scraper for arXiv queries, one row per paper: the arXiv id, the title, the whole abstract, every author, the categories, the first-submitted and last-revised dates, the DOI when there is one, and direct links to the abstract page and the PDF.
Metadata and links only. The PDF link is there for you to fetch; this actor does not download or read the paper, and arXiv publishes no citation counts, so there are none here either.
| Input | An arXiv search query, using arXiv's own field prefixes |
| Output | One row per paper: id, title, full abstract, authors, categories, both dates, DOI, abstract and PDF links |
| Ceiling | 30,000 papers per query, which is arXiv's own depth limit |
| Account needed | None, and no API key |
What arXiv Scraper does
It runs your query against arXiv and pages through the results, pausing between pages because arXiv asks callers to. A paper that turns up on two pages is delivered once.
The query uses arXiv's own syntax. It is worth two minutes, because it is what makes a search precise:
| Prefix | Searches |
|---|---|
all: | every field |
ti: | the title |
au: | the authors |
abs: | the abstract |
cat: | the category, like cs.CL or math.AG |
Combine them with AND, OR and ANDNOT. ti:attention AND au:vaswani does exactly what it looks like. Results come back by relevance, by submission date or by last revision, and both date orders put the newest first.
What data you get from each arXiv paper
| What you get | Field |
|---|---|
| The arXiv id, without its version marker | arxivId |
| The title and the whole abstract | title, abstract |
| Every author, in the order on the paper | authors |
| The category it was filed under, and all the others | primaryCategory, categories |
| When it was first submitted and when it was last revised | publishedAt, updatedAt |
| The journal DOI, when the author added one | doi |
| The abstract page and the PDF | absUrl, pdfUrl |
What it does not do
- No full text. Abstracts and links. The PDF is yours to fetch from
pdfUrl. - No citation counts, no references, no related-paper graph. arXiv does not publish them.
- No peer-review status. A paper on arXiv may be a preprint, a submitted manuscript or a published article, and nothing on the row tells you which.
doiis usuallynull. Most preprints have none, and arXiv does not go looking.- No date-range filter, and no ascending order. Sort by date and trim the rows yourself.
- About 30,000 results per query, at most. That is arXiv's depth limit, not a setting here. A pull that size runs for close to an hour, the default run timeout, and rows are only written at the end, so split a broad query into narrower ones rather than raising the number.
- The run finishes even when every request failed, so read
okrather than the run status. A run the time limit stopped before any paper came back is no exception: it ends as succeeded too, with aTIME_LIMITrow and an amber status message. - It is not an official arXiv tool. Dami's Studio is independent and is not affiliated with or endorsed by arXiv or Cornell University, or by any other company named on this page.
How it works
- 1Open it on Apify
The Open on Apify button takes you there. Nothing to install.
- 2Set the inputs
The form opens with an example in Search query. Put in your own and check the other settings.
- 3Click Run
It runs on Apify's servers, on your own Apify account.
- 4Export the results
Download them from the run, or read them over Apify's API.
Pricing
$0.002 per paper = $2 per 1,000
Live price on Apify's Free plan, read on 5 November 2026. Paid plans pay a little less. You are billed on your own Apify account. The full price list is on the Apify page.
Use it from your AI chat
Add Apify's connector to your AI chat once (setup steps), then paste this:
Use the arXiv Scraper (dami_studio/arxiv-scraper) to search arXiv for "all:large language models", and return one row per paper: id, title, full abstract, authors, categories, both dates, DOI, abstract and PDF links.Some apps ask for a server address instead. This one loads just this tool:
https://mcp.apify.com?tools=dami_studio/arxiv-scraperEvery run your AI chat starts goes on your own Apify account, at the prices on this tool's Apify page.
Inputs
| Field | What it does | Type |
|---|---|---|
query | arXiv search query. Use arXiv field prefixes: all: (all fields), ti: (title), au: (author), abs: (abstract), cat: (category). Examples: "all:large language models", "cat:cs.CL", "ti:attention AND au:vaswani". Combine terms with AND / OR / ANDNOT. | string |
sortBy | How to order results. Relevance ranks by match quality; Submitted date sorts by original submission; Last updated date sorts by most recent revision. Newest/most-relevant first. | string |
maxItems | Maximum number of papers to return. The actor paginates 100 per request and pauses ~3s between pages to respect arXiv's rate guidance. arXiv hard-limits total reachable results to about 30000. | integer |
notionConnector | Optional. Write each paper as a page into your Notion when the run finishes, handy for building a literature-review database. Authorize a Notion connector once in Settings → API & Integrations → MCP connectors, then pick it here. Leave empty to skip (default), results are always saved to the dataset regardless. | string |
notionParentId | Optional. The Notion data source ID of the database to write papers into (only used if a Notion connector is set). Leave empty to create the pages privately in your workspace instead. | string |
The full input form is on the Apify page.
Questions people ask
How much does arXiv Scraper cost?
$0.002 per paper ($2 per 1,000) on Apify's Free plan. Paid plans pay a little less. It is billed on your own Apify account.
Can I run arXiv Scraper from my AI chat?
Yes, from any app that supports MCP connectors. Add Apify's connector (https://mcp.apify.com/), sign in with your Apify account, and ask for dami_studio/arxiv-scraper. The steps are on the Use with AI page. Each run goes on your own Apify account, at the prices on its Apify page.
Do I need to write code to use arXiv Scraper?
No. Open it on Apify, fill in the form, click Run and download the results.