Chocodata
Arxiv Scraper API
Access any Arxiv page using our Arxiv Scraper API. Point one API request at a Arxiv URL and get structured JSON back while we get past CAPTCHAs, IP rate limiting, IP blocking, and headless-browser detection through residential proxies. Get back fields like paper title, authors, abstract, subject category as structured JSON.
check_circle 1,000 free requests/month. No credit card. Residential proxies.
curl "https://api.chocodata.com/api/v1/universal/get?api_key=YOUR_API_KEY&url=https://www.arxiv.com/"{
"success": true,
"url": "https://www.arxiv.com/",
"status": 200,
"content": "parsed Arxiv page content..."
// + more fields
}Arxiv is served through the Universal Web Scraper API
You scrape Arxiv with Chocodata's Universal Web Scraper API: point it at any Arxiv URL and get the page back as structured JSON. Residential proxies, rotation, and retries are handled for you, with no Arxiv-specific setup. The same API key and credits work here as on every dedicated endpoint.
About Arxiv
arXiv is an open-access repository of preprint scholarly articles in physics, mathematics, computer science, and related fields. Its public listing, abstract, and search pages expose titles, authors, abstracts, subject categories, and submission dates that are worth scraping for research tracking.
Scraping note: arXiv provides a public OAI/API and asks scrapers to use it with rate limits; listing and abstract HTML pages render server-side so a single fetch returns the full content.
Example Arxiv page
https://arxiv.org/list/cs.LG/recent Pass a URL like this as url= to the Universal Web Scraper API and get it back as JSON.
Fields you can extract from Arxiv
Common use: A research-trends tool scrapes arXiv listings to track newly published machine-learning preprints and their authors by subject category.
Everything you need to scrape Arxiv
You never expose your own IP, you get validated JSON instead of raw HTML, and the free tier covers arxiv scraper at 1,000 requests a month with no card required.
Clean structured JSON
The Arxiv page comes back as JSON in the parse mode you choose: auto, html, text, or json. No selectors to maintain for arxiv scraper.
Bypasses CAPTCHAs and anti-bot defenses
We get past CAPTCHAs, IP rate limiting, IP blocking, and headless-browser detection on Arxiv using rotating, country-matched residential proxies, so requests look like real users and your own IP stays private.
One API call
Scraping Arxiv is one simple API call. The same key works across our whole web scraping API: all 235 targets, any language, no SDK required.
Geo-targeting and JS rendering
Pass a country for proxy geo-targeting and turn on JavaScript rendering when a Arxiv page needs it. arxiv data api handles dynamic content and region-locked results.
Scrape Arxiv in one API request
Send one API request to the Universal Web Scraper API with a Arxiv URL and read the page back as JSON. Chocodata routes it through residential proxies and retries soft blocks, so arxiv api works without a Arxiv-specific integration.
- check_circle JSON in the parse mode you choose
- check_circle Residential-proxy infrastructure
- check_circle Only successful 2xx responses are billed
Request
curl "https://api.chocodata.com/api/v1/universal/get?api_key=YOUR_API_KEY&url=https://www.arxiv.com/"Response
{
"success": true,
"url": "https://www.arxiv.com/",
"status": 200,
"content": "parsed Arxiv page content..."
// + more fields
}Parameters
Arxiv routes through the Universal Web Scraper API, so the parameters are the universal ones: the URL to fetch, an optional parse mode, and an optional country for proxy geo-targeting.
| Parameter | Type | Required | Example |
|---|---|---|---|
| url | string | required | https://example.com |
| parse | enum | optional | auto |
| country | string | optional | us |
Enum parameters accept a fixed set of values. For example, parse
accepts auto, html, text, json.
What you can build with Arxiv data
Once the scraping API returns Arxiv search data as clean JSON, these are the patterns teams reach for most.
Data Aggregation
Pull Arxiv search records into your own warehouse and analyze them on your terms.
Market Intelligence
Track Arxiv search data over time to spot market shifts before competitors do.
Competitor Monitoring
Watch rivals on Arxiv and alert your team when prices, ranks, or listings change.
Lead Generation
Turn Arxiv search data into targeted lead lists and feed them into your CRM.
Why developers pick Chocodata for Arxiv
Fast at the tail
Median 2.6 s per request with multi-tier retry, so latency stays predictable even when Arxiv fights back.
Parity-checked output
The Universal scraper returns the live page faithfully in your chosen parse mode.
One key, 235 targets
The same scraping API key that scrapes Arxiv works across every other target, with official Node, Python, and Go SDKs.
Simple pricing that scales with you
Start free with 1,000 requests a month and 5,000 credits, no credit card. Scale on monthly plans from $19, or top up pay-as-you-go at $0.90 per 1,000 successful requests. Only successful 2xx responses are billed, and every plan covers the full scraping API: all 235 targets and every endpoint.
Free
Forever free on signup
- check_circle1,000 requests / month (5,000 credits)
- check_circle10 concurrent requests
- check_circleAll 237 targets
- check_circleFull dashboard + analytics
- check_circleTop-up at $0.90 / 1k
- check_circleCommunity support
Vibe
$0.70 / 1k effective
- check_circle27,000 requests / month (135,000 credits)
- check_circle30 concurrent requests
- check_circleAll 237 targets + content-language
- check_circleCountry-matched residential IPs
- check_circlePer-API-key usage tracking
- check_circleTop-up at $0.90 / 1k
- check_circleEmail support (1 business day)
Pro
$0.60 / 1k effective
- check_circle82,000 requests / month (410,000 credits)
- check_circle50 concurrent requests
- check_circlePriority routing queue
- check_circleCountry-matched residential IPs
- check_circleTeam seats (up to 5)
- check_circleTop-up at $0.90 / 1k
- check_circleEmail + chat support
Custom
Flat $0.50 / 1k effective at every level
- check_circle200k - 4M+ requests / month
- check_circle100-500+ concurrent requests
- check_circlePriority queue (highest)
- check_circlePremium proxy pool + SLA on request
- check_circleUnlimited team seats
- check_circleWire / invoice / annual PO
- check_circleDedicated Slack channel
Pay-as-you-go top-up
$0.90 / 1,000 successful requests
Available on every plan including Free. Top up any time when included credits run out. Only 2xx responses charged. Balance never expires.
Arxiv Scraper API FAQ
Is it legal to scrape Arxiv?
expand_more
How do I scrape Arxiv without getting blocked?
expand_more
What data does the Arxiv Scraper API return?
expand_more
How much does the Arxiv Scraper API cost?
expand_more
Do I need a Arxiv account or login?
expand_more
Related scraper APIs
Start scraping Arxiv for free
1,000 free scraping API requests on signup across all 235 targets. No credit card required.