Chocodata
public Via Universal scraper B2B & Companies

SEMrush Domain Scraper API

Access any SEMrush page using our SEMrush Scraper API. Point one API request at a SEMrush URL and get structured JSON back while we get past CAPTCHAs, IP rate limiting, IP blocking, and headless-browser detection through residential proxies. Get back fields like authority score, organic search traffic estimate, organic keyword count, paid keyword count as structured JSON.

Get your free API key Browse all scrapers

check_circle 1,000 free requests/month. No credit card. Residential proxies.

Request 
curl "https://api.chocodata.com/api/v1/universal/get?api_key=YOUR_API_KEY&url=https://www.semrush.com/"
JSON Response
200 OK 
{
  "success": true,
  "url": "https://www.semrush.com/",
  "status": 200,
  "content": "parsed SEMrush page content..."
  // + more fields
}
lan 235 targets
vpn_lock Residential proxy network
data_object Structured JSON
redeem 1,000 free requests/mo

SEMrush is served through the Universal Web Scraper API

You scrape SEMrush with Chocodata's Universal Web Scraper API: point it at any SEMrush URL and get the page back as structured JSON. Residential proxies, rotation, and retries are handled for you, with no SEMrush-specific setup. The same API key and credits work here as on every dedicated endpoint.

Universal scraper Start free

About SEMrush

SEMrush is an SEO and competitive-intelligence suite that publishes a free domain-overview page for any website. The public overview surfaces estimated organic traffic, keyword counts, authority score, backlink totals, and top organic keywords for the queried domain.

Scraping note: The overview is JS-rendered and shows only a limited free snapshot per domain, with deeper metrics behind a paywall, so a headless render is required to capture the visible figures.

Example SEMrush page

https://www.semrush.com/website/example.com/overview/

Pass a URL like this as url= to the Universal Web Scraper API and get it back as JSON.

Fields you can extract from SEMrush

check_small authority score check_small organic search traffic estimate check_small organic keyword count check_small paid keyword count check_small backlink count check_small top organic keywords check_small traffic trend

Common use: Benchmark a competitor's organic visibility and authority score by reading their SEMrush public domain-overview page.

Everything you need to scrape SEMrush

You never expose your own IP, you get validated JSON instead of raw HTML, and the free tier covers semrush scraper at 1,000 requests a month with no card required.

data_object

Clean structured JSON

The SEMrush page comes back as JSON in the parse mode you choose: auto, html, text, or json. No selectors to maintain for semrush scraper.

gpp_good

Bypasses CAPTCHAs and anti-bot defenses

We get past CAPTCHAs, IP rate limiting, IP blocking, and headless-browser detection on SEMrush using rotating, country-matched residential proxies, so requests look like real users and your own IP stays private.

api

One API call

Scraping SEMrush is one simple API call. The same key works across our whole web scraping API: all 235 targets, any language, no SDK required.

travel_explore

Geo-targeting and JS rendering

Pass a country for proxy geo-targeting and turn on JavaScript rendering when a SEMrush page needs it. semrush data api handles dynamic content and region-locked results.

Scrape SEMrush in one API request

Send one API request to the Universal Web Scraper API with a SEMrush URL and read the page back as JSON. Chocodata routes it through residential proxies and retries soft blocks, so semrush api works without a SEMrush-specific integration.

  • check_circle JSON in the parse mode you choose
  • check_circle Residential-proxy infrastructure
  • check_circle Only successful 2xx responses are billed
Get your free API key

Request

curl "https://api.chocodata.com/api/v1/universal/get?api_key=YOUR_API_KEY&url=https://www.semrush.com/"

Response

{
  "success": true,
  "url": "https://www.semrush.com/",
  "status": 200,
  "content": "parsed SEMrush page content..."
  // + more fields
}

Parameters

SEMrush routes through the Universal Web Scraper API, so the parameters are the universal ones: the URL to fetch, an optional parse mode, and an optional country for proxy geo-targeting.

Parameter Type Required Example
url string required https://example.com
parse enum optional auto
country string optional us

Enum parameters accept a fixed set of values. For example, parse accepts auto, html, text, json.

What you can build with SEMrush data

Once the scraping API returns SEMrush domain data as clean JSON, these are the patterns teams reach for most.

check_circle

Data Aggregation

Pull SEMrush domain records into your own warehouse and analyze them on your terms.

check_circle

Market Intelligence

Track SEMrush domain data over time to spot market shifts before competitors do.

check_circle

Competitor Monitoring

Watch rivals on SEMrush and alert your team when prices, ranks, or listings change.

check_circle

Lead Generation

Turn SEMrush domain data into targeted lead lists and feed them into your CRM.

Why developers pick Chocodata for SEMrush

bolt

Fast at the tail

Median 2.6 s per request with multi-tier retry, so latency stays predictable even when SEMrush fights back.

verified_user

Parity-checked output

The Universal scraper returns the live page faithfully in your chosen parse mode.

hub

One key, 235 targets

The same scraping API key that scrapes SEMrush works across every other target, with official Node, Python, and Go SDKs.

Simple pricing that scales with you

Start free with 1,000 requests a month and 5,000 credits, no credit card. Scale on monthly plans from $19, or top up pay-as-you-go at $0.90 per 1,000 successful requests. Only successful 2xx responses are billed, and every plan covers the full scraping API: all 235 targets and every endpoint.

Free

$0

Forever free on signup

  • check_circle1,000 requests / month (5,000 credits)
  • check_circle10 concurrent requests
  • check_circleAll 237 targets
  • check_circleFull dashboard + analytics
  • check_circleTop-up at $0.90 / 1k
  • check_circleCommunity support
Start free
Most popular

Vibe

$19 / month

$0.70 / 1k effective

  • check_circle27,000 requests / month (135,000 credits)
  • check_circle30 concurrent requests
  • check_circleAll 237 targets + content-language
  • check_circleCountry-matched residential IPs
  • check_circlePer-API-key usage tracking
  • check_circleTop-up at $0.90 / 1k
  • check_circleEmail support (1 business day)
Get Vibe

Pro

$49 / month

$0.60 / 1k effective

  • check_circle82,000 requests / month (410,000 credits)
  • check_circle50 concurrent requests
  • check_circlePriority routing queue
  • check_circleCountry-matched residential IPs
  • check_circleTeam seats (up to 5)
  • check_circleTop-up at $0.90 / 1k
  • check_circleEmail + chat support
Get Pro

Custom

$100-$2k / month

Flat $0.50 / 1k effective at every level

  • check_circle200k - 4M+ requests / month
  • check_circle100-500+ concurrent requests
  • check_circlePriority queue (highest)
  • check_circlePremium proxy pool + SLA on request
  • check_circleUnlimited team seats
  • check_circleWire / invoice / annual PO
  • check_circleDedicated Slack channel
Pick Custom level

Pay-as-you-go top-up

$0.90 / 1,000 successful requests

Available on every plan including Free. Top up any time when included credits run out. Only 2xx responses charged. Balance never expires.

See full pricing and calculator →

SEMrush Scraper API FAQ

Is it legal to scrape SEMrush?

expand_more
Scraping publicly accessible SEMrush data is generally legal in the US under the Ninth Circuit's hiQ v. LinkedIn ruling, which held that scraping public web data does not violate the Computer Fraud and Abuse Act. It does not override SEMrush's own Terms of Service, which are a contract matter, so check those for your use case and comply with data laws such as GDPR. This is general information, not legal advice.

How do I scrape SEMrush without getting blocked?

expand_more
You scrape SEMrush without getting blocked by sending the URL to the Universal Web Scraper API, which fetches it through rotating residential proxies and retries on soft blocks. Your own IP is never used, so SEMrush's anti-bot layer sees ordinary residential traffic instead of a server.

What data does the SEMrush Scraper API return?

expand_more
Through the Universal Web Scraper API you get the SEMrush page back as JSON: rendered HTML, plain text, or auto-parsed content depending on the parse mode you pass. You choose the URL, Chocodata returns the data.

How much does the SEMrush Scraper API cost?

expand_more
The SEMrush Scraper API costs nothing to start: the Free plan includes 1,000 requests per month (5,000 credits) across all 235 targets. After that, monthly plans begin at $19, or you top up pay-as-you-go at $0.90 per 1,000 successful requests. One request is 5 credits, and non-2xx responses are never charged.

Do I need a SEMrush account or login?

expand_more
No SEMrush login is needed for public pages. You point the Universal Web Scraper API at a publicly accessible SEMrush URL with your Chocodata API key; you do not hand over any SEMrush credentials. Login-gated content is not supported.

Related scraper APIs

LinkedIn Company Scraper API arrow_forward ZoomInfo Scraper API arrow_forward SimilarWeb Scraper API arrow_forward Clutch Scraper API arrow_forward

Start scraping SEMrush for free

1,000 free scraping API requests on signup across all 235 targets. No credit card required.

Get your free API key Browse all scrapers