Web Search
Google, Bing, DuckDuckGo, Brave aggregated and re-ranked into one feed. Cloudflare-clean.
POST /v1/search
640ms
cold · 80 concurrent
live · serving requests
The scraping API that already won the fight.
One bearer token. Multi-engine web search, RAG answers with citations, Reddit, Google Maps reviews, podcast transcripts — the Cloudflare bypass and proxy rotation are someone else's problem now.
- 640ms cold search, multi-engine
- 100ms cached, P50
- 1,000 free credits, no card
the catalog
Hard targets. Already solved.
Every endpoint returns a stable schema. The proxy tier, JS rendering, cache TTL, and Cloudflare bypass are picked for each source — you just see clean JSON.
Deep Search
Search + auto-fetch the top N pages with extracted text. One round-trip for RAG.
POST /v1/search/deep
AI Answer
RAG-style. Search, fetch, summarise with numbered [1][2] citations.
POST /v1/search/answer
Any URL
Point us at a page. We get past the wall — rotated proxies, headless rendering, Cloudflare challenges — and hand back the rendered HTML and clean text.
POST /v1/scrape/url
Translate
28 languages. Flat per-call price — no per-character or per-word billing. A drop-in alternative to DeepL or Google Translate.
POST /v1/translate
Reddit · search
Search like a browser. Filter by sub, sort, time. Real posts, ranked.
POST /v1/scrape/reddit/search
Reddit · post
One URL, get the post + full ranked comment tree.
POST /v1/scrape/reddit/post
Google Maps reviews
Every recent review for a place_id. Author, rating, owner response, posted_at.
POST /v1/scrape/google-maps/reviews
Podcast transcripts
Timestamped, speaker-tagged. Apple, Overcast. 30-day cache.
POST /v1/scrape/podcast/transcript
AliExpress product
Title, price, currency, shipping, seller, rating, variants.
POST /v1/scrape/aliexpress/product
Catalog grows. Vote on the next endpoint or pull anything else through the generic URL fetcher.
anatomy of a request
Bearer token in. Clean JSON out.
You write the curl. We do the unglamorous half — rotating proxies, solving Cloudflare challenges, parsing five flavours of broken HTML — and hand back stable, versioned JSON.
-
01
You send a POST
Auth verified in ~50 ms. Rate-limited per key, per minute, per day. Failed requests don't bill.
-
02
We pick the tier
Datacenter for soft targets, residential for hostile ones, a real headless browser for challenge walls. Tier is picked per-domain, not per-customer.
-
03
Cache or fetch
Same request inside the TTL? Cached hit at 100 ms for 1 credit. Otherwise we fetch, extract, normalise, and cache it for next time.
-
04
JSON, every time
Stable response schema per endpoint. Pre-built scrapers don't make you write selectors. Failures return credits.
curl -X POST https://scrapenest.dev/v1/search \ -H "Authorization: Bearer sn_••••" \ -H "Content-Type: application/json" \ -d '{ "query": "best wireless earbuds 2026", "num_results": 5 }'
{
"query": "best wireless earbuds 2026",
"results": [
{
"url": "https://www.rtings.com/headphones/reviews/best/...",
"title": "The 6 Best Wireless Earbuds - Spring 2026",
"snippet": "Our top pick is the Sony WF-1000XM5...",
"engine": "google"
},
/* 4 more */
],
"took_ms": 640,
"cache_hit": false,
"credits_charged": 3
}
pricing
Pick a bundle. Or pay per credit.
Every plan has every endpoint, every proxy tier, JS rendering. The higher the bundle, the cheaper each credit. Failed requests refund automatically.
Free
Kick the tires
$0forever
- 1,000 credits / mo
- 1 concurrent
- All endpoints
Starter
Side projects
$29/ mo
- 200,000 credits / mo
- 10 concurrent
- Geotargeting
Growth
For shipping
$99/ mo
- 1,000,000 credits / mo
- 40 concurrent
- Priority queue
- Custom endpoint requests
Pro
For teams
$249/ mo
- 3,000,000 credits / mo
- 100 concurrent
- Slack channel
- 5 seats
Scale
Data teams
$599/ mo
- 10,000,000 credits / mo
- 200 concurrent
- SLA + on-call
- Unlimited seats
Or pay as you go
No commit. $0.0002 per credit, billed weekly for what you used. Same endpoints, same proxy tiers.
Plain HTTP
Datacenter, no JS
1 credit
$0.0002
JS rendering
Headless Chromium
5 credits
$0.0010
Residential proxy
Geo-targeted, no JS
10 credits
$0.0020
Residential + JS
Hostile targets, full render
25 credits
$0.0050
Cache hit
Repeated inside TTL window
1 credit
$0.0002
Need 25M+ credits or a dedicated VPC? Talk to sales. Plans cancel anytime, no contracts.
questions
Answered.
How is this different from ScrapingBee, BrightData, or Apify?
Those are generic scraping APIs — you bring the URL and the selectors and you write the parsers. ScrapeNest centres on pre-built endpoints for specific high-value sources (Google Maps reviews, Reddit posts, podcast transcripts, AliExpress products). Stable schema, no selectors, credit cost matches what the call actually used. The generic scrape/url covers the long tail.
What happens when a target hard-blocks the request?
If our proxy chain is exhausted and the source still refuses (CAPTCHA wall, geofence, hard-block), the request returns 502 and the credits return to your balance inside 60 seconds. Failures don't bill.
Do I need to bring my own proxies?
No. Proxy bandwidth is bundled. We route each call through the tier that fits the source automatically — datacenter for soft targets, residential for hostile ones, headless browser when there's a challenge page. Override per-request with proxy_tier.
Can I use this for ML training data?
Yes — that's a primary use case. Growth and Scale customers run daily ingest jobs into RAG indexes and fine-tuning corpora. Talk to us about volume rates above 500k req/mo.
What's the cache hit rate like in practice?
Blended target is 60–65% across paid traffic. Cached hits bill at 1 credit regardless of which tier originally fetched. Bypass with cache_ttl_seconds: 0 when you need live data.
ready when you are
Ship your scraper today.
Sleep tonight.
1,000 free credits. No card. The API key prints once — copy it, paste it, you're done.