Web Scraper API

Data Scraping and API Endpoint Integration

https://scrape.proxy-seller.com

Sync API

Sync API allows to receive immediate result using our Residential Proxy

Query Parameters

Returns

API key:

'api_key': 'API_KEY', where API_KEY is api_key from your package

Country codes

If you want to define the geolocation for your request, you may set the country_code (string) parameter with one country code at the creation of the request.

Example: 'us', 'gb', 'fr', 'de', 'jp', 'cn', 'ru'

Supported country codes can be found in the collapsible table below:

You're also free to pass your own headers set to the request

Language codes

If you want to define the language in your request, you may set the language (string) parameter with one language tag at the creation of the request.

Language codes can be found in the collapsible table below:

Curl example

curl -X POST "https://scrape.proxy-seller.com/" -d '{"api_key": "API_KEY", "url": "https://www.google.com"}'

Curl (with headers)

curl -X POST "https://scrape.proxy-seller.com/" -d '{    "api_key": "API_KEY",    "url": "https://www.google.com",    "headers": {        "Upgrade-Insecure-Requests": "1",        "User-Agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/113.0.0.0 Safari/537.36",        "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7",        "Sec-Fetch-Site": "none",        "Sec-Fetch-Mode": "navigate",        "Sec-Fetch-User": "?1",        "Sec-Fetch-Dest": "document",        "Accept-Encoding": "gzip, deflate, br",        "Accept-Language": "en-US,en;q=0.9"    }}'

Using headers:

If you’re trying to set your own headers - please make sure to pass all the necessary values including user agent in the correct order. In this case your target server will receive your headers without any modifications from our side. Setting incorrect headers might cause unexpected page results. Please use this only if you know what you are doing.

Async API

Async API allows to put multiple time-consuming requests to the queue and receive the results as soon as they are getting ready

POST https://scrape.proxy-seller.com/job

Payload parameters

Payload parameters you can find here in table.

Returns

Curl

curl -X POST -d '{"api_key": "API_KEY", "url": "http://httpbin.org/ip"}' "https://scrape.proxy-seller.com/job"

Async API - receiving results

POST https://scrape.proxy-seller.com/job/<job_id>

Path Parameters

Payload Parameters

Returns

Curl

curl -X POST -d '{"api_key": "API_KEY"}' "https://scrape.proxy-seller.com/job/<job_id>"

Credits and Requests

Your plan determines how many credits you can use. Each request you make costs some credits. The number of credits you use varies based on the domain and parameters of your request. Geotargeting is included in these credit costs.

Domains

We have built special scrapers for some sites. These scrapers will run when you scrape those domains, changing the credit cost. Scraping other domains costs 1 credit (without additional parameters).

caution

Normal - any other website if no additional parameters are added;

SERP - Google;

Ecommerce - Amazon, Booking;

LinkedIn - the cost will be 130 credits per request.

List will be updated as functionality is added.

Paid query parameters

These parameters provide you with additional features for the scraping.

{"render_js":"true"} – requests cost 10 credits.