Available FAQs:
Features/Using Our APIs
There’s always a risk of blocking issues with any web-scraping project, but we have many thousands of clients globally who use our APIs, and it’s in our best interest to solve those issues quickly.
You don’t have to worry about managing CAPTCHAs when using our APIs — we handle all issues related to this type of authentication.
When you make a request to any of our APIs, the data is scraped live from the associated website, so a request will typically take anywhere from 3-20s to return. The time the API takes to respond is governed by how long the site takes to load results, plus any retries to avoid CAPTCHAs and blocks.
The key to high throughput is concurrency – making multiple requests at once. Making 1,000 concurrent requests will take the same time as making one, assuming sufficient CPU and bandwidth on your end.
You can use Collections/Batches to do this – customers achieve tens of millions of requests per hour using that method.