Collections for High-Scale Apps
Meet Rainforest API Collections
Collections allow you to run up to 15,000 requests in bulk. Build them visually or via the Collections API. Set a schedule and have Rainforest API take care of the rest.
Built to Scale
Collections allow you to enqueue large volumes of requests and have Rainforest API execute them on a schedule. Collections remove the complexity of large-scale Amazon Product Data collection and let you focus on the results.
Bulk Import
Easily import requests from CSV files – Collections make it easy to import your existing request criteria from in-house tools or other legacy systems. We also provide a full API for creating and importing Collections.
Schedule
Rainforest API Collections take the hassle out of scheduling requests to run repeatedly. Set Collections to run hourly, daily, weekly or monthly – perfect for building tracking apps and viewing results over time.
There’s an API for That
Building apps that need access to mass-volume Amazon Product Data? Use the Collections API to programmatically create, execute and retrieve results from hundreds of thousands of requests without any maintenance overhead.
Collections API
Create Collections, add requests to them, set execution schedules and retrieve results all from the Collections API. Deliver high-scale Web-scraped Amazon Product Data apps and let Rainforest API handle the details.
Webhooks
Rainforest API sends an HTTP POST to your app when Collections complete. No need for status polling – get instantly notified when Collection results are ready for ingest into your app.
Retrieve results
Get Collection results as JSON, JSON Lines or CSV (it’s easy to specify which CSV columns to include). Rainforest API retains Collection results for 14 days so you can ingest the results into your app on your schedule.
Visual Collection Builder
The Collections API gives extreme flexibility in building high-scale Web-scraped Amazon Product Data apps but we also provide a visual Collection Builder to get started without coding a thing.
Build Collections visually
Get started in a snap. Our simple visual Collection Builder lets you create Collections, add Requests to them, and download results all from the Rainforest API Dashboard.
Extreme flexibility
Create up to 10,000 Collections, and add up to 15,000 requests per Collection. Get notified of Collection completions via email or webhook and download results as JSON or CSV.
Everything you need
The Collection Builder gives you all the tools you need – set request parameters and schedules, and access all request query options from the Product Data API.
Collections Frequently Asked Questions
How many Collections can I set up?
You can have up to 10,000 Collections set up on your Rainforest API account at any one time. For example, many users create a Collection per-customer when offering tracking services, to easily manage all required Web-scraped Amazon Product Data over time.
How many requests are allowed per Collection?
We allow up to 15,000 requests per Collection. For really large projects we recommend you split your requests across multiple Collections (we have clients who run over 10 million requests per day using multiple Collections).
How are Collections charged?
There is no charge for creating, updating or deleting Collections. When Collections are run they decrement your monthly request quota just like calls to the Product Data API would.
How long are Collection results stored?
Rainforest API stores the results from Collection runs (called Result Sets in Rainforest API-terminology) for 14 days. You can download result sets as many times as you need within the 14 day period.
What scheduling options are available?
You can schedule Collections to run hourly, daily, weekly or monthly or any combination in between. For example, you could set a Collection to run at 8am and 3pm daily, or 9am on the 1st of each month.
How do I know when a Collection completes?
Rainforest API can alert you to completed Collections and new result sets available for download, via email or via a HTTP POST to a webhook on your infrastructure.
How do I get Collection results?
Collection results are available for download via the Rainforest API Dashboard, or the Collections API. Results are available as JSON or CSV and you can specify the columns included within the CSV.
Try Rainforest API for Amazon Product Data For Free
Take your business to new heights with Amazon product data from Rainforest API.
Start for free today and choose a plan later.
Get Started with Rainforest API