The scraping system we use has randomly assigned IP addresses, and has a built in 'back-off' mechanism to ensure responsible scraping which will not overwhelm your website with requests. As a result there is currently no need to whitelist our scraper.
Written by Ian Pierson
Updated over 7 months ago