We want our website to be as open and inclusive as possible, but we also want it to be safe, secure, and available to everyone. For this reason, we have established a few ground rules for you to follow when using our website. Failure to comply with these rules may lead to denying your access to the website.
If you create a bot, crawler, scraper or other automated tool that accesses our website or APIs, you must:
- Carry out crawling in non-business hours between 9pm and 7am UK.
- Limit requests to 5 request every 10 seconds.
- Comply with our robots.txt file and any crawl delay instructions.
- Use a unique and identifiable User-Agent that includes your application name and version (for example: My-Bot/1.0.0).
- Include a contact method in your User-Agent, such as a company email address or website URL, so we can contact you if required. Do not include personal details, HTML tags, emojis or non-standard characters
- Avoid placing excessive load on our services. Contact us for high-volume use to discuss the most appropriate solution for your needs.
- Not attempt to bypass rate limits or access restrictions.
If you exceed the permitted request rate, we may return a 429 Too Many Requests response with a Retry-After header. Your application must respect the Retry-After value before making further requests.
Failure to comply with this policy may result in temporary or permanent access restrictions.
We may temporarily reduce limits to protect or block access at our discretion to maintain service availability, security, stability or performance.
We may update this policy, our robots.txt file or our rate limits at any time without notice.