Climatax Research Crawler
We operate a crawler that collects publicly available news and regulatory
publications for research into corporate environmental, social and governance
(ESG) conduct.
Contact: research@climatax.org
— we read this mailbox and act on it. If our crawler is causing you a problem,
email us and we will fix it. You do not need to block us first.
How to identify us
Our requests carry this User-Agent:
CorporateResearch/1.0 (+https://climatax.org/contact/research-bot/; research@climatax.org)What we collect
- RSS, Atom and JSON feeds that publishers make available for syndication.
- The article pages those feeds link to, so we can read the full text rather
than a headline. - Publicly published regulatory and enforcement records — competition
decisions, environmental penalties, labour inspection findings, securities
disclosures.
We do not attempt to access anything behind a paywall, a login, or any other
access control. We do not submit forms, create accounts, or use credentials.
How often we visit
Feeds are checked about once an hour. Article pages are fetched once — we keep
a record of what we have already seen and do not re-fetch it.
If that is too frequent for your site, tell us a rate that works and we will
use it. We would rather slow down than lose access.
What we do with the text
We analyse article text to identify companies, incidents and events — for
example, an environmental fine, a workplace-safety failure, or a product recall —
and to build structured records of those events over time.
Article text is also used to build and improve the machine-learning models
that perform that analysis. Those models are our own extraction tools; we do not
train or sell general-purpose language models.
We do not republish your articles, redistribute your text, or sell it as a
dataset. Our published outputs are aggregate indicators and structured event
records, which link back to your article as the source.
If you would rather we did not
Email research@climatax.org. We will
remove your site on request — you do not need to justify it, and we will confirm
when it is done.
Last updated: 17 August 2026