Back to home

CommonElementsBot

The crawler Common Elements uses to keep public community association records current. Here is what it does and how to reach us.

Last updated October 2026.

What it fetches

CommonElementsBot reads public records about community associations: state and county registries, licensing rosters, recorded-document indexes, and open-data portals. It also checks association and management-company websites that are already linked to a record. It reads what the publisher makes available and does not try to get past a login, a CAPTCHA, or a bot check.

How it identifies itself

Every request carries the same User-Agent:

CommonElementsBot/1.0 (+https://commonelements.com/bot; hschoeller@commonelements.com)

We never present the crawler as a web browser, rotate identities, or route requests through proxies to look like someone else.

How to limit or block it

CommonElementsBot follows robots.txt (RFC 9309). To keep it out of part or all of your site, add a group for its token:

User-agent: CommonElementsBot
Disallow: /

If robots.txt cannot be read, the crawler treats the site as off limits. It paces requests at least one second apart per site, and it stops for the day when a site answers with a rate limit or an access cap. It does not work around CAPTCHAs, bot checks, or session limits. When a site blocks it, we ask the publisher for an official data channel instead.

Contact

Questions, corrections, or a request to change how often we visit: email hschoeller@commonelements.com. A person reads every message.