Verified by Web Bot Auth

CrowBot

The crawler behind Crow. It visits public online storefronts to capture how they present themselves to shoppers.

What CrowBot does

Crow studies how online stores are built. For each storefront on a list that people choose by hand, CrowBot requests a few public pages, such as the homepage and product pages, and records what a visitor would see.

CrowBot does not sign in, add items to a cart, check out, or touch anything behind a login. It only reads pages that any visitor can open, and it may close a popup or cookie banner so the page underneath can be captured.

How it behaves

Identification

User-Agent
CrowBot/2.0 (+https://botcrow.com)
Verification
CrowBot signs its requests with HTTP Message Signatures (Cloudflare Web Bot Auth, Ed25519).
Public keys
/.well-known/http-message-signatures-directory
Operator
Unit 203 Technologies Inc.

Opt out or get in touch

To keep CrowBot off your site, or to slow it down, add a rule for CrowBot to your robots.txt. CrowBot reads it on every visit, so a change takes effect on the next one.

For anything else, such as unexpected traffic, a removal request, or a question, write to support@trycrow.ai.