About Brass-SEO Bot
Information about our web crawler for site owners and administrators.
What This Bot Does
Brass-SEO is an SEO analysis tool. Our bot crawls pages on behalf of site owners who have signed up for our service and connected their website.
We only crawl sites that belong to our customers. We do not crawl sites for competitive analysis or scraping purposes.
The bot fetches individual pages to analyze on-page SEO elements like title tags, meta descriptions, headings, and content structure. This data is used to provide SEO recommendations to the site owner.
How to Identify Us
Our bot identifies itself with the following User-Agent string:
Cryptographic Verification
Our bot uses Web Bot Auth (RFC 9421 HTTP Message Signatures) to cryptographically prove its identity. Every request is signed with an Ed25519 private key, and you can verify the signature using our public key.
This prevents spoofing — anyone can fake a User-Agent string, but only we can produce valid signatures.
Public Key Directory:
WAF providers like Cloudflare, Akamai, and AWS WAF can automatically verify our requests using this standard. See the Cloudflare Web Bot Auth docs for more information.
Rate Limiting
We limit our crawling to avoid impacting your server:
- Maximum 10 requests per minute per domain
- Maximum 3 concurrent requests
- We respect
robots.txtdirectives - Automatic backoff when we detect rate limiting or blocking
How to Block This Bot
Add the following to your robots.txt file:
Disallow: /
Note: If you are a Brass-SEO customer and block our bot, page-level analysis features will be unavailable. Your GSC and GA4 data will still work normally.
How to Allow This Bot
If your site uses a Web Application Firewall (Cloudflare, Vercel Firewall, etc.) and you want to allow Brass-SEO to access your pages, see our complete firewall guide for step-by-step instructions.
- Cloudflare: Create a WAF custom rule to allow requests where the User-Agent contains
Brass-SEO(docs) - Vercel Firewall: Add a rule to skip challenges for the Brass-SEO User-Agent (docs)
- AWS WAF: Add a User-Agent exception to Bot Control rules (docs)
- Azure Front Door: Create a custom WAF rule matching the User-Agent header (docs)
- Sucuri: Add our IP addresses to the whitelist (docs)
- Wordfence: Add our IP addresses to the whitelist (docs)
Contact
If you have questions or concerns about our crawler, contact us at .