Privacy policy

This page covers the Crawl Budget Snapshot website (aicrawlready.com), its public APIs, and the AI Crawler Checker extension for Chrome, Microsoft Edge, and Firefox. Last updated: 2026-09-25. Contact: support@aicrawlready.com.

Website and public APIs

What we don't collect

No accounts or logins, no cookies, no analytics or tracking scripts, no advertising.
Fonts and scripts are served from this site; pages don't load third-party trackers.

What the tools fetch

When you run a check, our server makes public GET or HEAD requests to the site you entered: its robots.txt and XML sitemaps (Crawl Budget Snapshot), its robots.txt (AI crawler checker), or each redirect hop of the URLs you paste (redirect checker). The site you check sees those requests coming from our host, not from you. We only request public URLs and block private or reserved network addresses.

What is kept, and for how long

Check results are cached in server memory for up to 5 minutes (robots.txt and sitemap checks) so repeated checks don't re-fetch the same files. Redirect-checker results aren't cached.
To limit abuse, the redirect checker counts requests per IP address in server memory for one minute. The counts aren't written to disk and disappear when the server instance restarts.
We don't keep a database of the URLs you check.

Hosting

The site runs on Cloudflare Workers. Like any web host, Cloudflare processes each request, including your IP address, to deliver the page, and may keep standard logs and aggregate analytics under Cloudflare's privacy policy. Our Worker's own request logging is turned off.

Links to Gumroad

Links to our paid products go to Gumroad and carry UTM parameters (for example utm_campaign=home) that tell us only which page and placement the click came from. Anything you do on Gumroad is covered by Gumroad's own privacy policy.

AI Crawler Checker extension (Chrome, Microsoft Edge and Firefox)

Last updated: 2026-09-25

This policy covers the AI Crawler Checker extension for Chrome, Microsoft Edge, and Firefox. The same code runs in all three browsers, and the practices below are the same in each.

In short

No telemetry: no analytics, tracking, crash reporting or advertising, and nothing is sent to the developer.
Local storage only: anything the extension saves stays in the browser's extension storage on your device (storage.local). Nothing is synced to your browser account or sent to a server.
Optional, per-site access: the extension has no access to any website when installed. It asks for access to a site only when you run a check on it, and only uses that access if you grant it.

What the extension fetches

When you click "Check robots.txt" (or run a Pro bulk check), your browser requests two files from each site being checked:
- <site>/robots.txt
- <site>/llms.txt
These requests go directly from your browser to that site, without cookies (credentials: omit) and without a referrer. Like any web request, the site can see your IP address and browser user agent.
Pro license check (not active in the current version): Pro licensing is disabled in version 0.1.0. If it is enabled in a later version, activating or re-verifying a Pro license would send your license key and the product ID to Gumroad's license verification API (https://api.gumroad.com/v2/licenses/verify), and only after you grant access to api.gumroad.com. Gumroad's own privacy policy applies to that request.
Nothing else is fetched. The extension loads no remote code, fonts or images.

What is stored, and where

Everything is stored locally in the browser's extension storage on your device (storage.local):

the license state, if you activate Pro: the license key, when it was last verified, and the status
if Pro is active, a history of up to 200 checks. Each entry holds the origin, time, summary counts and blocked bots.

This data is not synced (the extension doesn't use storage.sync) and is not sent to the developer or anyone else. It is deleted when you remove the license, clear history in the popup, or uninstall the extension. CSV exports are saved only as a file on your own device.

What is not collected

no analytics, telemetry, tracking or advertising
no browsing history: the extension reads the current tab's URL only when you click its icon, and only to know which site to check
no page content, cookies, form data or personal information
no selling or sharing of data

Permissions

activeTab: read the current tab's URL after you click the icon.
storage: save license state and history locally.
Optional site access (host permissions): none is granted at install. When you run a check, the extension asks for access to that site only: its address plus the www/non-www variant (and the https version if you're on an http page), because robots.txt often redirects between them. For Pro it would also ask for api.gumroad.com. If you decline, nothing is fetched. You can revoke access at any time:
- Chrome: chrome://extensions → AI Crawler Checker → Details → Site access
- Microsoft Edge: edge://extensions → AI Crawler Checker → Details → Site access
- Firefox: about:addons → AI Crawler Checker → Permissions tab ("Permissions and data" in newer versions)

Contact

Questions about this policy or the extension: email support@aicrawlready.com. You can also reach the developer through the Gumroad store page, https://nwadike8.gumroad.com. This policy is also published at https://aicrawlready.com/privacy.

Contact

Questions about this policy, the website, the APIs or the extension: email support@aicrawlready.com. You can also reach us through the Gumroad store page. See also the tools and API docs.