Skip to content
PreferiumJoin the waitlist

Free tool

Check what AI crawlers can read.

Enter a public URL to check what its raw HTML and robots.txt tell AI crawlers. Get a clear report on the title, description and structured data. No account or email required.

Free AI scan · one public page

Scan a public page.

Free, with no account required. The scanner does not store page content. Hashed request data is used to limit abuse.

  1. 01Page HTML
  2. 02Crawler access
  3. 03Next actions

Your page’s raw HTML

Enter a page address to check its HTML and crawler access. This checks the page, not its citations in live AI answers.

Preview the report fieldsScan details
Title
Awaiting scan
Description
Awaiting scan
Main heading (H1)
Awaiting scan
Structured data
Awaiting scan

Are AI crawlers allowed in?

  • GPTBot (OpenAI training)Unknown
  • ClaudeBot (Anthropic training)Unknown
  • PerplexityBot (Perplexity search)Unknown
  • Google-Extended (Google control token for Gemini, not a crawler)Unknown

JavaScript dependency

Unknown

Low suggests the content is available in the raw HTML. High suggests a dependency on scripts.

Readable text and page size appear here after a scan.

Reading the result

Four checks.
A clearer next step.

The scan checks fetched HTML and access rules. It does not measure live AI answers or predict citations.

Title and meta description

Review missing or generic titles and descriptions against the content visitors see.

Structured data

Check that structured data matches the visible facts. Missing schema alone does not prevent an AI citation.

JavaScript dependency

High means the scan found signs of JavaScript dependency. Check whether essential text is readable without scripts.

Crawler access

Review robots.txt rules separately for search access and training permission. Firewalls can also block access.

Turn scan findings into supported fixes

Preferium can publish supported page improvements at the edge — no CMS changes, reversible per element. Resell it under your own brand.

Join the waitlistHow white label works

Rather ask a person? Talk to us

Privacy choices

Choose which optional technologies Preferium AS may use. All of them are off until you choose.

Analytics: Google Analytics 4 counts page views. Google may receive the page address, referrer, network address, browser and device details, and online identifiers. Browser storage: _ga, _ga_*: Up to 730 days. Renewed on activity. The browser may shorten the storage period.

Provider: Google Ireland Limited. Google may transfer data to the United States.

See the cookie notice, the privacy notice and theterms.

Necessary technologies Used for site functions

Preferium AS and Cloudflare deliver the site and protect forms against abuse. A local preference remembers if you pause animation. When optional tracking is available, the site can also remember your documented privacy choices.

Consent receipt
Provider: Preferium AS. HttpOnly receipt that documents and retrieves your consent choice. Name in the browser: __Host-preferium_consent. Storage period: The receipt is valid for up to 180 days without rolling renewal.
Local privacy choices and pending rejections
Provider: Preferium AS. Local storage of privacy choices and pending rejections. The entry alone can never allow optional technologies; a valid server receipt is required. Name in the browser: preferium-consent-v2. Storage period: Until the entry is overwritten or the browser site data is cleared. No automatic timed deletion is configured.
Privacy choice synchronization between tabs
Provider: Preferium AS. The latest message that synchronizes privacy choices and pending rejections between tabs. The message can only close optional technologies and trigger a new server check. Name in the browser: preferium-consent-sync-v1. Storage period: Until the entry is overwritten or the browser site data is cleared. No automatic timed deletion is configured.
Motion pause preference
Provider: Preferium AS. Session storage restores the requested accessibility preference between pages in this tab. Nothing is sent to a server. Name in the browser: preferium-motion-paused. Storage period: Until this browser tab session ends.
Cloudflare Turnstile
Provider: Cloudflare. Abuse protection that loads only on forms where Turnstile is necessary. Storage period: Short-lived control value tied to a form submission.
Analytics

Helps us understand how the site is used, when you consent.

Provider: Google Ireland Limited. The data may include the page address, referrer, network address, browser/device, online identifiers and usage events.

_ga, _ga_*
Processes site usage for aggregated analytics after specific consent. Storage period: Up to 730 days. Renewed on activity. The browser may shorten the storage period.

You can withdraw your choice via Privacy choices. That stops further optional loading but does not recall data already sent to Google. We attempt to delete known first-party values; the browser may prevent deletion of third-party values.

How Google uses and is responsible for data · How Google uses information from partner sites · Google privacy policy