Skip to content
PreferiumJoin the waitlist
Menu
Platform
Open Platform OverviewThe whole platform, chapter by chapterAutonomous optimizationThe loop that finds, fixes, deploys, verifies and rolls backControl & safetyThree control levels, log, kill switch and the edge boundaryAI visibilityTracked prompts across six answer surfaces, not access to conversationsAgent trafficCrawler visits and AI referrals, kept apartConnectionOne CNAME record, no plugin, no server accessAlerts and reportsAlert types by email and Slack, and white-label reports in your brandIntegrations and APIWebhooks, SSO and a connection for AI assistantsCapability catalog358 capabilities across 24 areas
White labelPricing
Compare
Open Compare All comparisonsHow Preferium differs, with sourcesvs OTTO by Search AtlasThe tool we ran client SEO on before building our ownvs Alli AISnippet delivery against edge deliveryvs overlay toolsWhy a JavaScript snippet is invisible to AI crawlers
Resources
Open Resources BlogArticles on AI search and technical SEOGlossary17 AI-search terms, explainedFree AI scanSee what GPTBot actually receives from any URLCrawlerPreferiumAIEdgeBot, documented
Company
Open Company AboutWhy we built it, and how we workContactWaitlist, partnership and questionsTermsWhat we deliver, and on which conditionsAgency white-label termsResponsibilities between Preferium, agency and clientAcceptable useSEO, AI, security and abuse boundariesAI transparencyOpenness under the EU AI ActPrivacy noticeWhat we process, and your rightsData processing agreementWhen we process on your behalfSubprocessorsActive providers, locations and transfersCookie noticeWhich cookies are set, and whyTrust and securityThe controls in place — and the ones that are not
Join the waitlist

Crawler

PreferiumAIEdgeBot

The web crawler operated by Preferium AS for Preferium. If you saw it in your server logs, this page explains exactly what it is and what it does.

What it is

PreferiumAIEdgeBot fetches pages so Preferium can read a site's current content and generate SEO / AI-search optimizations for it. Its main crawler identifies itself with this exact user-agent string:

PreferiumAIEdgeBot/1.0 (+https://preferium.com/bot)

Why it visited your site

It only crawls domains whose owner has connected them to Preferium and asked us to optimize them. If you did not connect your site and believe this is a mistake, the crawler can be blocked immediately (see below) and you are welcome to contact us.

How it behaves

  • Respects robots.txt. It reads and honours your /robots.txt, including Crawl-delay, for the PreferiumAIEdgeBot user-agent (and the* wildcard).
  • Polite by design. It paces requests, limits concurrency, and backs off automatically on 429 / 403 responses — it will not hammer your origin.
  • Read-only. It issues GET requests to fetch public HTML. It never submits forms, logs in, or attempts to modify anything.
  • Scoped. It crawls a bounded number of pages per run on a periodic schedule, not continuously.

How to verify it

Genuine traffic from us uses one of two user-agent strings — the crawler above, and a headless-browser variant used to render JavaScript-heavy pages:

PreferiumAIEdgeBot/1.0 (browser-rendering)

Both begin with the PreferiumAIEdgeBot token. A look-alike token with different wording, or one arriving from an IP range unrelated to us, can be treated as spoofed — if in doubt, contact us before blocking rather than risk turning away a genuine fetch.

How to block it

Add this to your /robots.txt to disallow the crawler entirely:

User-agent: PreferiumAIEdgeBot
Disallow: /

It obeys robots.txt on the next fetch. To also disconnect the site from Preferium, remove the domain from your Preferium dashboard — that stops all future crawling as well.

Contact

Questions about this crawler? Email post@preferium.no.

Build your agency on Preferium

Partner registration opens to founding partners first. Join the waitlist, or talk to us about Enterprise — both reach the same people.

Join the waitlistTalk to us

Privacy choices

Optional analytics and advertising technologies are not activated on this site. Here you find information about the necessary technologies.

See the cookie notice, the privacy notice and theterms.

Necessary technologies Always necessary

Preferium AS and Cloudflare deliver the site, protect forms against abuse and remember documented privacy choices. These purposes have no optional switch.

Cloudflare Turnstile
Provider: Cloudflare. Abuse protection that loads only on forms where Turnstile is necessary. Storage period: Short-lived control value tied to a form submission.