bloomberg.com

Whether agents can crawl you, find you in the registries and searches they check, and trust what they find.

• ✓Sitemap present & freshrequired4/4

  Sitemap at https://www.bloomberg.com/sitemaps/news/index.xml: 2985 entries, freshest <lastmod> 2026-08-17 (0 days ago)

  Resolved the sitemap from robots.txt or /sitemap.xml, validated XML, and checked lastmod freshness

  spec ↗report issue
• ✗Brand search discoverabilityrequired0/4

  Neither search ("PX8FCGYgk4", "PX8FCGYgk4 security") cited bloomberg.com. Cited instead: https://domain.glass/collector-px8fcgygk4.px-cloud.net, https://github.com/gocolly/twocaptcha/issues/1, https://stackoverflow.com/questions/52570401/https-preventing-website-scraping-in-python3, https://ssmela.com/zjnzoaeywhd/managementy/qiakslweufylyu/?ro=YW5nZWxhLmxvdWRvbkBhbGxlbm92ZXJ5LmNvbQ==, https://www.joesandbox.com/analysis/1777708/0/html

  fix → Your domain doesn't surface when agents search "PX8FCGYgk4". Strengthen brand pages, structured data, and third-party citations (docs portals, GitHub, directories).

  Ran clean brand-name web searches and checked whether your domain is cited in the results

  report issue
• —MCP registry listingsrecommendedna

  No MCP server detected for this product

  Queried the official MCP registry, Smithery, Glama, and PulseMCP for servers matching your domain

  spec ↗report issue

Whether your robots policy, bot protection, and agent guidance actively admit AI agents instead of blocking them.

• ✓robots.txt present & parseablerequired2/2

  /robots.txt parses: 98 User-agent group(s), 10 Sitemap line(s)

  Fetched /robots.txt and validated it parses as a robots policy

  spec ↗report issue
• ✗AI crawler policyrequired0/5

  robots.txt blocks 12 of 12 AI crawler user-agents from /: GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-User, Claude-SearchBot, anthropic-ai, PerplexityBot, Google-Extended, CCBot, meta-externalagent, Bytespider

  fix → robots.txt blocks GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-User, Claude-SearchBot, anthropic-ai, PerplexityBot, Google-Extended, CCBot, meta-externalagent, Bytespider. Add explicit `User-agent: <bot>` / `Allow: /` groups for the AI agents you welcome; a blanket Disallow makes you invisible to them.

  Evaluated robots.txt groups for the major AI agent user-agents (GPTBot, ClaudeBot, PerplexityBot, …)

  report issue
• ✗Content Signals directivesemerging0/2

  No Content-Signal lines in robots.txt

  fix → Declare Content Signals in robots.txt (e.g. `Content-Signal: search=yes, ai-train=no`) to express AI usage preferences machine-readably.

  Looked for Content-Signal lines in robots.txt

  spec ↗report issue
• !Agent user-agent paritybetarequirederror

  Browser UA received HTTP 403 with bot-challenge markers — cannot evaluate parity (the site may be blocking our scanner)

  Compared responses served to browser and AI-agent user-agents (informational while in beta)

  report issue
• ✗agents.mdrecommended0/3

  No agents.md: https://bloomberg.com/agents.md → HTTP 403, https://bloomberg.com/AGENTS.md → HTTP 403

  fix → Add /agents.md: what agents may do on your site, key URLs, auth, rate limits, and who to contact.

  Fetched /agents.md and checked for substantive agent guidance

  spec ↗report issue

Whether your pages carry machine-readable identity: structured data, llms.txt, clear copy an agent can quote.

• !Homepage states what you arerequirederror

  Homepage returned HTTP 403 — no content to evaluate

  An LLM read your homepage as an agent would and rated how confidently it could say what you do

  report issue
• !OpenGraph / social metadatarecommendederror

  Homepage returned HTTP 403 (application/json) — could not parse HTML meta tags

  Parsed homepage og:title / og:description / og:image and twitter:card meta tags

  spec ↗report issue
• ✗llms.txtrecommended0/4

  GET /llms.txt returned HTTP 403

  fix → Add /llms.txt: an H1 with your name, a one-line blockquote summary, and H2 sections of curated links to docs, pricing, and API.

  Fetched /llms.txt and validated it against the llmstxt.org shape (H1, summary, curated links)

  spec ↗report issue
• ✗llms-full.txtbonusrecommended0/2

  GET /llms-full.txt returned HTTP 403

  fix → Add /llms-full.txt with expanded inline docs content so agents can load everything in one fetch.

  Fetched /llms-full.txt and checked for substantial inline markdown content

  spec ↗report issue
• !JSON-LD structured datarequirederror

  Homepage returned HTTP 403 (content-type application/json) — no HTML to inspect

  Extracted and validated application/ld+json blocks on the homepage and pricing page

  spec ↗report issue
• ✗Markdown content negotiationrecommended0/3

  GET / with `Accept: text/markdown` returned HTTP 403 text/html; no .md twins found (1 probed)

  fix → Serve text/markdown when clients send `Accept: text/markdown` (or expose .md twins of key pages) — agents get far more signal per token.

  Requested key pages with Accept: text/markdown and probed .md twin URLs

  report issue

Whether the artifacts an agent needs to build on you — docs, API specs, SDKs, MCP servers — exist and are findable.

• ✗Developer resource discoverabilityrecommended0/3

  Search "PX8FCGYgk4 API documentation" cited nothing from bloomberg.com and nothing mentioning "PX8FCGYgk4". Cited: https://github.com/gocolly/twocaptcha/issues/1, https://trakkr.ai/learn/api/endpoints/citations, https://www.searchapi.io/docs/google, https://docs.firecrawl.dev/features/search, https://community.openai.com/t/web-search-api-url-citations-not-coming-through/1145410

  fix → Create a crawlable /docs or developers.bloomberg.com hub and link it from your homepage footer so search-grounded agents find your API.

  Searched for your brand with developer-keyword suffixes and checked which official resources are cited

  report issue
• ◐OpenAPI spec discoverablerequired2.5/5

  An OpenAPI spec URL was referenced but returned HTTP 401/403 — not fetchable without authentication

  fix → Expose your OpenAPI spec unauthenticated at /openapi.json; agents cannot integrate against a spec they cannot read.

  Probed standard OpenAPI locations and docs links for a fetchable, parseable spec

  spec ↗report issue
• ◐Docs discoverablerequired2/4

  Docs URL https://bloomberg.com/docs exists but returned HTTP 403 — readable only behind login

  fix → Make at least a public subset of your docs readable without login; agents cannot complete an auth flow just to read documentation.

  Followed homepage nav/footer links and probed /docs, /developers, docs.{domain}

  report issue
• ✗MCP server discoveryrequired0/5

  No MCP evidence found: probed /.well-known/mcp/server-card.json, /.well-known/mcp.json, /mcp.json and scanned llms.txt, agents.md, and docs for endpoints or install commands

  fix → Publish /.well-known/mcp/server-card.json describing your MCP endpoint so agents can autodiscover it. Evidence found: none.

  Probed /.well-known/mcp/server-card.json, mcp.json, and docs mentions for an MCP endpoint

  spec ↗report issue
• ✗npm SDKrecommended0/2

  No official npm SDK found: probed 6 candidate(s) (@px8fcgygk4/sdk, @px8fcgygk4/px8fcgygk4, px8fcgygk4, px8fcgygk4-sdk, px8fcgygk4-api, px8fcgygk4-js) — registry unavailable for: @px8fcgygk4/px8fcgygk4 (Request budget exhausted), px8fcgygk4 (Request budget exhausted), px8fcgygk4-sdk (Request budget exhausted), px8fcgygk4-api (Request budget exhausted), px8fcgygk4-js (Request budget exhausted)

  fix → Publish an official npm SDK (suggest @px8fcgygk4/sdk) with your domain in package.json homepage so agents can verify it's official.

  Searched the npm registry for an official, domain-verified SDK package

  report issue
• ✗PyPI SDKrecommended0/2

  No official PyPI SDK found: probed 4 candidate(s) (px8fcgygk4, px8fcgygk4-sdk, px8fcgygk4api, px8fcgygk4-python) — registry unavailable for: px8fcgygk4-python (Request budget exhausted)

  fix → Publish an official Python SDK (suggest "px8fcgygk4") with your domain in the project URLs so agents can verify it's official.

  Searched PyPI for an official, domain-verified SDK package

  report issue

Whether your specs, docs, and tools are complete and descriptive enough for an agent to use them without guessing.

• —OpenAPI validity & qualityrecommendedna

  No OpenAPI spec found — nothing to lint

  Linted the spec: descriptions, operationIds, securitySchemes, servers

  report issue
• —Docs qualityrecommendedna

  No documentation found to evaluate

  An LLM rated your docs for clarity, completeness, runnable examples, and agent-friendliness

  report issue
• —Quickstart / getting startedrecommendedna

  No docs found — a quickstart is evaluated on the docs artifact

  Looked for a quickstart/getting-started guide containing code blocks

  report issue
• —MCP tool qualityrecommendedna

  No MCP endpoint known — tool lint requires a tools/list

  Linted listed tools for descriptions, typed input schemas, and naming

  report issue

Response hygiene, TLS and redirect discipline, and security contact channels agents depend on at runtime.

• ◐TLS & redirect hygienerequired1/2

  http://bloomberg.com/ reaches https but ends in HTTP 403: http://bloomberg.com/ → https://bloomberg.com/ → https://www.bloomberg.com/

  fix → Redirect http→https in one hop and keep redirect chains ≤2; each hop costs agent latency and some clients give up.

  Checked http→https redirect behavior, chain length, and TLS health

  report issue
• !Response speed & weightrequirederror

  Homepage returned HTTP 403 — cannot assess response hygiene

  Measured homepage TTFB, payload size, and compression

  report issue
• ✓security.txtrecommended1/1

  Valid security.txt at https://bloomberg.com/.well-known/security.txt: Contact mailto:reportvuln@bloomberg.net, Expires 2027-07-01

  Fetched /.well-known/security.txt and validated Contact + Expires

  spec ↗report issue

Whether agents can discover your auth model machine-readably (OAuth metadata) and follow documented steps to credentials.

• ◐OAuth authorization server metadatarecommended1.5/3

  Valid RFC 8414 metadata at https://bloomberg.com/.well-known/oauth-authorization-server (issuer https://www.bloomberg.com, PKCE S256) but no registration_endpoint

  fix → Add a registration_endpoint (dynamic client registration) — agents cannot pre-register OAuth clients by hand.

  Fetched /.well-known/oauth-authorization-server (and openid-configuration fallback)

  spec ↗report issue
• ✗OAuth protected resource metadatarecommended0/2

  No RFC 9728 metadata: https://bloomberg.com/.well-known/oauth-protected-resource → HTTP 404

  fix → Serve RFC 9728 metadata at /.well-known/oauth-protected-resource naming your authorization servers so agents can discover how to authenticate.

  Fetched /.well-known/oauth-protected-resource

  spec ↗report issue
• ✗Auth documentationrecommended0/2

  No /auth.md and no docs page to search for authentication documentation

  fix → Document auth end-to-end (key creation → header format → example call), or ship /auth.md.

  Looked for /auth.md or an authentication docs page with code examples

  report issue

Whether pricing is discoverable and machine-readable, and whether you support agent payment protocols.

• ✗Pricing discoverablerequired0/5

  No pricing page found: no homepage link matching pricing/plans/billing, and probes of /pricing and /plans returned no HTML page.

  fix → Expose a crawlable /pricing page with literal plan prices and link it from your homepage nav.

  Followed nav/footer links and probed /pricing for a page with legible price signals

  report issue
• —Machine-readable pricingrecommendedna

  No pricing page found to evaluate

  Looked for Offer JSON-LD, then had an LLM attempt structured extraction of your plans

  spec ↗report issue
• ✗x402 payment supportbonusrecommended0/2

  /.well-known/x402 returned HTTP 404. No x402 support detected (bonus check — absence costs nothing).

  fix → Support x402: serve payment requirements at /.well-known/x402, or answer unauthenticated API calls with HTTP 402 plus an x402 payment-requirements payload (x402Version, accepts[]).

  Probed /.well-known/x402 and API endpoints for HTTP 402 payment-required envelopes

  spec ↗report issue
• ✗AP2 readinessemerging0/1

  No AP2 hints found — scanned no fetched artifacts (none available); /.well-known/ap2 returned HTTP 404.

  fix → Adopt AP2 to accept delegated agent payments — see https://ap2-protocol.org.

  Scanned fetched artifacts and well-known paths for AP2 hints

  spec ↗report issue
• ✗Agentic Commerce Protocolemerging0/1

  No Agentic Commerce Protocol hints found — scanned no fetched artifacts (none available); /.well-known/acp returned HTTP 404.

  fix → Adopt the Agentic Commerce Protocol so agent checkouts can complete against your store — see https://developers.openai.com/commerce.

  Scanned docs and specs for agentic checkout endpoints

  spec ↗report issue
• ✗Other agent payment protocolsbonusemerging0/1

  No UCP/MPP hints found — scanned no fetched artifacts (none available).

  fix → Track emerging agent payment protocols (UCP, MPP) and adopt the ones your buyers' agents use.

  Scanned fetched artifacts for UCP/MPP protocol hints

  report issue

Whether an end user's agent can operate on their behalf: working MCP tools, published skills, agent configs.

• —Agent skill publishedbonusemergingna

  Requires the analysis phase — not yet evaluated

  Checked /skill.md, /.well-known/skills/, and skills.sh for published agent skills

  report issue
• —MCP handshake & tools listrequiredna

  No MCP endpoint known — nothing to handshake with

  Performed a streamable-HTTP initialize + tools/list against the MCP endpoint

  spec ↗report issue
• —Agent configs in public repobonusemergingna

  Requires the analysis phase — not yet evaluated

  Checked your public GitHub org's main repos for AGENTS.md / .claude / .cursor configs

  report issue

Whether the site itself is legible to non-rendering and browser agents: semantic HTML, no JS walls, accessibility.

• ✗NLWeb endpointemerging0/1

  No NLWeb endpoint detected: /.well-known/nlweb.json returned HTTP 404 (application/json); GET /ask?query=hello returned HTTP 403 (application/json)

  fix → Consider exposing an NLWeb /ask endpoint (and /.well-known/nlweb.json) for conversational access to your content.

  Probed /.well-known/nlweb.json and the /ask endpoint

  spec ↗report issue
• !Semantic HTML structurerequirederror

  Homepage returned HTTP 403 (content-type application/json) — no HTML to inspect

  Scored landmark elements, heading hierarchy, and text-to-markup ratio on the homepage

  report issue
• !Content readable without JavaScriptrequirederror

  Homepage returned HTTP 403 (content-type application/json) — no HTML to inspect

  Measured visible text in the raw, unrendered homepage HTML

  report issue
• !Accessibility basicsrequirederror

  Homepage did not parse as HTML (HTTP 403, content-type "application/json")

  Static checks: lang attribute, title, alt coverage, labeled inputs, landmarks

  report issue
• ✗WebMCPemerging0/1

  No WebMCP evidence on homepage: no application/webmcp script and no navigator.modelContext reference

  fix → Consider WebMCP to expose page actions as tools to browser agents.

  Looked for WebMCP script declarations on the homepage

  spec ↗report issue