Domain report
agentweb.us
agentweb.us ranks in the top 0.29% of domains by connectivity (Common Crawl, cc-main-2026-jul-aug-sep), with 1 distinct host observed under it.
Connectivity
- Top percentile
- 0.29%
- Hosts observed
- 1
From the Common Crawl cc-main-2026-jul-aug-sep hyperlink graph, 133,241,980 domains total. What this rank means
HTTPS reachability
https://agentweb.us/ answered with HTTP 200.
DNS records
- A
- 216.150.1.1
- AAAA
- No records found.
- MX
- 1 smtp.google.com.
- NS
- val.ns.cloudflare.com.
- zod.ns.cloudflare.com.
Live preview
This site sends "X-Frame-Options: DENY", which blocks embedding it here.
Since agentweb.us can't be embedded live, this is a captured screenshot instead — a snapshot from whenever it was last rendered, not necessarily this exact moment.
Domain registration (WHOIS / RDAP)
RDAP lookup failed (HTTP 429).
SSL certificate
Certificate Transparency lookup failed (HTTP 429).
HTTP & security headers
Response
- Server
- cloudflare
- Content-Type
- text/html; charset=utf-8
- Cache-Control
- public, max-age=0, must-revalidate
- Content-Encoding
- Not sent
Security
- Content-Security-Policy
- default-src 'self'; base-uri 'self'; object-src 'none'; form-action 'self'; script-src 'self' https://*.i.posthog.com https://r.agentweb.us https://www.googletagmanager.com; style-src 'self' 'unsafe-inline' https://fonts.googleapis.com; img-src 'self' data: https:; connect-src 'self' https://api.agentweb.us https://mcp.agentweb.us https://mcp-staging.agentweb.us https://r.agentweb.us https://*.supabase.co https://agentweb-mcp.andreymarey20.workers.dev https://agentweb-telemetry.andreymarey20.workers.dev https://http-intake.logs.datadoghq.com https://*.posthog.com https://*.i.posthog.com https://*.onkernel.com:8443 wss://*.onkernel.com:8443 https://*.kernel.sh:8443 wss://*.kernel.sh:8443 https://www.google-analytics.com https://*.google-analytics.com https://*.grafana.net; font-src 'self' https://fonts.gstatic.com; frame-src https://cal.com https://*.cal.com https://www.loom.com https://browserbase.com https://*.browserbase.com https://*.onkernel.com:8443 https://*.kernel.sh:8443; frame-ancestors 'none'
- Strict-Transport-Security
- max-age=63072000; includeSubDomains; preload
- X-Frame-Options
- DENY
- X-Content-Type-Options
- nosniff
- Referrer-Policy
- strict-origin-when-cross-origin
- Permissions-Policy
- camera=(), microphone=(), geolocation=(), payment=(), publickey-credentials-get=(self), publickey-credentials-create=(self), usb=()
Redirect chain
- 1.
http://agentweb.us/HTTP 308→ https://agentweb.us/
- 2.
https://agentweb.us/HTTP 307→ https://www.agentweb.us/
- 3.
https://www.agentweb.us/HTTP 200
Meta tags
- Title
- AgentWeb | The Web, Indexed for Action
- Description
- AgentWeb is the action index for the web: real sites indexed as callable, verified actions for AI agents.
- Canonical
- https://www.agentweb.us/
- Robots
- Not set
- Generator
- Not set
- Open Graph title
- AgentWeb | The Web, Indexed for Action
- Open Graph description
- AgentWeb is the action index for the web: real sites indexed as callable, verified actions for AI agents.
- Open Graph image
- https://www.agentweb.us/agentweb-social-card-2026-08.jpg
- Open Graph type
- website
- Twitter card
- summary_large_image
- Twitter title
- AgentWeb | The Web, Indexed for Action
- Twitter image
- https://www.agentweb.us/agentweb-social-card-2026-08.jpg
robots.txt
- Disallow rules (User-agent: *)
- 3
- Disallow rules (other agents)
- 40
Sitemaps declared:
https://www.agentweb.us/sitemap.xmlhttps://www.agentweb.us/sitemap-pseo.xml
Technology detected
Best-effort, based on a small set of well-known signals — this may be incomplete.
- Cloudflarecdn
Server: cloudflare
Related domains
Similar connectivity
Domains ranked just above and below it in the same snapshot.