DEV-TOOLSApril 17, 20261 min read12 views

Scan your website to see how ready it is for AI agents

A new scanning tool evaluates website readiness for AI agents across five key categories, including discoverability and protocol support. It provides a roadmap for developers to optimize their sites for the emerging agentic web.

Is Your Site Agent-Ready?

Scan your website to see how ready it is for AI agents. We check multiple emerging standards — from robots.txt and Markdown negotiation to MCP, OAuth, Agent Skills and agentic commerce.

Multiple checks across 5 categories:

Discoverability — robots.txt, Sitemap, Link response headers Content Accessibility — Markdown content negotiation Bot Access Control — AI bot rules in robots.txt, Content Signals, Web Bot Auth Protocol Discovery — MCP Server Card, Agent Skills, WebMCP, API Catalog, OAuth discovery, OAuth Protected Resource Commerce — x402, UCP, ACP

Start with the easy wins: publish a valid robots.txt with AI bot rules and sitemap directives, and make sure your homepage exposes useful discovery headers or metadata.

How to improve your score

Copy the instructions below and paste them into your coding agent (Cursor, Claude Code, Windsurf, Copilot, etc.) to improve your site's agent readiness.

Source: Hacker News

More in this category

dev-tools

Linux kernel will support $ORIGIN, sort of

Farid Zakaria shares his journey of proposing a patch to the Linux kernel to support relocatable binaries in Nix, which evolved into a powerful eBPF-based solution for binfmt_misc.

dev-tools

Five US tech giants' hidden debts soar to $1.65T on opaque AI funding

A Nikkei study reveals that off-balance-sheet debts at five major US tech companies have surged eightfold to $1.65 trillion, driven by massive AI investments like data center leases and GPU contracts.

dev-tools

Running Doom on Our Custom CPU and Going Viral

Two developers successfully built a custom CPU from scratch at the logic gate level, deployed it on an FPGA, and optimized its memory architecture to run the classic game DOOM.

dev-tools

Incremental – A library for incremental computations

Incremental is a library designed for building complex computations that update efficiently when inputs change. Inspired by self-adjusting computation research, it is highly useful for large-scale calculations, GUI views, and data synchronization.

dev-tools

Flock Credibility Lost as It Repeatedly Lies to City Councils, Police, & Public

Flock Safety, a prominent provider of automatic license plate readers (ALPR), is facing a severe credibility crisis after being caught repeatedly misleading city councils, police departments, and the public about its surveillance capabilities and data practices.

dev-tools

Human mathematicians are being outcounterexampled

In just a few weeks, advanced AI models like ChatGPT Sol and Claude Fable have disproved long-standing mathematical conjectures by finding precise counterexamples and auto-formalizing them in Lean.