Skip to the content

Agent readiness check

robots.txt states how AI may use the content

robots.txt declares Content-Signal preferences for search, ai-input and ai-train.

low severityagents.content-signals

Run this check on your site

Runs just this check in quick mode. The report opens with the evidence and the fix.

Why it matters

Allow and Disallow say who may fetch a page, not what they may do with it. Content Signals add that: whether the content may be indexed for search, used as input to an AI answer, or used to train a model.

How to fix it

Add a Content-Signal line to robots.txt with your choice for each use, for example `Content-Signal: search=yes, ai-input=yes, ai-train=no`. The values are a business decision: choose them, then publish them.

The details

Category
Agent readiness
Severity of a failure
low
Confidence
high
Needs a browser
No
Check id
agents.content-signals

References