AI Context Files

A crawler policy is published

One of 40 checks the scanner runs. This one is worth 1 point inside the AI Context Files dimension, which carries 5% of the total score.

What does this check look at?

robots.txt is readable, so a crawler policy is published.

How do I fix it?

  • Publish robots.txt stating which crawlers are welcome.

Why is it worth 1 point?

Points are relative weights inside a dimension, and a dimension's weight decides how much of the total it can move. The reasoning for this dimension's weight is published rather than asserted:

DimensionAI Context Files — 5% of the total score
Points for this check1 of 6 in this dimension
Worth at most0.8 of the 100 points

Deliberately low. Most tools in this category weight llms.txt heavily and imply it is a ranking factor; the evidence does not support that, so neither does this score.

What else is measured in this dimension?

How do I see my own result?

Run a scan on your own domain. The report lists every failed check with the evidence that produced it, so you can tell a real failure from a check that does not apply.

Run a free GEO audit on your own site →

The full method, including the dimensions that are deliberately weighted low and the parts of the picture a single-URL scan cannot see, is on the methodology page.