The tool reads declared robots rules for a set of known crawler user agents and reports whether those rules permit access to the tested path.
KNWN Visibility · Technical Check
Check whether AI crawlers can access your site.
Inspect a site's robots file for known crawler access rules. Access is one technical condition and does not guarantee inclusion in an AI answer.
Robots access is a technical signal, not a guarantee of citations or rankings.
Section 01
What this check can verify
Section 02
What it cannot verify
It does not prove that a crawler visited, indexed or used the content, and it cannot guarantee a citation, recommendation or ranking.
Live check
Check a public website
Enter a public HTTP or HTTPS site. The submitted address is sent only to the checker service and is not included in analytics.
Related capability
Need a crawler delivery layer?
KNWN Visibility measures what appears in AI answers. If AI crawlers are receiving incomplete or unsuitable content from your existing site, DualWeb provides the synchronized bifurcation and delivery layer.
Explore DualWeb Bifurcation