If an AI crawler cannot read a page, the assistant cannot cite it. robots.txt is not the only gate. A firewall, a CDN rule, or a login wall can block the crawler even when the file looks open. Visibility starts with a page the assistant is allowed to fetch.