09/11/2026
Blocking a page with robots.txt doesn't actually hide it. Most business owners have no idea.
That "disallow" instruction is a request, not a guarantee. If another site links to that page, a crawler can still find it, still show it, still reference it, disallow or not.
Think about an old promo page or staging page you assumed was tucked away. If it's linked from a Facebook group or an old backlink, it can still surface.
Google's own documentation confirms it: blocking a page in robots.txt does not guarantee it stays out of search or AI tools.
If you need something actually hidden, use password protection or a noindex tag instead.