Can AI crawlers read your site? robots.txt audit for 48 known AI bots — compared side by side with competitor domains.
Static robots.txt audit: what your rules allow or block, before any crawler visits.
Auditing robots.txt…
Bot list and categories are based on public user-agent documentation: the ai.robots.txt community list, Dark Visitors, and each operator's own docs. ai.robots.txt · Dark Visitors