I checked llms.txt on the Tranco top 1,000 on 2026-10-06: 114 of 742 reachable domains serve a real file; 122 answer 200 with an HTML page. Format, si...
robots.txt on the Tranco top 1,000 (2026-10-06, n=545 files): which AI tokens control training and which control answers, and the mistakes real files ...
90% ship Open Graph tags. Only 23% declare image dimensions, one in five skips twitter:card entirely, and two sites ship an og:image tag with no conte...
Most sites emit one JSON-LD block per schema type and never connect them. A single @graph with @id references fixes the duplication — and makes the da...