{"meta":{"dataset":"law-firm-ai-readiness","title":"US law-firm websites and AI crawlers: crawler-file rules, text before JavaScript, snippet limits and Spanish pages, by state and market","version":"1.0.0","doi":"10.5281/zenodo.24015038","doiUrl":"https://doi.org/10.5281/zenodo.24015038","conceptDoi":"10.5281/zenodo.24015037","license":"CC BY 4.0","licenseUrl":"https://creativecommons.org/licenses/by/4.0/","attribution":"Source: Probative, US law-firm websites and AI crawlers: crawler-file rules, text before JavaScript, snippet limits and Spanish pages, by state and market, version 1.0.0, https://doi.org/10.5281/zenodo.24015038, licensed CC BY 4.0.","citation":"Probative. (2026). US law-firm websites and AI crawlers: crawler-file rules, text before JavaScript, snippet limits and Spanish pages, by state and market (Version 1.0.0) [Data set]. Zenodo. https://doi.org/10.5281/zenodo.24015038","citeAs":"Probative Growth, US law-firm websites and AI crawlers: crawler-file rules, text before JavaScript, snippet limits and Spanish pages, by state and market, 2026, https://doi.org/10.5281/zenodo.24015038","disclaimer":"Not legal advice. These are counts of what law-firm websites' crawler files and raw pages said when read. A rule in such a file is what the file says; it does not show what any AI tool does, and nothing here measures whether a firm appears in AI answers. The counts describe no firm's quality.","notice":"Probative is a marketing firm, not a law firm; not legal advice.","lastChecked":"2026-11-06","url":"https://probativegrowth.com/data/v1/law-firm-ai-readiness/changes.json","humanUrl":"https://probativegrowth.com/data/law-firm-ai-readiness/","statusCodes":{"P":"primary source","S":"secondary source"}},"changes":[{"id":"law-firm-ai-readiness-2026-11-06-first","date":"2026-11-06","jurisdiction":"US","records":["law-firm-ai-readiness:US"],"status":"P","title":"Law-firm websites and AI crawlers first published","summary":"Crawler-file rules for eight named AI crawlers and controls, the home-page text a reader gets before JavaScript runs, FAQPage and Organization markup, snippet limits, apex and www hosts and Spanish pages on 44,118 US law-firm websites: 2.2% block the home page for at least one named AI crawler or control.","source":{"label":"Probative, law-firm websites read 2026-11-03 to 2026-11-04","url":"https://probativegrowth.com/data/law-firm-ai-readiness/"},"dataset":"law-firm-ai-readiness"}]}