source string | entry_record string | retrieved string | index_built string | degraded bool | last_tick dict | measured_n int64 | current_version_n int64 | license string | score_version int64 | note string | rows list | events list |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
https://crawlcheck.io/directory | https://crawlcheck.io/directory/{slug}/record.json | 2026-11-18T02:20:51.838Z | 2026-11-18T02:03:04.965Z | false | {
"started": "2026-11-18T02:03:02.276Z",
"phase": "rebuild",
"picks": 4,
"ms": {
"scans": 90
},
"prev": {
"started": "2026-11-18T01:32:56.113Z",
"phase": "done",
"picks": 4,
"ms": {
"scans": 667,
"rebuild": 11635,
"snapshot": 231
},
"at_ms": 13081,
"scanned"... | 364 | 58 | https://creativecommons.org/licenses/by/4.0/ | 43 | Scores are measurements of each vendor's own site, taken from outside its network. Rows regenerate; a score is never altered by payment or request. Categories are ours and unscored. | [
{
"slug": "ahrefs",
"name": "Ahrefs",
"domain": "ahrefs.com",
"cat": "SEO suite",
"measured": true,
"at": "2026-11-11T01:47:53.578Z",
"id": "jwomlwonql",
"refused": false,
"alias_of": null,
"sv": 34,
"grade": "C",
"score": 65,
"findings": 3,
"level": "medium",... | [
{
"vendor": "Anthropic",
"slug": "anthropic",
"domain": "anthropic.com",
"at": "2026-11-16T21:33:03.804Z",
"kind": "appeared",
"code": "IMAGE_FORMAT_MISMATCH",
"text": "homepage images stopped matching their file names"
},
{
"vendor": "Anyword",
"slug": "anyword",
"domain... |
CrawlCheck: Vendor website benchmark
SEO and AI-visibility vendors measured by the same rules as everyone else: what a crawler receives from each homepage, re-measured on a rolling cadence.
Mirrored from crawlcheck.io/directory by the CrawlCheck Worker; the site is the canonical copy and is updated first. Measured by CrawlCheck's own observer. Free under CC BY 4.0: credit "CrawlCheck" with the URL of the file.
- Catalogue of every dataset: https://crawlcheck.io/datasets
- How the data is made: https://crawlcheck.io/how-it-works
- Downloads last month
- 3,129