Dataset Viewer
Auto-converted to Parquet Duplicate
source
string
entry_record
string
retrieved
string
index_built
string
degraded
bool
last_tick
dict
measured_n
int64
current_version_n
int64
license
string
score_version
int64
note
string
rows
list
events
list
https://crawlcheck.io/directory
https://crawlcheck.io/directory/{slug}/record.json
2026-11-18T02:20:51.838Z
2026-11-18T02:03:04.965Z
false
{ "started": "2026-11-18T02:03:02.276Z", "phase": "rebuild", "picks": 4, "ms": { "scans": 90 }, "prev": { "started": "2026-11-18T01:32:56.113Z", "phase": "done", "picks": 4, "ms": { "scans": 667, "rebuild": 11635, "snapshot": 231 }, "at_ms": 13081, "scanned"...
364
58
https://creativecommons.org/licenses/by/4.0/
43
Scores are measurements of each vendor's own site, taken from outside its network. Rows regenerate; a score is never altered by payment or request. Categories are ours and unscored.
[ { "slug": "ahrefs", "name": "Ahrefs", "domain": "ahrefs.com", "cat": "SEO suite", "measured": true, "at": "2026-11-11T01:47:53.578Z", "id": "jwomlwonql", "refused": false, "alias_of": null, "sv": 34, "grade": "C", "score": 65, "findings": 3, "level": "medium",...
[ { "vendor": "Anthropic", "slug": "anthropic", "domain": "anthropic.com", "at": "2026-11-16T21:33:03.804Z", "kind": "appeared", "code": "IMAGE_FORMAT_MISMATCH", "text": "homepage images stopped matching their file names" }, { "vendor": "Anyword", "slug": "anyword", "domain...

CrawlCheck: Vendor website benchmark

SEO and AI-visibility vendors measured by the same rules as everyone else: what a crawler receives from each homepage, re-measured on a rolling cadence.

Mirrored from crawlcheck.io/directory by the CrawlCheck Worker; the site is the canonical copy and is updated first. Measured by CrawlCheck's own observer. Free under CC BY 4.0: credit "CrawlCheck" with the URL of the file.

Downloads last month
3,129