You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 3ed4561
Browse filesBrowse the repository at this point in the historyBrowse files
feat: richer column value profiles in schema_inspect (ranked values, uniqueness, value shapes, MongoDB) (#1542)
* feat: richer column value profiles in schema_inspect (ranked values, uniqueness, value shapes, MongoDB paths)
- SQL profile (sqlite, duckdb, postgres) stays one query per table but now
returns frequency-ranked values with counts; high-cardinality text shows the
3 most frequent values instead of arbitrary ones
- mark columns whose distinct count equals their non-null count as
`unique in sample`
- report the top value shapes of informative text columns (`H01M4/9066` ->
`A9+A9/9+`), skipping free text and plain single-shape words
- show one ~160 character example for long text columns
- MongoDB: the driver reports nested dotted paths (depth <= 3, `field[]` for
arrays of objects) with a presence share, exposes `sampleDocuments`, and
`schema_inspect` builds the same value profile from the sampled documents
Co-Authored-By: Claude Opus 5.5 <[email protected]>
* fix: [review] MongoDB value profile renders BSON types, dotted keys and MongoDB notation
- render UUID, ObjectId, Decimal128, Long, Timestamp, regex, Code and MinKey/MaxKey
as readable text; values with no text form report "values not profiled (type)"
instead of "all NULL"
- carry key paths as segments so keys containing "." are read correctly
- name nested fields in MongoDB dot notation (`items.sku`) and mark array
membership in a "Nested fields" listing
- revert `describeTable` to its top-level behaviour; nested fields are derived
in `schema_inspect` from the single document sample used for the value profile
- bound the sample with `maxTimeMS` and the tool call's abort signal
- add real-BSON unit tests, a describeTable regression test, and a real-server e2e case
Co-Authored-By: Claude Opus 5.5 <[email protected]>
* fix: [review] handle late sampleDocuments rejection and keep array-element marking
- attach a handler to the in-flight read so a rejection after abort is not unhandled, and pass the signal to find
- accumulate inArray across every occurrence of a nested path so mixed-shape fields are never unique
- add tests for both
Co-Authored-By: Claude Opus 5.5 <[email protected]>
* fix: [review] count and rank profile values on the full text, clip only for output
SQL groups and ranks the full value and applies SUBSTR in the outer projection; the MongoDB profile keys counts by the full rendered text. Long values sharing a 200 character prefix stay distinct and unique.
Co-Authored-By: Claude Opus 5.5 <[email protected]>
---------
Co-authored-by: Claude Opus 5.5 <[email protected]>
0 commit comments