[ENH] Wire up quantized writer in compaction by Sicheng-Pan · Pull Request #6399 · chroma-core/chroma

Sicheng-Pan · 2026-02-10T22:48:52Z

Description of changes

Summarize the changes made by this PR.

Improvements & Bug fixes
- Updated spann provider to spawn quantized writer with feature flag
- Wire up the quantized writer spawning in compactor
New functionality
- N/A

Test plan

How are these changes tested?

Tests pass locally with pytest for python, yarn test for js, cargo test for rust

Migration plan

Are there any migrations, or any forwards/backwards compatibility changes needed in order to make sure this change deploys reliably?

Observability plan

What is the plan to instrument and monitor this change?

Documentation Changes

Are all docstrings for user-facing APIs updated if required? Do we need to make documentation changes in the docs section?

Sicheng-Pan · 2026-02-10T22:49:08Z

This stack of pull requests is managed by Graphite. Learn more about stacking.

github-actions · 2026-02-10T22:51:08Z

propel-code-bot · 2026-02-11T02:31:07Z

Enable Quantized SPANN Writer and USearch Provider Plumbing

This PR wires quantized SPANN compaction end-to-end by introducing a USearch-backed writer path and the configuration/schema changes required to drive it. SpannProvider now optionally owns a USearchIndexProvider, bootstrapped via new usearch_provider.cache_config blocks in the service YAMLs and guarded by feature flags, while the worker/compactor orchestration code branches on SegmentType::QuantizedSpann to spawn the new quantized writer. The quantization configuration surface was redesigned: SpannIndexConfig.quantize is now the Quantization enum, serialization/deserialization helpers enforce valid presets, and Schema::quantize() applies preset defaults for allow-listed tenants; the generated TypeScript API types and validation logic were updated accordingly. Tests and helpers (including quantized_spann::test_config) were adjusted to the new enum-based configuration and to cover quantized segment paths and USearch cache directories.

Key Changes

• Introduced optional USearchIndexProvider wiring inside SpannProvider, including feature-gated constructors, write_quantized_usearch helper, and server/bootstrap hooks that build the provider/cache using new YAML config.
• Refactored compaction, log-fetch, and attached-function orchestration to recognize SegmentType::QuantizedSpann, spawn the quantized writer, and stop assuming HNSW UUIDs.
• Replaced the boolean SpannIndexConfig.quantize flag with a Quantization enum, added serde helpers/validation, and exposed the enum through Rust schema APIs and generated TypeScript types.
• Added Schema::quantize() to auto-apply quantization presets for eligible tenants and kept frontend schema/attached-function flows in sync.
• Updated worker Cargo.toml, configuration files, and tests (including quantized_spann::test_config) to enable the usearch feature and supply cache/test directories for quantized segments.

Possible Issues

• Deployments missing the new usearch_provider config will fail at startup when the usearch feature is enabled.
• Older persisted schemas or clients still sending boolean quantize values may break without migration/backcompat logic.
• Any remaining code paths that still expect an HNSW UUID for quantized segments could panic or mis-route work.

This summary was automatically generated by @propel-code-bot

rust/worker/src/compactor/compaction_manager.rs

rust/types/src/collection_schema.rs

rust/segment/src/spann_provider.rs

rust/worker/src/server.rs

HammadB

please move out the config

Sicheng-Pan · 2026-02-13T00:58:38Z

Introduced separate cache config for USearch

Sicheng-Pan · 2026-02-14T01:52:19Z

Merge activity

Feb 14, 1:52 AM UTC: A user started a stack merge that includes this pull request via Graphite.
Feb 14, 1:54 AM UTC: Graphite rebased this pull request as part of a merge.
Feb 14, 2:30 AM UTC: @Sicheng-Pan merged this pull request with Graphite.

- **[ENH]: Cache rust git submodules in mounted volume (#6424)** - **[CHORE](k8s) increase dev CPU limits from 100m to 200-300m (#6435)** - **[ENH] replace live cloud tests with k8s integration tests (#6434)** - **[ENH] Make dirty_log_collections metric mcmr-aware. (#6353)** - **[ENH] Quantized Spann Segment Writer (#6397)** - **[ENH] Wire up quantized writer in compaction (#6399)** - **[ENH] Quantized Spann Segment Reader (#6405)** - **[ENH] Wire up quantized reader in new orchestrator (#6409)** - **[ENH] Garbage collect usearch index files (#6416)** - **[ENH] Trace quantized spann implementation (#6425)** - **[ENH]: Precompute data chunk len() (#6442)** - **[BUG]: Compaction version file flush was incomplete on MCMR (#6423)** - **[DOC]: Fixed broken links in Readme (#6440)** - **[DOC] Fix link to Rust documentation (#6443)** - **[ENH]: Allow users to disable FTS in schema (#6214)** --------- Co-authored-by: Robert Escriva <[email protected]> Co-authored-by: Macronova <[email protected]> Co-authored-by: Nilpotent <[email protected]> Co-authored-by: anderk222 <[email protected]> Co-authored-by: Sanket Kedia <[email protected]>

Sicheng-Pan mentioned this pull request Feb 10, 2026

[ENH] Quantized Spann Segment Writer #6397

Merged

1 task

This comment has been minimized.

Sign in to view

Sicheng-Pan force-pushed the 02-10-_enh_quantized_spann_segment branch from 15768fa to e3957b5 Compare February 11, 2026 02:22

Sicheng-Pan force-pushed the 02-10-_enh_wire_up_quantized_writer_in_compaction branch from 184f5c3 to ff1afdf Compare February 11, 2026 02:22

Sicheng-Pan marked this pull request as ready for review February 11, 2026 02:30

This comment has been minimized.

Sign in to view

Sicheng-Pan force-pushed the 02-10-_enh_quantized_spann_segment branch from e3957b5 to 0a585d2 Compare February 11, 2026 19:10

Sicheng-Pan force-pushed the 02-10-_enh_wire_up_quantized_writer_in_compaction branch from ff1afdf to d599ae5 Compare February 11, 2026 19:10

This was referenced Feb 11, 2026

[ENH] Quantized Spann Segment Reader #6405

Merged

[ENH] Wire up quantized reader in new orchestrator #6409

Merged

Sicheng-Pan force-pushed the 02-10-_enh_wire_up_quantized_writer_in_compaction branch from 3324688 to f823d3d Compare February 11, 2026 21:07

This comment has been minimized.

Sign in to view

Sicheng-Pan force-pushed the 02-10-_enh_wire_up_quantized_writer_in_compaction branch from f823d3d to d45735e Compare February 12, 2026 01:40

Sicheng-Pan force-pushed the 02-10-_enh_quantized_spann_segment branch from 22ff37f to fa35f48 Compare February 12, 2026 01:40

Sicheng-Pan force-pushed the 02-10-_enh_wire_up_quantized_writer_in_compaction branch from d45735e to d24f142 Compare February 12, 2026 01:41

Sicheng-Pan force-pushed the 02-10-_enh_quantized_spann_segment branch from fa35f48 to b02eb80 Compare February 12, 2026 01:41

propel-code-bot bot reviewed Feb 12, 2026

View reviewed changes

rust/worker/src/compactor/compaction_manager.rs Show resolved Hide resolved

This was referenced Feb 12, 2026

[ENH] Garbage collect usearch index files #6416

Merged

[ENH] Trace quantized spann implementation #6425

Merged

Sicheng-Pan force-pushed the 02-10-_enh_wire_up_quantized_writer_in_compaction branch from d2f93df to bc0818a Compare February 12, 2026 21:33

Sicheng-Pan force-pushed the 02-10-_enh_quantized_spann_segment branch from b02eb80 to 41c8cc9 Compare February 12, 2026 21:33

propel-code-bot bot reviewed Feb 12, 2026

View reviewed changes

rust/types/src/collection_schema.rs Show resolved Hide resolved

propel-code-bot bot reviewed Feb 12, 2026

View reviewed changes

rust/types/src/collection_schema.rs Show resolved Hide resolved

propel-code-bot bot reviewed Feb 12, 2026

View reviewed changes

rust/types/src/collection_schema.rs Show resolved Hide resolved

This comment has been minimized.

Sign in to view

Sicheng-Pan commented Feb 12, 2026

View reviewed changes

rust/types/src/collection_schema.rs Outdated Show resolved Hide resolved

Sicheng-Pan commented Feb 12, 2026

View reviewed changes

rust/segment/src/spann_provider.rs Show resolved Hide resolved

Sicheng-Pan commented Feb 12, 2026

View reviewed changes

rust/worker/src/server.rs Outdated Show resolved Hide resolved

HammadB approved these changes Feb 12, 2026

View reviewed changes

Sicheng-Pan force-pushed the 02-10-_enh_quantized_spann_segment branch from 41c8cc9 to d58781f Compare February 13, 2026 00:43

Sicheng-Pan force-pushed the 02-10-_enh_wire_up_quantized_writer_in_compaction branch from bc0818a to 465c5fc Compare February 13, 2026 00:43

HammadB approved these changes Feb 13, 2026

View reviewed changes

Sicheng-Pan changed the base branch from 02-10-_enh_quantized_spann_segment to graphite-base/6399 February 14, 2026 01:52

Sicheng-Pan changed the base branch from graphite-base/6399 to main February 14, 2026 01:52

Sicheng-Pan added 7 commits February 14, 2026 01:53

[ENH] Wire up quantized writer in compaction

9f01b16

Update provider

4bad3c1

Update quantization schema config

3051ec4

Regen

67012e4

Fix test

aa5d64b

Rename enum

d4fc475

Address comments

8588982

Sicheng-Pan force-pushed the 02-10-_enh_wire_up_quantized_writer_in_compaction branch from 465c5fc to 8588982 Compare February 14, 2026 01:53

Sicheng-Pan merged commit 6b0fa05 into main Feb 14, 2026
67 checks passed

tanujnay112 mentioned this pull request Feb 18, 2026

[CHORE]: fast forward rc/2026-02-13 to 3cb097601ddd379ab109456727a926e593e43a5c #6456

Merged

Sicheng-Pan deleted the 02-10-_enh_wire_up_quantized_writer_in_compaction branch February 25, 2026 23:47

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[ENH] Wire up quantized writer in compaction#6399

[ENH] Wire up quantized writer in compaction#6399
Sicheng-Pan merged 7 commits intomainfrom
02-10-_enh_wire_up_quantized_writer_in_compaction

Sicheng-Pan commented Feb 10, 2026 •

edited

Loading

Uh oh!

Sicheng-Pan commented Feb 10, 2026 •

edited

Loading

Uh oh!

github-actions bot commented Feb 10, 2026

Uh oh!

This comment has been minimized.

propel-code-bot bot commented Feb 11, 2026 •

edited

Loading

Uh oh!

This comment has been minimized.

This comment has been minimized.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

This comment has been minimized.

Uh oh!

Uh oh!

Uh oh!

HammadB left a comment

Uh oh!

Sicheng-Pan commented Feb 13, 2026

Uh oh!

Sicheng-Pan commented Feb 14, 2026 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

Sicheng-Pan commented Feb 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description of changes

Test plan

Migration plan

Observability plan

Documentation Changes

Uh oh!

Sicheng-Pan commented Feb 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 10, 2026

Reviewer Checklist

Testing, Bugs, Errors, Logs, Documentation

System Compatibility

Quality

Uh oh!

This comment has been minimized.

propel-code-bot bot commented Feb 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

This comment has been minimized.

This comment has been minimized.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

This comment has been minimized.

Uh oh!

Uh oh!

Uh oh!

HammadB left a comment

Choose a reason for hiding this comment

Uh oh!

Sicheng-Pan commented Feb 13, 2026

Uh oh!

Sicheng-Pan commented Feb 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merge activity

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Sicheng-Pan commented Feb 10, 2026 •

edited

Loading

Sicheng-Pan commented Feb 10, 2026 •

edited

Loading

propel-code-bot bot commented Feb 11, 2026 •

edited

Loading

Sicheng-Pan commented Feb 14, 2026 •

edited

Loading