Skip to content

Add serialisation for svs + adjustments [MOD-10097]#6394

Merged
alonre24 merged 17 commits intomasterfrom
serialization_for_svs
Jun 30, 2025
Merged

Add serialisation for svs + adjustments [MOD-10097]#6394
alonre24 merged 17 commits intomasterfrom
serialization_for_svs

Conversation

@alonre24
Copy link
Collaborator

@alonre24 alonre24 commented Jun 29, 2025

Describe the changes in the pull request

A clear and concise description of what the PR is solving, including:

Adds required support for SVS-VAMANA, including:

  1. Add a new RDB serialization version to support SVS-VAMANA. This one does not include saving initial_cap and block_size index parameters as we used to in the past. Backward compatibility exists, though these args are ignored in practice.
  2. Remove logic for validations of initial_cap and block_size so that index creation will not exceed memory limits. The logic was reduces and the minimum needed was left (validation that a single vector will not exceed the maximum block size allowed). Tests were also removed and adjusted.
  3. Add support for JSON, but not for multi just yet (enable sanity tests and fail gracefully in multi).
  4. Remove exposure of some svs args (the ones decided to be internal args) and adjust tests. Also, update FT.INFO for vector field of type VAMANA and test that it returns the proper default fields by default.

Main objects this PR modified

  1. ...

Mark if applicable

  • This PR introduces API changes
  • This PR introduces serialization changes

todo: fix create error test, test info with quantised index
@alonre24 alonre24 marked this pull request as ready for review June 30, 2025 06:31
@alonre24 alonre24 requested review from GuyAv46 and meiravgri June 30, 2025 06:33
@alonre24 alonre24 changed the title add serialization for svs + adjustments [WIP] Add serialisation for svs + adjustments [10097] Jun 30, 2025
@alonre24 alonre24 requested review from GuyAv46 and meiravgri June 30, 2025 16:31
@alonre24 alonre24 changed the title Add serialisation for svs + adjustments [10097] Add serialisation for svs + adjustments [MOD-10097] Jun 30, 2025
GuyAv46
GuyAv46 previously approved these changes Jun 30, 2025
@codecov
Copy link

codecov bot commented Jun 30, 2025

Codecov Report

Attention: Patch coverage is 78.52349% with 32 lines in your changes missing coverage. Please review.

Project coverage is 89.21%. Comparing base (b133248) to head (48cdf83).
Report is 4 commits behind head on master.

Files with missing lines Patch % Lines
src/vector_index.c 74.74% 25 Missing ⚠️
src/spec.c 83.72% 7 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           master    #6394      +/-   ##
==========================================
+ Coverage   88.81%   89.21%   +0.40%     
==========================================
  Files         251      251              
  Lines       41605    41307     -298     
  Branches     3623     3623              
==========================================
- Hits        36953    36854      -99     
+ Misses       4608     4409     -199     
  Partials       44       44              
Flag Coverage Δ
flow 81.92% <78.52%> (+0.40%) ⬆️
unit 46.85% <6.71%> (+0.19%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@alonre24 alonre24 merged commit e4b2cab into master Jun 30, 2025
12 checks passed
@alonre24 alonre24 deleted the serialization_for_svs branch June 30, 2025 21:57
alonre24 added a commit to alonre24/redis that referenced this pull request Jul 1, 2025
Introducing a new SVS-VAMANA vector type index which supports vector compression (optimized on Intel machines) - RediSearch/RediSearch#6329, RediSearch/RediSearch#6394
YaacovHazan pushed a commit to redis/redis that referenced this pull request Jul 2, 2025
[#Q6329](RediSearch/RediSearch#6329),
[#Q6329](RediSearch/RediSearch#6394) -
Introducing the new SVS-VAMANA vector index type which supports vector
compression (optimized on Intel machines)
fcostaoliveira pushed a commit to filipecosta90/redis that referenced this pull request Jul 4, 2025
[#Q6329](RediSearch/RediSearch#6329),
[#Q6329](RediSearch/RediSearch#6394) -
Introducing the new SVS-VAMANA vector index type which supports vector
compression (optimized on Intel machines)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants