Skip to content

Enable mmap storage using blob store for sparse vectors by default#5784

Merged
timvisee merged 1 commit intodevfrom
blob-store-sparse-vectors-enable
Jan 13, 2025
Merged

Enable mmap storage using blob store for sparse vectors by default#5784
timvisee merged 1 commit intodevfrom
blob-store-sparse-vectors-enable

Conversation

@timvisee
Copy link
Copy Markdown
Member

Prepare for the release of Qdrant 1.13 and enable the mmap storage for sparse vectors using blob store by default. This allows us to test it on chaos testing for some time.

All Submissions:

  • Contributions should target the dev branch. Did you create your branch from dev?
  • Have you followed the guidelines in our Contributing document?
  • Have you checked to ensure there aren't other open Pull Requests for the same update/change?

@timvisee timvisee requested review from agourlay and generall January 13, 2025 12:58
Comment thread lib/segment/src/types.rs
Comment on lines 983 to 991
pub enum SparseVectorStorageType {
/// Storage on disk
// (rocksdb storage)
#[default]
OnDisk,
/// Storage in memory maps
// (blob_store storage)
#[default]
Mmap,
}
Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Note: this also changes the default variant on SparseVectorStorageType, I expect no weird side effects because of it.

@agourlay
Copy link
Copy Markdown
Member

This allows us to test it on chaos testing for some time.

Do we push sparse vectors on chaos testing?

@timvisee
Copy link
Copy Markdown
Member Author

This allows us to test it on chaos testing for some time.

Do we push sparse vectors on chaos testing?

We don't right now. But we do in continuous benchmarks.

@timvisee timvisee merged commit e1a4968 into dev Jan 13, 2025
@timvisee timvisee deleted the blob-store-sparse-vectors-enable branch January 13, 2025 13:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants