Skip to content

Enable HNSW graph links compression by default#5781

Merged
timvisee merged 1 commit intodevfrom
hnsw-graph-compression-enable
Jan 13, 2025
Merged

Enable HNSW graph links compression by default#5781
timvisee merged 1 commit intodevfrom
hnsw-graph-compression-enable

Conversation

@timvisee
Copy link
Copy Markdown
Member

Prepare for the release of Qdrant 1.13 and enable HNSW graph links compression by default. This allows us to test it on chaos testing for some time.

This removes the configurability and enables it by default. Converting existing graphs is disabled, thus only new graphs are affected.

All Submissions:

  • Contributions should target the dev branch. Did you create your branch from dev?
  • Have you followed the guidelines in our Contributing document?
  • Have you checked to ensure there aren't other open Pull Requests for the same update/change?

@timvisee timvisee requested review from generall and xzfc January 13, 2025 12:03
const SINGLE_THREADED_HNSW_BUILD_THRESHOLD: usize = 256;

const LINK_COMPRESSION_FORMAT: GraphLinksFormat = GraphLinksFormat::Compressed;
const LINK_COMPRESSION_CONVERT_EXISTING: bool = false;
Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I disabled converting existing graphs for now. I figured we might want to wait one minor version with this and fully dedicate to the feature in 1.14.

@timvisee timvisee merged commit 64be478 into dev Jan 13, 2025
@timvisee timvisee deleted the hnsw-graph-compression-enable branch January 13, 2025 18:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants