Skip to content

bug(python): Creating an IVF index can panic in K-means with an assertion failure #3649

Description

@zhuang-keju

LanceDB version

0.34.0b6

What happened?

When inserting 1537 data, and creating the IVF index with 472 clusters, the rust worker panicks with the exception "pyo3_async_runtimes.RustPanic: rust future panicked: unknown error". According to the IVF algorithm, creating 472 clusters for 1537 data should be successful. Even if unsuccessful, it should produce a clearer indication of error, instead of an unknown error.

Are there known steps to reproduce?

the following two files can be used to reproduce the bug. run lancedb_bug_trigger.py to reproduce.

lancedb_bug_trigger.py
lancedb_trigger_data.py

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions