perf: faster and more balanced clustering

- [ ] balanced clustering: this is needed because if some partitions go much larger than the others, any queries hitting such partitions would be with high tail latency
- [ ] faster clustering for large K (the number of partitions): to limit the size of single partition, we have to be able to train IVF with large K