Skip to content

Merge upstream master#16

Merged
JoanFM merged 86 commits intomasterfrom
merge-upstream-master
Dec 15, 2021
Merged

Merge upstream master#16
JoanFM merged 86 commits intomasterfrom
merge-upstream-master

Conversation

@JoanFM
Copy link
Copy Markdown

@JoanFM JoanFM commented Dec 15, 2021

All Submissions:

  • Have you followed the guidelines in our Contributing document?
  • Have you checked to ensure there aren't other open Pull Requests for the same update/change?

New Feature Submissions:

  1. Does your submission pass tests?
  2. Have you lint your code locally prior to submission?

Changes to Core Features:

  • Have you added an explanation of what your changes do and why you'd like us to include them?
  • Have you written new tests for your core changes, as applicable?
  • Have you successfully ran tests with your changes locally?

generall and others added 30 commits June 6, 2021 22:20
* update tokio in collection crate qdrant#18

* update tokio in main and storage crates qdrant#18
* WIP: filtered points iterator qdrant#38

* add paginated filtered point request function qdrant#38

* add scroll api + openapi definitions qdrant#38

* fix openapi qdrant#38
* docs: update README.md [skip ci]

* docs: update .all-contributorsrc [skip ci]

Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com>
* docs: update README.md [skip ci]

* docs: update .all-contributorsrc [skip ci]

Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com>
* Apply cargo fmt command

* Enabled cargo fmt on build
* Replace File::write to write_all to ensure the whole vector is written

* [CLIPPY] Replace option_env! with env!
* Avoid vector copy during scoring

* Fixing ptr_arg clippy rules for &[VectorElementType]
* [CLIPPY] Fixed the warning for references of the user defined types

* [CLIPPY] Fix module naming issue

* [CLIPPY] Fix the last set of warnings and enable clippy check during CI

* Moved cargo fmt and cargo clippy into it's own action
* Updated actix to 4.0.0-beta.8

* Refactored search, scroll, update and collection operation APIs to be async
generall and others added 29 commits October 24, 2021 18:10
* update segment version after completed update only

* more stable updates: check pre-existing points on update, fail recovery, WAL proper ack. check_unprocessed_points WIP

* switch to async channel

* perform update operations in a separate thread (qdrant#111)

* perform update operations in a separate thread

* ordered sending update signal

* locate a segment merging versioning bug

* rename id_mapper -> id_tracker

* per-record versioning

* clippy fixes

* cargo fmt

* rm limit of open files

* fail recovery test

* cargo fmt

* wait for worker stops befor dropping the runtime
* docs: update README.md [skip ci]

* docs: update .all-contributorsrc [skip ci]

Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com>
* - update rust version in Dockerfile
- use rust edition 2021

* - update rust edition for libs

* remove *.lock from gitignore
* docs: update README.md [skip ci]

* docs: update .all-contributorsrc [skip ci]

Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com>
* upd API description in OpenAPI qdrant#37

* upd openapi
* extend comments for strorage crate

* update comments and readme for collection crate

* apply cargo fmt

* fix tests

* apply fmt
* add comments for segment entitites

* fmt

* cargo fmt
* run optimizers on tokio thread pool for cpu-bound tasks

* [WIP] move check condition to another thread

* [WIP] optimizer iter live not long enough

* [WIP] change Box to Arc in optimizers vector

* add blocking handles management

* cargo fmt apply

* Update lib/collection/src/update_handler.rs

Co-authored-by: Andrey Vasnetsov <[email protected]>

* [WIP] optimizer iter live not long enough

* [WIP] change Box to Arc in optimizers vector

* add blocking handles management

* fix code review issues

* use CollectionConfig available cpu value

* apply updated fmt

* [WIP] move count of optimization threads to OptimizersConfig

* optimization options

* fix formatting

* fix proto for optimizer config

* fmt

* Update config/config.yaml

related task: qdrant#30

Co-authored-by: Andrey Vasnetsov <[email protected]>
* [GRPC] Expose upsert points API

* refactor PointSruct: use map instead of list + grpc tests

Co-authored-by: Andrey Vasnetsov <[email protected]>
* split storage operation structures qdrant#32

* cargo fmt qdrant#32

* split collection update api into several endpoints qdrant#32

* cargo fmt qdrant#32

* fix tonic-related code with new structures

* upd alias structures

* use ytt teplate engine for OpenAPI Endpoint schema generation
* refactor: replace parking_lot with tokio mutex for WAL

* cargo fmt
* docs: update README.md [skip ci]

* docs: update .all-contributorsrc [skip ci]

Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com>
* wip

* use tokio signals and serve_with_shutdown

* keep it simple
@JoanFM JoanFM merged commit 5d7badd into master Dec 15, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.