Skip to content

Implement GA release of replication ops #1708

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
tsmith023 merged 34 commits into from
Jul 9, 2025
Merged

Implement GA release of replication ops #1708

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
7562dc7
Implement `client.replication` namespace for all replicate ops
tsmith023 May 15, 2025
6530382
Remove default kwargs from executor
tsmith023 May 16, 2025
a8f83f3
Remove `TypedDict` classes mapping to API responses
tsmith023 May 16, 2025
dddfc57
Add include history true default to list all method
tsmith023 May 27, 2025
3289507
Add `shard` option to `cluster.nodes()` method
tsmith023 May 28, 2025
21fc463
Allow `query_sharding_state` to return `None` if collection/shard doe…
tsmith023 May 28, 2025
117064c
Fix stubs for `list_all()` and `query()`
tsmith023 Jun 5, 2025
9a26c20
Fix `resp_rest` in `tenants.get_by_name`
tsmith023 Jun 5, 2025
4e75612
Simplify `cluster.nodes()` output types
tsmith023 Jun 6, 2025
2a92525
Add RBAC permissions for replicate operations
tsmith023 Jun 26, 2025
546344d
Merge branch 'dev/1.31' of https://github.com/weaviate/weaviate-pytho…
tsmith023 Jun 26, 2025
1a28d79
Merge branch 'dev/1.31' of https://github.com/weaviate/weaviate-pytho…
tsmith023 Jun 26, 2025
3965e8d
Run `stubs_regen.sh`
tsmith023 Jun 26, 2025
61ff89c
Add `REPLICA_MOVEMENT_ENABLED: 'true'` to env var in ci
tsmith023 Jun 26, 2025
e763346
Skip replicate tests in <1.31.0
tsmith023 Jun 26, 2025
c4f0585
Move all replicate ops under the cluster namespace
tsmith023 Jun 26, 2025
218dfd3
Skip replicate tests in <1.31.0
tsmith023 Jun 26, 2025
5150471
Merge branch '1.31/add-support-for-replicate-operations' of https://g…
tsmith023 Jun 26, 2025
1312548
Only test RBAC replicate with >1.31.0
tsmith023 Jun 26, 2025
29b3b44
Merge branch '1.31/add-support-for-replicate-operations' of https://g…
tsmith023 Jun 26, 2025
c01272c
Ensure no test collisions using xdist and cleanup of repl ops
tsmith023 Jun 26, 2025
f93aa7f
Update to use latest API on `stable/v1.32` and forbid tests in <1.32.0
tsmith023 Jun 27, 2025
e2ab641
Merge branch 'dev/1.32' of https://github.com/weaviate/weaviate-pytho…
tsmith023 Jun 27, 2025
3294d64
Make types for `ReplicateOperation` with/without history
tsmith023 Jun 30, 2025
417fcda
Add missing `ReplicateOperations` to `weaviate.outputs`
tsmith023 Jun 30, 2025
9611083
Ensure list is always returned for `status.errors`
tsmith023 Jun 30, 2025
72e3c0d
Add `ShardingState` and `ShardReplicas` to `weaviate.outputs`
tsmith023 Jun 30, 2025
6b16fba
Fix name of `targetNode` param in query by target node
tsmith023 Jul 1, 2025
0dbcb14
Merge branch 'dev/1.32' into 1.31/move-replication-under-cluster
dirkkul Jul 4, 2025
ce03ddc
Merge branch 'dev/1.32' of https://github.com/weaviate/weaviate-pytho…
tsmith023 Jul 9, 2025
adf161c
Merge branch '1.31/move-replication-under-cluster' of https://github.…
tsmith023 Jul 9, 2025
2f06250
Fix test
tsmith023 Jul 9, 2025
785f087
Remove duplicated test
tsmith023 Jul 9, 2025
01fdfa5
Remove missed docstring from `WeaviateAsyncClient`
tsmith023 Jul 9, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
26 changes: 13 additions & 13 deletions .github/workflows/main.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,9 +22,9 @@ env:
WEAVIATE_126: 1.26.17
WEAVIATE_127: 1.27.14
WEAVIATE_128: 1.28.8
WEAVIATE_129: 1.29.1
WEAVIATE_130: 1.30.1
WEAVIATE_131: stable-v1.31-81f8efb
WEAVIATE_129: 1.29.8
WEAVIATE_130: 1.30.9
WEAVIATE_131: 1.31.5
WEAVIATE_132: 1.32.0-rc.0-6eb89d6.amd64

jobs:
Expand Down Expand Up @@ -133,11 +133,11 @@ jobs:
fail-fast: false
matrix:
versions: [
{ py: "3.9", weaviate: $WEAVIATE_130},
{ py: "3.10", weaviate: $WEAVIATE_130},
{ py: "3.11", weaviate: $WEAVIATE_130},
{ py: "3.12", weaviate: $WEAVIATE_130},
{ py: "3.13", weaviate: $WEAVIATE_130}
{ py: "3.9", weaviate: $WEAVIATE_131},
{ py: "3.10", weaviate: $WEAVIATE_131},
{ py: "3.11", weaviate: $WEAVIATE_131},
{ py: "3.12", weaviate: $WEAVIATE_131},
{ py: "3.13", weaviate: $WEAVIATE_131}
]
optional_dependencies: [false]
steps:
Expand Down Expand Up @@ -188,11 +188,11 @@ jobs:
fail-fast: false
matrix:
versions: [
{ py: "3.9", weaviate: $WEAVIATE_129},
{ py: "3.10", weaviate: $WEAVIATE_129},
{ py: "3.11", weaviate: $WEAVIATE_129},
{ py: "3.12", weaviate: $WEAVIATE_129},
{ py: "3.13", weaviate: $WEAVIATE_129}
{ py: "3.9", weaviate: $WEAVIATE_131},
{ py: "3.10", weaviate: $WEAVIATE_131},
{ py: "3.11", weaviate: $WEAVIATE_131},
{ py: "3.12", weaviate: $WEAVIATE_131},
{ py: "3.13", weaviate: $WEAVIATE_131}
]
optional_dependencies: [false]
steps:
Expand Down
3 changes: 3 additions & 0 deletions ci/docker-compose-cluster.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,7 @@ services:
DEFAULT_VECTORIZER_MODULE: text2vec-contextionary
ENABLE_MODULES: text2vec-contextionary
AUTOSCHEMA_ENABLED: 'false'
REPLICA_MOVEMENT_ENABLED: 'true'

weaviate-node-2:
init: true
Expand Down Expand Up @@ -56,6 +57,7 @@ services:
DEFAULT_VECTORIZER_MODULE: text2vec-contextionary
ENABLE_MODULES: text2vec-contextionary
AUTOSCHEMA_ENABLED: 'false'
REPLICA_MOVEMENT_ENABLED: 'true'

weaviate-node-3:
init: true
Expand Down Expand Up @@ -89,4 +91,5 @@ services:
DEFAULT_VECTORIZER_MODULE: text2vec-contextionary
ENABLE_MODULES: text2vec-contextionary
AUTOSCHEMA_ENABLED: 'false'
REPLICA_MOVEMENT_ENABLED: 'true'
...
53 changes: 53 additions & 0 deletions integration/test_rbac.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@
DataPermissionOutput,
NodesPermissionOutput,
Role,
ReplicatePermissionOutput,
RolesPermissionOutput,
TenantsPermissionOutput,
UsersPermissionOutput,
Expand Down Expand Up @@ -43,6 +44,7 @@
],
nodes_permissions=[],
tenants_permissions=[],
replicate_permissions=[],
),
None,
),
Expand All @@ -59,6 +61,7 @@
backups_permissions=[],
nodes_permissions=[],
tenants_permissions=[],
replicate_permissions=[],
),
None,
),
Expand All @@ -79,6 +82,7 @@
backups_permissions=[],
nodes_permissions=[],
tenants_permissions=[],
replicate_permissions=[],
),
None,
),
Expand All @@ -97,6 +101,7 @@
backups_permissions=[],
nodes_permissions=[],
tenants_permissions=[],
replicate_permissions=[],
),
None,
),
Expand Down Expand Up @@ -128,6 +133,7 @@
backups_permissions=[],
nodes_permissions=[],
tenants_permissions=[],
replicate_permissions=[],
),
None,
),
Expand All @@ -148,6 +154,7 @@
)
],
tenants_permissions=[],
replicate_permissions=[],
),
None,
),
Expand All @@ -168,6 +175,7 @@
)
],
tenants_permissions=[],
replicate_permissions=[],
),
None,
),
Expand All @@ -188,6 +196,7 @@
backups_permissions=[],
nodes_permissions=[],
tenants_permissions=[],
replicate_permissions=[],
),
None,
),
Expand All @@ -210,6 +219,7 @@
actions={Actions.Tenants.READ, Actions.Tenants.UPDATE},
)
],
replicate_permissions=[],
),
None,
),
Expand Down Expand Up @@ -249,6 +259,7 @@
actions={Actions.Tenants.READ, Actions.Tenants.UPDATE},
),
],
replicate_permissions=[],
),
None,
),
Expand All @@ -269,9 +280,50 @@
backups_permissions=[],
nodes_permissions=[],
tenants_permissions=[],
replicate_permissions=[],
),
None,
),
(
Permissions.replicate(
collection=["ColA", "ColB"], shard=["tenant1", "tenant2"], read=True, update=True
),
Role(
name="Replicate",
cluster_permissions=[],
alias_permissions=[],
users_permissions=[],
collections_permissions=[],
roles_permissions=[],
data_permissions=[],
backups_permissions=[],
nodes_permissions=[],
tenants_permissions=[],
replicate_permissions=[
ReplicatePermissionOutput(
collection="ColA",
shard="tenant1",
actions={Actions.Replicate.READ, Actions.Replicate.UPDATE},
),
ReplicatePermissionOutput(
collection="ColA",
shard="tenant2",
actions={Actions.Replicate.READ, Actions.Replicate.UPDATE},
),
ReplicatePermissionOutput(
collection="ColB",
shard="tenant1",
actions={Actions.Replicate.READ, Actions.Replicate.UPDATE},
),
ReplicatePermissionOutput(
collection="ColB",
shard="tenant2",
actions={Actions.Replicate.READ, Actions.Replicate.UPDATE},
),
],
),
32,
),
(
Permissions.alias(alias="*", read=True, delete=True),
Role(
Expand All @@ -289,6 +341,7 @@
backups_permissions=[],
nodes_permissions=[],
tenants_permissions=[],
replicate_permissions=[],
),
32, # Minimum version for alias permissions
),
Expand Down
Loading
Loading