Skip to content

Commit 09b6a70

Browse files
groeneaiclaude
andcommitted
Update pyarrow to 26.0.1 in the integration tests runner image
pyarrow before 26 aborts the process when a cast changes a map's key type (string -> large_string) and the keys child carries a validity bitmap, which filter and take produce (apache/arrow#51029, fixed by apache/arrow#51093 in 26.0.0). PyIceberg 0.11.1's upsert makes exactly that cast after a filtered scan, so the data lake fuzzer's pyiceberg_rest writer aborted the whole pytest process on the first nightly Data lake fuzzer (arm_release) run, and the remaining writers never ran. Replaying 5000 pyiceberg_rest fuzzer histories in the runner image without ClickHouse: 53 abort with pyarrow 23.0.1, none with 26.0.1. pip check is clean; test_arrowflight_interface and test_storage_iceberg_no_spark pass identically on both versions. Related: ClickHouse#128538 Co-Authored-By: Claude Opus 5.5 <[email protected]>
1 parent 4f752f7 commit 09b6a70

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

‎ci/docker/integration/runner/requirements.txt‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -66,7 +66,7 @@ psycopg-binary==3.3.3
6666
psycopg2-binary==2.9.11
6767
psycopg==3.3.3
6868
py4j==0.10.9.9
69-
pyarrow==23.0.1
69+
pyarrow==26.0.1
7070
pycparser==2.22
7171
pycryptodome==3.23.0
7272
pydantic==2.12.5

0 commit comments

Comments
 (0)