Repository navigation
Commit 09b6a70
Update pyarrow to 26.0.1 in the integration tests runner image
pyarrow before 26 aborts the process when a cast changes a map's key type
(string -> large_string) and the keys child carries a validity bitmap, which
filter and take produce (apache/arrow#51029, fixed by
apache/arrow#51093 in 26.0.0). PyIceberg 0.11.1's upsert
makes exactly that cast after a filtered scan, so the data lake fuzzer's
pyiceberg_rest writer aborted the whole pytest process on the first nightly
Data lake fuzzer (arm_release) run, and the remaining writers never ran.
Replaying 5000 pyiceberg_rest fuzzer histories in the runner image without
ClickHouse: 53 abort with pyarrow 23.0.1, none with 26.0.1. pip check is clean;
test_arrowflight_interface and test_storage_iceberg_no_spark pass identically on
both versions.
Related: ClickHouse#128538
Co-Authored-By: Claude Opus 5.5 <[email protected]>1 parent 4f752f7 commit 09b6a70
1 file changed
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
66 | 66 | | |
67 | 67 | | |
68 | 68 | | |
69 | | - | |
| 69 | + | |
70 | 70 | | |
71 | 71 | | |
72 | 72 | | |
| |||
0 commit comments