Skip to content

perf: default the native Iceberg scan to two concurrent data files #9131

perf: default the native Iceberg scan to two concurrent data files

perf: default the native Iceberg scan to two concurrent data files #9131

Triggered via pull request October 20, 2026 10:15
Status Success
Total duration 38m 20s
Artifacts –

ci.yml

on: pull_request
Detect changes
20s
Detect changes
PR Build (Linux)  /  Lint
48s
PR Build (Linux) / Lint
Iceberg Spark SQL Tests (Iceberg 1.10)  /  Build Native Library
Iceberg Spark SQL Tests (Iceberg 1.10) / Build Native Library
Iceberg Spark SQL Tests (Iceberg 1.11)  /  Build Native Library
Iceberg Spark SQL Tests (Iceberg 1.11) / Build Native Library
Iceberg Spark SQL Tests (Iceberg 1.8)  /  Build Native Library
Iceberg Spark SQL Tests (Iceberg 1.8) / Build Native Library
Iceberg Spark SQL Tests (Iceberg 1.9)  /  Build Native Library
Iceberg Spark SQL Tests (Iceberg 1.9) / Build Native Library
Matrix: PyArrow UDF Tests / pyarrow-udf
Waiting for pending jobs
PR Build (macOS)  /  Lint
PR Build (macOS) / Lint
PR Build (Linux)  /  Lint Scala (syntactic)
29s
PR Build (Linux) / Lint Scala (syntactic)
Delta Contrib Build Gate  /  Build-gate verification (default builds exclude Delta)
Delta Contrib Build Gate / Build-gate verification (default builds exclude Delta)
Delta Contrib Tests (Spark 3.5)  /  Delta contrib S3 suite (Spark 3.5, MinIO)
Delta Contrib Tests (Spark 3.5) / Delta contrib S3 suite (Spark 3.5, MinIO)
Delta Contrib Tests (Spark 3.5)  /  Delta dev scripts (Python)
Delta Contrib Tests (Spark 3.5) / Delta dev scripts (Python)
Delta Contrib Tests (Spark 3.5)  /  Feature-off native build
Delta Contrib Tests (Spark 3.5) / Feature-off native build
Delta Contrib Tests (Spark 3.5)  /  contrib-delta
Delta Contrib Tests (Spark 3.5) / contrib-delta
Delta Contrib Tests (Spark 4.0)  /  Delta contrib S3 suite (Spark 3.5, MinIO)
Delta Contrib Tests (Spark 4.0) / Delta contrib S3 suite (Spark 3.5, MinIO)
Delta Contrib Tests (Spark 4.0)  /  Delta dev scripts (Python)
Delta Contrib Tests (Spark 4.0) / Delta dev scripts (Python)
Delta Contrib Tests (Spark 4.0)  /  Feature-off native build
Delta Contrib Tests (Spark 4.0) / Feature-off native build
Delta Contrib Tests (Spark 4.0)  /  contrib-delta
Delta Contrib Tests (Spark 4.0) / contrib-delta
Delta Contrib Tests (Spark 4.1)  /  Delta contrib S3 suite (Spark 3.5, MinIO)
Delta Contrib Tests (Spark 4.1) / Delta contrib S3 suite (Spark 3.5, MinIO)
Delta Contrib Tests (Spark 4.1)  /  Delta dev scripts (Python)
Delta Contrib Tests (Spark 4.1) / Delta dev scripts (Python)
Delta Contrib Tests (Spark 4.1)  /  Feature-off native build
Delta Contrib Tests (Spark 4.1) / Feature-off native build
Delta Contrib Tests (Spark 4.1)  /  contrib-delta
Delta Contrib Tests (Spark 4.1) / contrib-delta
PR Benchmark Check  /  Benchmark Compile & Lint Check
PR Benchmark Check / Benchmark Compile & Lint Check
Spark SQL Tests (Spark 3.4)  /  Build Native + JVM Test Classes
Spark SQL Tests (Spark 3.4) / Build Native + JVM Test Classes
Spark SQL Tests (Spark 3.5)  /  Build Native + JVM Test Classes
Spark SQL Tests (Spark 3.5) / Build Native + JVM Test Classes
Spark SQL Tests (Spark 4.0)  /  Build Native + JVM Test Classes
Spark SQL Tests (Spark 4.0) / Build Native + JVM Test Classes
Spark SQL Tests (Spark 4.1)  /  Build Native + JVM Test Classes
Spark SQL Tests (Spark 4.1) / Build Native + JVM Test Classes
Spark SQL Tests (Spark 4.2)  /  Build Native + JVM Test Classes
Spark SQL Tests (Spark 4.2) / Build Native + JVM Test Classes
Deploy Comet site  /  Build docs
Deploy Comet site / Build docs
PR Build (Linux)  /  Build Native Library
4m 13s
PR Build (Linux) / Build Native Library
Matrix: PR Build (Linux) / celeborn-reflection-compatibility
Matrix: PR Build (Linux) / lint-java
PR Build (Linux)  /  Strict Scala warnings (Spark 3.5, JDK 17)
5m 34s
PR Build (Linux) / Strict Scala warnings (Spark 3.5, JDK 17)
PR Build (Linux)  /  ubuntu-latest/rust-test
20m 56s
PR Build (Linux) / ubuntu-latest/rust-test
Matrix: Iceberg Spark SQL Tests (Iceberg 1.10) / iceberg-spark
Waiting for pending jobs
Iceberg Spark SQL Tests (Iceberg 1.10)  /  iceberg-spark-extensions
Iceberg Spark SQL Tests (Iceberg 1.10) / iceberg-spark-extensions
Iceberg Spark SQL Tests (Iceberg 1.10)  /  iceberg-spark-runtime
Iceberg Spark SQL Tests (Iceberg 1.10) / iceberg-spark-runtime
Matrix: Iceberg Spark SQL Tests (Iceberg 1.11) / iceberg-spark
Waiting for pending jobs
Iceberg Spark SQL Tests (Iceberg 1.11)  /  iceberg-spark-extensions
Iceberg Spark SQL Tests (Iceberg 1.11) / iceberg-spark-extensions
Iceberg Spark SQL Tests (Iceberg 1.11)  /  iceberg-spark-runtime
Iceberg Spark SQL Tests (Iceberg 1.11) / iceberg-spark-runtime
Matrix: Iceberg Spark SQL Tests (Iceberg 1.8) / iceberg-spark
Waiting for pending jobs
Iceberg Spark SQL Tests (Iceberg 1.8)  /  iceberg-spark-extensions
Iceberg Spark SQL Tests (Iceberg 1.8) / iceberg-spark-extensions
Iceberg Spark SQL Tests (Iceberg 1.8)  /  iceberg-spark-runtime
Iceberg Spark SQL Tests (Iceberg 1.8) / iceberg-spark-runtime
Matrix: Iceberg Spark SQL Tests (Iceberg 1.9) / iceberg-spark
Waiting for pending jobs
Iceberg Spark SQL Tests (Iceberg 1.9)  /  iceberg-spark-extensions
Iceberg Spark SQL Tests (Iceberg 1.9) / iceberg-spark-extensions
Iceberg Spark SQL Tests (Iceberg 1.9)  /  iceberg-spark-runtime
Iceberg Spark SQL Tests (Iceberg 1.9) / iceberg-spark-runtime
PR Build (macOS)  /  Build Native Library (macOS)
PR Build (macOS) / Build Native Library (macOS)
Matrix: Spark SQL Tests (Spark 3.4) / spark-sql-test
Waiting for pending jobs
Matrix: Spark SQL Tests (Spark 3.5) / spark-sql-test
Waiting for pending jobs
Matrix: Spark SQL Tests (Spark 4.0) / spark-sql-test
Waiting for pending jobs
Matrix: Spark SQL Tests (Spark 4.1) / spark-sql-test
Waiting for pending jobs
Matrix: Spark SQL Tests (Spark 4.2) / spark-sql-test
Waiting for pending jobs
PR Build (Linux)  /  Verify TPC-H Results
8m 46s
PR Build (Linux) / Verify TPC-H Results
PR Build (Linux)  /  Verify TPC-DS Results
22m 45s
PR Build (Linux) / Verify TPC-DS Results
Matrix: PR Build (Linux) / linux-test
Iceberg Spark SQL Tests (Iceberg 1.10)  /  iceberg-spark-shard-coverage
Iceberg Spark SQL Tests (Iceberg 1.10) / iceberg-spark-shard-coverage
Iceberg Spark SQL Tests (Iceberg 1.11)  /  iceberg-spark-shard-coverage
Iceberg Spark SQL Tests (Iceberg 1.11) / iceberg-spark-shard-coverage
Iceberg Spark SQL Tests (Iceberg 1.8)  /  iceberg-spark-shard-coverage
Iceberg Spark SQL Tests (Iceberg 1.8) / iceberg-spark-shard-coverage
Iceberg Spark SQL Tests (Iceberg 1.9)  /  iceberg-spark-shard-coverage
Iceberg Spark SQL Tests (Iceberg 1.9) / iceberg-spark-shard-coverage
Matrix: PR Build (macOS) / macos-aarch64-test
Waiting for pending jobs
Spark SQL Tests (Spark 3.4)  /  merge-fallback-logs
Spark SQL Tests (Spark 3.4) / merge-fallback-logs
Spark SQL Tests (Spark 3.5)  /  merge-fallback-logs
Spark SQL Tests (Spark 3.5) / merge-fallback-logs
Spark SQL Tests (Spark 4.0)  /  merge-fallback-logs
Spark SQL Tests (Spark 4.0) / merge-fallback-logs
Spark SQL Tests (Spark 4.1)  /  merge-fallback-logs
Spark SQL Tests (Spark 4.1) / merge-fallback-logs
Spark SQL Tests (Spark 4.2)  /  merge-fallback-logs
Spark SQL Tests (Spark 4.2) / merge-fallback-logs
Required Checks
3s
Required Checks
Nightly failure report
0s
Nightly failure report
Fit to window
Zoom out
Zoom in

Annotations

34 warnings
PR Build (Linux) / Celeborn 0.7.0 reflection compatibility
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Celeborn 0.7.0 reflection compatibility
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Celeborn 0.6.0 reflection compatibility
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Celeborn 0.6.0 reflection compatibility
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Build Native Library
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Build Native Library
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Lint Java (Spark 4.1, JDK 17)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Lint Java (Spark 4.1, JDK 17)
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Lint Java (Spark 3.4, JDK 17, Scala 2.12)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Lint Java (Spark 3.4, JDK 17, Scala 2.12)
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Lint Java (Spark 4.0, JDK 21)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Lint Java (Spark 4.0, JDK 21)
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Lint Java (Spark 4.0, JDK 17)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Lint Java (Spark 4.0, JDK 17)
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Lint Java (Spark 3.5, JDK 17, Scala 2.12)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Lint Java (Spark 3.5, JDK 17, Scala 2.12)
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Strict Scala warnings (Spark 3.5, JDK 17)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Strict Scala warnings (Spark 3.5, JDK 17)
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Lint Java (Spark 4.2, JDK 17)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Lint Java (Spark 4.2, JDK 17)
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Verify TPC-H Results
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Verify TPC-H Results
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Spark 4.1, JDK 17 [shuffle]
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Spark 4.1, JDK 17 [shuffle]
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Spark 4.1, JDK 17 [scans]
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Spark 4.1, JDK 17 [scans]
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / ubuntu-latest/rust-test
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/cache/restore@v4, actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / ubuntu-latest/rust-test
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Spark 4.1, JDK 17 [exec]
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Spark 4.1, JDK 17 [exec]
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Verify TPC-DS Results
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Verify TPC-DS Results
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Spark 4.1, JDK 17 [expressions]
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Spark 4.1, JDK 17 [expressions]
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.