Skip to content

fix: park the native scan loop instead of busy-polling while waiting on native I/O #5889

fix: park the native scan loop instead of busy-polling while waiting on native I/O

fix: park the native scan loop instead of busy-polling while waiting on native I/O #5889

Triggered via pull request September 25, 2026 14:43
Status Cancelled
Total duration 1h 4m 37s
Artifacts –

ci.yml

on: pull_request
Detect changes
20s
Detect changes
PR Build (Linux)  /  Lint
39s
PR Build (Linux) / Lint
Iceberg Spark SQL Tests (Iceberg 1.10)  /  Build Native Library
Iceberg Spark SQL Tests (Iceberg 1.10) / Build Native Library
Iceberg Spark SQL Tests (Iceberg 1.11)  /  Build Native Library
Iceberg Spark SQL Tests (Iceberg 1.11) / Build Native Library
Iceberg Spark SQL Tests (Iceberg 1.8)  /  Build Native Library
Iceberg Spark SQL Tests (Iceberg 1.8) / Build Native Library
Iceberg Spark SQL Tests (Iceberg 1.9)  /  Build Native Library
Iceberg Spark SQL Tests (Iceberg 1.9) / Build Native Library
Matrix: PyArrow UDF Tests / pyarrow-udf
Waiting for pending jobs
PR Build (macOS)  /  Lint
PR Build (macOS) / Lint
PR Build (Linux)  /  Lint Scala (syntactic)
35s
PR Build (Linux) / Lint Scala (syntactic)
Delta Contrib Build Gate  /  Build-gate verification (default builds exclude Delta)
Delta Contrib Build Gate / Build-gate verification (default builds exclude Delta)
PR Benchmark Check  /  Benchmark Compile & Lint Check
PR Benchmark Check / Benchmark Compile & Lint Check
Spark SQL Tests (Spark 3.4)  /  Build Native + JVM Test Classes
Spark SQL Tests (Spark 3.4) / Build Native + JVM Test Classes
Spark SQL Tests (Spark 3.5)  /  Build Native + JVM Test Classes
Spark SQL Tests (Spark 3.5) / Build Native + JVM Test Classes
Spark SQL Tests (Spark 4.0)  /  Build Native + JVM Test Classes
Spark SQL Tests (Spark 4.0) / Build Native + JVM Test Classes
Spark SQL Tests (Spark 4.1)  /  Build Native + JVM Test Classes
43m 20s
Spark SQL Tests (Spark 4.1) / Build Native + JVM Test Classes
Deploy Comet site  /  Build docs
Deploy Comet site / Build docs
PR Build (Linux)  /  Build Native Library
30m 25s
PR Build (Linux) / Build Native Library
Matrix: PR Build (Linux) / celeborn-reflection-compatibility
Matrix: PR Build (Linux) / lint-java
PR Build (Linux)  /  Build Spark 4.1, JDK 17
4m 33s
PR Build (Linux) / Build Spark 4.1, JDK 17
PR Build (Linux)  /  ubuntu-latest/rust-test
21m 44s
PR Build (Linux) / ubuntu-latest/rust-test
Matrix: Iceberg Spark SQL Tests (Iceberg 1.10) / iceberg-spark
Waiting for pending jobs
Iceberg Spark SQL Tests (Iceberg 1.10)  /  iceberg-spark-extensions
Iceberg Spark SQL Tests (Iceberg 1.10) / iceberg-spark-extensions
Iceberg Spark SQL Tests (Iceberg 1.10)  /  iceberg-spark-runtime
Iceberg Spark SQL Tests (Iceberg 1.10) / iceberg-spark-runtime
Matrix: Iceberg Spark SQL Tests (Iceberg 1.11) / iceberg-spark
Waiting for pending jobs
Iceberg Spark SQL Tests (Iceberg 1.11)  /  iceberg-spark-extensions
Iceberg Spark SQL Tests (Iceberg 1.11) / iceberg-spark-extensions
Iceberg Spark SQL Tests (Iceberg 1.11)  /  iceberg-spark-runtime
Iceberg Spark SQL Tests (Iceberg 1.11) / iceberg-spark-runtime
Matrix: Iceberg Spark SQL Tests (Iceberg 1.8) / iceberg-spark
Waiting for pending jobs
Iceberg Spark SQL Tests (Iceberg 1.8)  /  iceberg-spark-extensions
Iceberg Spark SQL Tests (Iceberg 1.8) / iceberg-spark-extensions
Iceberg Spark SQL Tests (Iceberg 1.8)  /  iceberg-spark-runtime
Iceberg Spark SQL Tests (Iceberg 1.8) / iceberg-spark-runtime
Matrix: Iceberg Spark SQL Tests (Iceberg 1.9) / iceberg-spark
Waiting for pending jobs
Iceberg Spark SQL Tests (Iceberg 1.9)  /  iceberg-spark-extensions
Iceberg Spark SQL Tests (Iceberg 1.9) / iceberg-spark-extensions
Iceberg Spark SQL Tests (Iceberg 1.9)  /  iceberg-spark-runtime
Iceberg Spark SQL Tests (Iceberg 1.9) / iceberg-spark-runtime
PR Build (macOS)  /  Build Native Library (macOS)
PR Build (macOS) / Build Native Library (macOS)
Matrix: Spark SQL Tests (Spark 3.4) / spark-sql-test
Waiting for pending jobs
Matrix: Spark SQL Tests (Spark 3.5) / spark-sql-test
Waiting for pending jobs
Matrix: Spark SQL Tests (Spark 4.0) / spark-sql-test
Waiting for pending jobs
Matrix: Spark SQL Tests (Spark 4.1) / spark-sql-test
PR Build (Linux)  /  Verify TPC-H Results
10m 26s
PR Build (Linux) / Verify TPC-H Results
PR Build (Linux)  /  Verify TPC-DS Results
26m 16s
PR Build (Linux) / Verify TPC-DS Results
Matrix: PR Build (Linux) / linux-test
Iceberg Spark SQL Tests (Iceberg 1.10)  /  iceberg-spark-shard-coverage
Iceberg Spark SQL Tests (Iceberg 1.10) / iceberg-spark-shard-coverage
Iceberg Spark SQL Tests (Iceberg 1.11)  /  iceberg-spark-shard-coverage
Iceberg Spark SQL Tests (Iceberg 1.11) / iceberg-spark-shard-coverage
Iceberg Spark SQL Tests (Iceberg 1.8)  /  iceberg-spark-shard-coverage
Iceberg Spark SQL Tests (Iceberg 1.8) / iceberg-spark-shard-coverage
Iceberg Spark SQL Tests (Iceberg 1.9)  /  iceberg-spark-shard-coverage
Iceberg Spark SQL Tests (Iceberg 1.9) / iceberg-spark-shard-coverage
Matrix: PR Build (macOS) / macos-aarch64-test
Waiting for pending jobs
Spark SQL Tests (Spark 3.4)  /  merge-fallback-logs
Spark SQL Tests (Spark 3.4) / merge-fallback-logs
Spark SQL Tests (Spark 3.5)  /  merge-fallback-logs
Spark SQL Tests (Spark 3.5) / merge-fallback-logs
Spark SQL Tests (Spark 4.0)  /  merge-fallback-logs
Spark SQL Tests (Spark 4.0) / merge-fallback-logs
Spark SQL Tests (Spark 4.1)  /  merge-fallback-logs
0s
Spark SQL Tests (Spark 4.1) / merge-fallback-logs
Required Checks
5s
Required Checks
Nightly failure report
0s
Nightly failure report
Fit to window
Zoom out
Zoom in

Annotations

19 errors and 46 warnings
Spark SQL Tests (Spark 4.1) / spark-sql-sql_core-2/spark-4.1.3-jdk17
Canceling since a higher priority waiting request for apache/datafusion-comet-fix/park-native-scan-loop-Comet CI-pull_request exists
Spark SQL Tests (Spark 4.1) / spark-sql-sql_core-2/spark-4.1.3-jdk17
The operation was canceled.
PR Build (Linux) / Spark 4.1, JDK 17 [expressions]
Canceling since a higher priority waiting request for apache/datafusion-comet-fix/park-native-scan-loop-Comet CI-pull_request exists
PR Build (Linux) / Spark 4.1, JDK 17 [expressions]
The operation was canceled.
Spark SQL Tests (Spark 4.1) / spark-sql-sql_hive-1/spark-4.1.3-jdk17
Canceling since a higher priority waiting request for apache/datafusion-comet-fix/park-native-scan-loop-Comet CI-pull_request exists
Spark SQL Tests (Spark 4.1) / spark-sql-sql_hive-1/spark-4.1.3-jdk17
The operation was canceled.
Spark SQL Tests (Spark 4.1) / spark-sql-sql_core-3/spark-4.1.3-jdk17
Canceling since a higher priority waiting request for apache/datafusion-comet-fix/park-native-scan-loop-Comet CI-pull_request exists
Spark SQL Tests (Spark 4.1) / spark-sql-sql_core-3/spark-4.1.3-jdk17
The operation was canceled.
Spark SQL Tests (Spark 4.1) / spark-sql-sql_hive-2/spark-4.1.3-jdk17
Canceling since a higher priority waiting request for apache/datafusion-comet-fix/park-native-scan-loop-Comet CI-pull_request exists
Spark SQL Tests (Spark 4.1) / spark-sql-sql_hive-2/spark-4.1.3-jdk17
The operation was canceled.
Spark SQL Tests (Spark 4.1) / spark-sql-sql_hive-3/spark-4.1.3-jdk17
Canceling since a higher priority waiting request for apache/datafusion-comet-fix/park-native-scan-loop-Comet CI-pull_request exists
Spark SQL Tests (Spark 4.1) / spark-sql-sql_hive-3/spark-4.1.3-jdk17
The operation was canceled.
Spark SQL Tests (Spark 4.1) / spark-sql-sql_core-1/spark-4.1.3-jdk17
Canceling since a higher priority waiting request for apache/datafusion-comet-fix/park-native-scan-loop-Comet CI-pull_request exists
Spark SQL Tests (Spark 4.1) / spark-sql-sql_core-1/spark-4.1.3-jdk17
The operation was canceled.
Required Checks
Process completed with exit code 1.
Required Checks
One or more upstream jobs did not succeed. See the results above.
Comet CI
Canceling since a higher priority waiting request for apache/datafusion-comet-fix/park-native-scan-loop-Comet CI-pull_request exists
Comet CI
Canceling since a higher priority waiting request for apache/datafusion-comet-fix/park-native-scan-loop-Comet CI-pull_request exists
Comet CI
Canceling since a higher priority waiting request for apache/datafusion-comet-fix/park-native-scan-loop-Comet CI-pull_request exists
PR Build (Linux) / Celeborn 0.7.0 reflection compatibility
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Celeborn 0.7.0 reflection compatibility
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Build Spark 4.1, JDK 17
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Build Spark 4.1, JDK 17
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Celeborn 0.6.0 reflection compatibility
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Celeborn 0.6.0 reflection compatibility
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Lint Java (Spark 4.0, JDK 21)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Lint Java (Spark 4.0, JDK 21)
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Lint Java (Spark 3.4, JDK 17, Scala 2.12)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Lint Java (Spark 3.4, JDK 17, Scala 2.12)
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Lint Java (Spark 4.0, JDK 17)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Lint Java (Spark 4.0, JDK 17)
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Lint Java (Spark 3.5, JDK 17, Scala 2.12)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Lint Java (Spark 3.5, JDK 17, Scala 2.12)
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / ubuntu-latest/rust-test
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/cache/restore@v4, actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / ubuntu-latest/rust-test
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Build Native Library
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Build Native Library
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Verify TPC-H Results
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Verify TPC-H Results
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
Spark SQL Tests (Spark 4.1) / Build Native + JVM Test Classes
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/cache/restore@v4, actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark SQL Tests (Spark 4.1) / Build Native + JVM Test Classes
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Spark 4.1, JDK 17 [shuffle]
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Spark 4.1, JDK 17 [shuffle]
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Spark 4.1, JDK 17 [scans]
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Spark 4.1, JDK 17 [scans]
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Verify TPC-DS Results
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Verify TPC-DS Results
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
Spark SQL Tests (Spark 4.1) / spark-sql-catalyst/spark-4.1.3-jdk17
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/cache/restore@v4, actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark SQL Tests (Spark 4.1) / spark-sql-catalyst/spark-4.1.3-jdk17
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Spark 4.1, JDK 17 [exec]
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Spark 4.1, JDK 17 [exec]
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
Spark SQL Tests (Spark 4.1) / spark-sql-sql_core-2/spark-4.1.3-jdk17
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/cache/restore@v4, actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark SQL Tests (Spark 4.1) / spark-sql-sql_core-2/spark-4.1.3-jdk17
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
PR Build (Linux) / Spark 4.1, JDK 17 [expressions]
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
PR Build (Linux) / Spark 4.1, JDK 17 [expressions]
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
Spark SQL Tests (Spark 4.1) / spark-sql-sql_hive-1/spark-4.1.3-jdk17
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/cache/restore@v4, actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark SQL Tests (Spark 4.1) / spark-sql-sql_hive-1/spark-4.1.3-jdk17
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
Spark SQL Tests (Spark 4.1) / spark-sql-sql_core-3/spark-4.1.3-jdk17
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/cache/restore@v4, actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark SQL Tests (Spark 4.1) / spark-sql-sql_core-3/spark-4.1.3-jdk17
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
Spark SQL Tests (Spark 4.1) / spark-sql-sql_hive-2/spark-4.1.3-jdk17
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/cache/restore@v4, actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark SQL Tests (Spark 4.1) / spark-sql-sql_hive-2/spark-4.1.3-jdk17
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
Spark SQL Tests (Spark 4.1) / spark-sql-sql_hive-3/spark-4.1.3-jdk17
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/cache/restore@v4, actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark SQL Tests (Spark 4.1) / spark-sql-sql_hive-3/spark-4.1.3-jdk17
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.
Spark SQL Tests (Spark 4.1) / spark-sql-sql_core-1/spark-4.1.3-jdk17
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/cache/restore@v4, actions/setup-java@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark SQL Tests (Spark 4.1) / spark-sql-sql_core-1/spark-4.1.3-jdk17
setup-java v4 is deprecated and will no longer receive updates. Please migrate to actions/setup-java@v5.