Repository navigation
[SPARK-60848][TESTS] Regenerate benchmark results after bumping the minimum Java to 21 - #60064
Draft
dongjoon-hyun wants to merge 1 commit into
Draft
dongjoon-hyun wants to merge 1 commit into
dongjoon-hyun wants to merge 1 commit into
Conversation
Member
Author
|
Currently, thesis a draft because the benchmarks are running here in order to make it sure that all data are in sync in terms of the generation time and the expected CPU model (
Please note that I need to re-trigger the subset of test pipelines multiple times because the benchmark run will fail at the startup if the expected CPU model is not |
HyukjinKwon
added
the
ai-review-requested
Collaborator
|
The AI review requested by @HyukjinKwon did not finish. A committer can add the |
spark-test
removed
the
ai-review-requested
dongjoon-hyun
force-pushed
the
SPARK-60848
branch
from
November 6, 2026 06:34
1e578e0 to
4763f3e
Compare
…inimum Java to 21
dongjoon-hyun
force-pushed
the
SPARK-60848
branch
from
November 11, 2026 22:00
ba4de62 to
e6b86b7
Compare
Member
Author
|
Rebase to master to sync with |
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What changes were proposed in this pull request?
This PR aims to regenerate the benchmark results after bumping the minimum Java version to 21 (SPARK-60669).
Why are the changes needed?
After SPARK-60669, Java 21 is the minimum Java version of Apache Spark 5.0.0, and
BenchmarkBaseuses Java 21 as its base (SPARK-60831). The default benchmark results were generated with the previous baseline (Java 17), so they no longer represent the supported minimum Java version. Regenerating them keeps the results consistent with the current baseline and the JDK 25 results.Currently, Apache Spark benchmark CI has been broken like the following. This PR will detect those issues.
HighlyCompressedMapStatusBenchmarkfailure whenmockitois not on the classpath #60160NoClassDefFoundErrorwhen running Kafka benchmarks in the benchmark workflow #60161Does this PR introduce any user-facing change?
No. This PR only updates the benchmark result files.
How was this patch tested?
Manually reviewed. The result files were generated by running the benchmarks in GitHub Actions (JDK 21 and JDK 25, Scala 2.13, split 1-64) according to https://spark.apache.org/developer-tools.html#github-workflow-benchmarks.
Was this patch authored or co-authored using generative AI tooling?
Generated-by: Claude Sonnet 5.5