Repository navigation
Commit ae66818
fix(build): pin Spark 4.1 to 4.1.1 for delta-spark 4.1.0 compatibility (apache#76 follow-up)
The spark-4.1 profile (and top-level default) pinned spark.version=4.1.2, but
delta-spark 4.1.0 references org.apache.spark.sql.catalyst.plans.logical.IgnoreCachedData,
which Spark removed in 4.1.2. So `-Pspark-4.1,contrib-delta` builds/tests failed at
runtime with NoClassDefFoundError (the contrib-delta CI matrix already labelled the cell
4.1.1, but the build resolved the pom's 4.1.2). Comet itself works on either patch; the
constraint is delta-spark. Pin to 4.1.1 in both spots so CI and local agree and the contrib
suites run. Verified: full contrib package 152/0 with no -Dspark.version override.
Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]>1 parent a4ae76d commit ae66818
1 file changed
Lines changed: 8 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
77 | 77 | | |
78 | 78 | | |
79 | 79 | | |
80 | | - | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
81 | 85 | | |
82 | 86 | | |
83 | 87 | | |
| |||
718 | 722 | | |
719 | 723 | | |
720 | 724 | | |
721 | | - | |
| 725 | + | |
| 726 | + | |
| 727 | + | |
722 | 728 | | |
723 | 729 | | |
724 | 730 | | |
| |||
0 commit comments