Skip to content

Commit 02f89d6

Browse files
authored
docs(spark): update the published version coordinates (#9171)
The README's example coordinates still named `0.78.0`, five releases behind the `0.83.0` currently on Maven Central, so anyone copying the `spark-shell --jars` URL or the dependency snippet pulled a stale JAR. Nothing regenerates these, so they need updating by hand. ## Tests Verified the coordinates resolve: ``` $ curl -sI https://repo1.maven.org/maven2/dev/vortex/vortex-spark_2.13/0.83.0/vortex-spark_2.13-0.83.0-all.jar HTTP 200 ``` `0.83.0` is the current `<release>` in the `maven-metadata.xml` of both `vortex-spark_2.13` and `vortex-spark_2.12`. Signed-off-by: jackylee <[email protected]>
1 parent 795054a commit 02f89d6

1 file changed

Lines changed: 5 additions & 5 deletions

File tree

‎java/vortex-spark/README.md‎

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ Two flavors are published to Maven Central:
1111
| `dev.vortex:vortex-spark_2.13` | Spark 4.x | 2.13 |
1212
| `dev.vortex:vortex-spark_2.12` | Spark 3.5.x | 2.12 |
1313

14-
Use the `all` classifier JAR (e.g. `vortex-spark_2.13-0.78.0-all.jar`). It is self-contained:
14+
Use the `all` classifier JAR (e.g. `vortex-spark_2.13-0.83.0-all.jar`). It is self-contained:
1515
it bundles the Vortex JNI bindings, native libraries for Linux (x86_64 and aarch64) and macOS
1616
(aarch64), and relocates its Arrow, Guava, and Jackson dependencies to avoid classpath
1717
conflicts with Spark. The thin (unclassified) JAR does not work on its own because it
@@ -23,28 +23,28 @@ Pass the `all` JAR to `spark-shell`, `spark-submit`, or `pyspark` with `--jars`.
2323
either a local path or a URL, so you can point directly at Maven Central:
2424

2525
```shell
26-
spark-shell --jars https://repo1.maven.org/maven2/dev/vortex/vortex-spark_2.13/0.78.0/vortex-spark_2.13-0.78.0-all.jar
26+
spark-shell --jars https://repo1.maven.org/maven2/dev/vortex/vortex-spark_2.13/0.83.0/vortex-spark_2.13-0.83.0-all.jar
2727
```
2828

2929
Or configure it on the session builder, e.g. in PySpark:
3030

3131
```python
3232
spark = (
3333
SparkSession.builder
34-
.config("spark.jars", "/path/to/vortex-spark_2.13-0.78.0-all.jar")
34+
.config("spark.jars", "/path/to/vortex-spark_2.13-0.83.0-all.jar")
3535
.getOrCreate()
3636
)
3737
```
3838

39-
Note that `--packages dev.vortex:vortex-spark_2.13:0.78.0` does not work: `--packages` cannot
39+
Note that `--packages dev.vortex:vortex-spark_2.13:0.83.0` does not work: `--packages` cannot
4040
select the `all` classifier and resolves the thin JAR, which fails at runtime with
4141
`NoClassDefFoundError: dev/vortex/relocated/...`.
4242

4343
To depend on the connector from a JVM project instead, add the `all` classifier to the
4444
dependency:
4545

4646
```kotlin
47-
implementation("dev.vortex:vortex-spark_2.13:0.78.0:all")
47+
implementation("dev.vortex:vortex-spark_2.13:0.83.0:all")
4848
```
4949

5050
## Usage

0 commit comments

Comments
 (0)