Skip to content

feat: support spark csc - #18642

Merged
Jefffrey merged 3 commits into
apache:mainfrom
psvri:feat_spark_sec
Nov 15, 2025
Merged

Jefffrey merged 3 commits into
apache:mainfrom
psvri:feat_spark_sec

Conversation

@psvri

@psvri psvri commented Nov 12, 2025

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Partially implements apache/datafusion-spark#5

Rationale for this change

Spark has support for cosecant https://spark.apache.org/docs/latest/api/sql/index.html#csc .

This function is not there othere in DB's like postgres, mysql and sqlite3. Hence I have added this function into datafusion-spark

What changes are included in this PR?

Adds support for cosecant in datafusion-spark

Are these changes tested?

Unit tests with inputs/outputs obtained from spark

Are there any user-facing changes?

Yes

@github-actions github-actions Bot added sqllogictest SQL Logic Tests (.slt) spark Changes to datafusion-spark crate labels Nov 12, 2025
@Jefffrey
Jefffrey added this pull request to the merge queue Nov 15, 2025
Merged via the queue into apache:main with commit 729bf26 Nov 15, 2025
@Jefffrey

Copy link
Copy Markdown
Contributor

Thanks @psvri & @martin-g

@psvri
psvri deleted the feat_spark_sec branch November 15, 2025 04:43
jizezhang pushed a commit to jizezhang/datafusion that referenced this pull request Nov 15, 2025
## Which issue does this PR close?

Partially implements #15914 

## Rationale for this change

Spark has support for cosecant
https://spark.apache.org/docs/latest/api/sql/index.html#csc .

This function is not there othere in DB's like postgres, mysql and
sqlite3. Hence I have added this function into datafusion-spark


## What changes are included in this PR?

Adds support for cosecant in datafusion-spark 


## Are these changes tested?

Unit tests with inputs/outputs obtained from spark

## Are there any user-facing changes?

Yes
logan-keede pushed a commit to logan-keede/datafusion that referenced this pull request Nov 23, 2025
## Which issue does this PR close?

Partially implements #15914 

## Rationale for this change

Spark has support for cosecant
https://spark.apache.org/docs/latest/api/sql/index.html#csc .

This function is not there othere in DB's like postgres, mysql and
sqlite3. Hence I have added this function into datafusion-spark


## What changes are included in this PR?

Adds support for cosecant in datafusion-spark 


## Are these changes tested?

Unit tests with inputs/outputs obtained from spark

## Are there any user-facing changes?

Yes
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

spark Changes to datafusion-spark crate sqllogictest SQL Logic Tests (.slt)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants