Repository navigation
Native engine crashes on literal sha2() with 'Unsupported argument types' #3340
Description
Description
When Spark's ConstantFolding optimizer rule is disabled, an all-literal sha2() call reaches the native engine, which crashes with:
Unsupported argument types for sha2 function
How to Reproduce
SET spark.sql.optimizer.excludedRules=org.apache.spark.sql.catalyst.optimizer.ConstantFolding;
SELECT sha2('test', 256);Expected Behavior
The native engine should handle literal sha2 inputs gracefully — either by computing the correct result or by falling back to Spark.
Reacted by Bhargava Vadlamani
Activity
Add literal argument tests for all SQL file expression tests
0lai0 commentedon Feb 10, 2026
take
0lai0 commentedon Feb 10, 2026
@andygrove I'm not sure should I add sha2.rs in
native/spark-expr/src/hash_funcs/or use fallback to spark.Please let me know which one is better, thanks !
parthchandra commentedon Feb 14, 2026
@0lai0 why not try the native code path first and if that fails, fallback to spark.
0lai0 commentedon Feb 17, 2026
Thanks @parthchandra for the feedback. I'll incorporate these suggestions into the update. Thank you!