You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "andygrove (via GitHub)" <gi...@apache.org> on 2026/01/29 22:04:17 UTC
[I] Native engine crashes on literal sha2() with 'Unsupported argument types' [datafusion-comet]
andygrove opened a new issue, #3340:
URL: https://github.com/apache/datafusion-comet/issues/3340
## Description
When Spark's `ConstantFolding` optimizer rule is disabled, an all-literal `sha2()` call reaches the native engine, which crashes with:
```
Unsupported argument types for sha2 function
```
## How to Reproduce
```sql
SET spark.sql.optimizer.excludedRules=org.apache.spark.sql.catalyst.optimizer.ConstantFolding;
SELECT sha2('test', 256);
```
## Expected Behavior
The native engine should handle literal sha2 inputs gracefully — either by computing the correct result or by falling back to Spark.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Native engine crashes on literal sha2() with 'Unsupported argument types' [datafusion-comet]
Posted by "0lai0 (via GitHub)" <gi...@apache.org>.
0lai0 commented on issue #3340:
URL: https://github.com/apache/datafusion-comet/issues/3340#issuecomment-3914860626
Thanks @parthchandra for the feedback. I'll incorporate these suggestions into the update. Thank you!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Native engine crashes on literal sha2() with 'Unsupported argument types' [datafusion-comet]
Posted by "parthchandra (via GitHub)" <gi...@apache.org>.
parthchandra commented on issue #3340:
URL: https://github.com/apache/datafusion-comet/issues/3340#issuecomment-3901085831
@0lai0 why not try the native code path first and if that fails, fallback to spark.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Native engine crashes on literal sha2() with 'Unsupported argument types' [datafusion-comet]
Posted by "0lai0 (via GitHub)" <gi...@apache.org>.
0lai0 commented on issue #3340:
URL: https://github.com/apache/datafusion-comet/issues/3340#issuecomment-3875443521
take
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Native engine crashes on literal sha2() with 'Unsupported argument types' [datafusion-comet]
Posted by "0lai0 (via GitHub)" <gi...@apache.org>.
0lai0 commented on issue #3340:
URL: https://github.com/apache/datafusion-comet/issues/3340#issuecomment-3875815722
@andygrove I'm not sure should I add sha2.rs in `native/spark-expr/src/hash_funcs/` or use fallback to spark.
Please let me know which one is better, thanks !
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Native engine crashes on literal sha2() with 'Unsupported argument types' [datafusion-comet]
Posted by "mbutrovich (via GitHub)" <gi...@apache.org>.
mbutrovich closed issue #3340: Native engine crashes on literal sha2() with 'Unsupported argument types'
URL: https://github.com/apache/datafusion-comet/issues/3340
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org