You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "andygrove (via GitHub)" <gi...@apache.org> on 2025/01/20 16:34:39 UTC
[I] SparkToColumnar class cast exception when reading structs [datafusion-comet]
andygrove opened a new issue, #1314:
URL: https://github.com/apache/datafusion-comet/issues/1314
### Describe the bug
See the following test added to `CometArrayExpressionSuite` in https://github.com/apache/datafusion-comet/pull/1308
```
test("array_remove - test all types (convert from Parquet)")
```
The test fails when trying to create an array of structs and then pass that array into array_remove.
```
java.lang.ClassCastException: class org.apache.spark.sql.vectorized.ColumnarBatch cannot be cast to class org.apache.spark.sql.catalyst.InternalRow
```
I added a workaround to skip testing with structs until this issue is resolved.
### Steps to reproduce
_No response_
### Expected behavior
_No response_
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] ColumnarBatch cannot be cast to class InternalRow [datafusion-comet]
Posted by "andygrove (via GitHub)" <gi...@apache.org>.
andygrove closed issue #1314: ColumnarBatch cannot be cast to class InternalRow
URL: https://github.com/apache/datafusion-comet/issues/1314
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org