You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "gnailJC (via GitHub)" <gi...@apache.org> on 2024/08/16 06:13:18 UTC
[I] [Bug] java.lang.ClassCastException: org.apache.paimon.spark.SparkInternalRow cannot be cast to org.apache.spark.sql.catalyst.expressions.UnsafeRow [paimon]
gnailJC opened a new issue, #3977:
URL: https://github.com/apache/paimon/issues/3977
### Search before asking
- [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.
### Paimon version
0.7
### Compute Engine
spark 3.1.2 - 2.12
### Minimal reproduce step
`24/08/16 10:58:18 WARN TaskSetManager: Lost task 4.0 in stage 6.0 (TID 584) (emr-worker-41874.cluster-215453 executor 10): java.lang.ClassCastException: org.apache.paimon.spark.SparkInternalRow cannot be cast to org.apache.spark.sql.catalyst.expressions.UnsafeRow
at org.apache.spark.sql.execution.UnsafeRowSerializerInstance$$anon$1.writeValue(UnsafeRowSerializer.scala:64)
at org.apache.spark.storage.DiskBlockObjectWriter.write(DiskBlockObjectWriter.scala:249)
at org.apache.spark.shuffle.sort.BypassMergeSortShuffleWriter.write(BypassMergeSortShuffleWriter.java:158)
at org.apache.spark.shuffle.ShuffleWriteProcessor.write(ShuffleWriteProcessor.scala:59)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:52)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
24/08/16 10:58:20 WARN TaskSetManager: Lost task 21.0 in stage 6.0 (TID 601) (emr-worker-41874.cluster-215453 executor 10): java.lang.ClassCastException
`
### What doesn't meet your expectations?
-
### Anything else?
_No response_
### Are you willing to submit a PR?
- [ ] I'm willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] java.lang.ClassCastException: org.apache.paimon.spark.SparkInternalRow cannot be cast to org.apache.spark.sql.catalyst.expressions.UnsafeRow [paimon]
Posted by "Zouxxyy (via GitHub)" <gi...@apache.org>.
Zouxxyy commented on issue #3977:
URL: https://github.com/apache/paimon/issues/3977#issuecomment-2299246477
Can you try to use the latest 0.8.2, or provide the steps to reproduce the problem~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org