You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by sara mustafa <en...@gmail.com> on 2015/12/28 21:04:16 UTC
Catalyst Class Cast Exception
Hi,
I am trying to run a sql query from TPC-H query samples using DataFrame, but
it throw this exception
java.lang.ClassCastException:
org.apache.spark.sql.catalyst.expressions.GenericInternalRow cannot be cast
to org.apache.spark.sql.catalyst.expressions.UnsafeRow
at
org.apache.spark.sql.execution.UnsafeRowSerializerInstance$$anon$2.writeValue(UnsafeRowSerializer.scala:61)
at
org.apache.spark.storage.DiskBlockObjectWriter.write(DiskBlockObjectWriter.scala:181)
at
org.apache.spark.shuffle.sort.BypassMergeSortShuffleWriter.insertAll(BypassMergeSortShuffleWriter.java:121)
at
org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:73)
at
org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:74)
at
org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:42)
at org.apache.spark.scheduler.Task.run(Task.scala:90)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Can anyone help me, please?
--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Catalyst-Class-Cast-Exception-tp15822.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: Catalyst Class Cast Exception
Posted by sara mustafa <en...@gmail.com>.
Not yet, but I will try it.
Thank you.
--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Catalyst-Class-Cast-Exception-tp15822p15826.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: Catalyst Class Cast Exception
Posted by Michael Armbrust <mi...@databricks.com>.
Looks like a bug. Have you tried Spark 1.6 RC4?
http://people.apache.org/~pwendell/spark-releases/spark-1.6.0-rc4-bin/
On Mon, Dec 28, 2015 at 12:17 PM, sara mustafa <en...@gmail.com>
wrote:
> spark 1.5.2
>
>
>
> --
> View this message in context:
> http://apache-spark-developers-list.1001551.n3.nabble.com/Catalyst-Class-Cast-Exception-tp15822p15824.html
> Sent from the Apache Spark Developers List mailing list archive at
> Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>
Re: Catalyst Class Cast Exception
Posted by sara mustafa <en...@gmail.com>.
spark 1.5.2
--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Catalyst-Class-Cast-Exception-tp15822p15824.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: Catalyst Class Cast Exception
Posted by Michael Armbrust <mi...@databricks.com>.
Which version of spark?
On Mon, Dec 28, 2015 at 12:04 PM, sara mustafa <en...@gmail.com>
wrote:
> Hi,
>
> I am trying to run a sql query from TPC-H query samples using DataFrame,
> but
> it throw this exception
>
> java.lang.ClassCastException:
> org.apache.spark.sql.catalyst.expressions.GenericInternalRow cannot be cast
> to org.apache.spark.sql.catalyst.expressions.UnsafeRow
> at
>
> org.apache.spark.sql.execution.UnsafeRowSerializerInstance$$anon$2.writeValue(UnsafeRowSerializer.scala:61)
> at
>
> org.apache.spark.storage.DiskBlockObjectWriter.write(DiskBlockObjectWriter.scala:181)
> at
>
> org.apache.spark.shuffle.sort.BypassMergeSortShuffleWriter.insertAll(BypassMergeSortShuffleWriter.java:121)
> at
>
> org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:73)
> at
> org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:74)
> at
> org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:42)
> at org.apache.spark.scheduler.Task.run(Task.scala:90)
> at
> org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214)
> at
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
>
> Can anyone help me, please?
>
>
>
> --
> View this message in context:
> http://apache-spark-developers-list.1001551.n3.nabble.com/Catalyst-Class-Cast-Exception-tp15822.html
> Sent from the Apache Spark Developers List mailing list archive at
> Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>