You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by "Yin, Fangxi (Pierre)" <Fa...@dynatrace.com> on 2014/12/25 04:31:22 UTC

java.lang.ClassCastException: com.esotericsoftware.kryo.Kryo cannot be cast to org.apache.hive.com.esotericsoftware.kryo.Kryo

I build hive with hive-spark trunk .
Then I switch hive execution engine to spark.

set spark.home=/home/realityload/spark-1.2.0-SNAPSHOT;
set hive.execution.engine=spark;
set spark.master=yarn-client;
set spark.eventLog.enabled=true;
set spark.executor.memory=1g;
set spark.serializer=org.apache.spark.serializer.KryoSerializer;

When I execute query, I found the following exception:

2014-12-25 03:18:09,880 INFO  [stderr-redir-1]: client.SparkClientImpl (SparkClientImpl.java:run(435)) - java.lang.ClassCastException: com.esotericsoftware.kryo.Kryo cannot be cast to org.apache.hive.com.esotericsoftware.kryo.Kryo
2014-12-25 03:18:09,880 INFO  [stderr-redir-1]: client.SparkClientImpl (SparkClientImpl.java:run(435)) -        at org.apache.hadoop.hive.ql.exec.spark.KryoSerializer.deserialize(KryoSerializer.java:51)
2014-12-25 03:18:09,880 INFO  [stderr-redir-1]: client.SparkClientImpl (SparkClientImpl.java:run(435)) -        at org.apache.hadoop.hive.ql.exec.spark.RemoteHiveSparkClient$JobStatusJob.call(RemoteHiveSparkClient.java:199)
2014-12-25 03:18:09,880 INFO  [stderr-redir-1]: client.SparkClientImpl (SparkClientImpl.java:run(435)) -        at org.apache.hive.spark.client.RemoteDriver$JobWrapper.call(RemoteDriver.java:289)
2014-12-25 03:18:09,880 INFO  [stderr-redir-1]: client.SparkClientImpl (SparkClientImpl.java:run(435)) -        at org.apache.hive.spark.client.RemoteDriver$JobWrapper.call(RemoteDriver.java:263)
2014-12-25 03:18:09,880 INFO  [stderr-redir-1]: client.SparkClientImpl (SparkClientImpl.java:run(435)) -        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
2014-12-25 03:18:09,880 INFO  [stderr-redir-1]: client.SparkClientImpl (SparkClientImpl.java:run(435)) -        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
2014-12-25 03:18:09,880 INFO  [stderr-redir-1]: client.SparkClientImpl (SparkClientImpl.java:run(435)) -        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
2014-12-25 03:18:09,881 INFO  [stderr-redir-1]: client.SparkClientImpl (SparkClientImpl.java:run(435)) -        at java.lang.Thread.run(Thread.java:745)
2014-12-25 03:18:09,883 INFO  [RPC-Handler-3]: client.SparkClientImpl (SparkClientImpl.java:handle(397)) - Received result for 2cc1b6cf-24d9-4aab-b8b6-d2af283c93f9

So how to fix it ?
The contents of this e-mail are intended for the named addressee only. It contains information that may be confidential. Unless you are the named addressee or an authorized designee, you may not copy or use it, or disclose it to anyone else. If you received it in error please notify us immediately and then destroy it.