Hive 2.3.2 does not execute on Spark engine anymore

[Mich Talebzadeh <mi...@gmail.com>]

Hi,

My previous Hive 2/0 used to work with Spark 1.3.1 as its execution engine.

I recently upgraded Hive to 2.3.2 and it fails to start with spark as its
execution engine as follows:

Launching Job 1 out of 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
  set mapreduce.job.reduces=<number>
Failed to execute spark task, with exception
'org.apache.hadoop.hive.ql.metadata.HiveException(Failed to create spark
client.)'
FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.spark.SparkTask. Failed to create spark
client.
I have looked around and this seems to be an issue.

As a matter of interest has anyone tested if Hive 2.3.2 runs with any
version of Spark engone.

P.S. Not interested about TEZ LLAP at this stage.

Thanks





Dr Mich Talebzadeh



LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*



http://talebzadehmich.wordpress.com


*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.