You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ambari.apache.org by Greg Hill <gr...@RACKSPACE.COM> on 2015/06/10 16:29:46 UTC

oozie + hive broken in Ambari 2.0?

For the life of me, I can't figure out what's going on with this.  We use the example hive job as a test to verify that oozie + hive is working in new versions of HDP that we test.  With HDP 2.2.4 and Ambari 2.0, it keeps failing with this nebulous error:

2015-06-09 19:41:04,705  WARN HiveActionExecutor:546 - SERVER[secondary-1.local] USER[greg7137] GROUP[-] TOKEN[] APP[hive-wf] JOB[0000010-150609171709914-oozie-oozi-W] ACTION[0000010-150609171709914-oozie-oozi-W@hive-node] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.HiveMain], exit code [1]

However, the actual hive job completed successfully.  Nothing else is logged anywhere, not by oozie, not by hive.  I have a feeling it's a classpath issue with the sharelib that is pushed into hdfs by Ambari, but I have to use 'oozie.use.system.libpath=true' for it to even find the Hive JARs at all.  But I think it's also pulling in a conflicting JAR in one of the other folders.

Does anyone have Oozie + Hive working properly with Ambari 2.0/HDP 2.2.4?
Did you have to do anything special?

I can provide more logs if you like, but there's nothing else useful anywhere.  Nothing to indicate what the actual error is.  I cranked every log in the system up to DEBUG and still produced nothing else useful.  No stack trace.  Nothing.  The YARN job completes fine, but oozie thinks it failed.  Switching between Tez and MapReduce has no effect, same error.

Thanks in advance for any suggestions of things to check for.

Greg