[jira] [Created] (TEZ-3586) Remove fusesource.leveldbjni from the tez-auxservices shaded jar

["Kuhu Shukla (JIRA)" <ji...@apache.org>]

Kuhu Shukla created TEZ-3586:
--------------------------------

             Summary: Remove fusesource.leveldbjni from the tez-auxservices shaded jar
                 Key: TEZ-3586
                 URL: https://issues.apache.org/jira/browse/TEZ-3586
             Project: Apache Tez
          Issue Type: Sub-task
            Reporter: Kuhu Shukla
            Assignee: Kuhu Shukla


If the recovery path is set for the new ShuffleHandler aux-service, the NM fails to instantiate with the following error:
{code}
FATAL nodemanager.NodeManager: Error starting NodeManager
java.lang.UnsatisfiedLinkError: org.apache.tez.shaded.org.fusesource.leveldbjni.internal.NativeOptions.init()V
at org.apache.tez.shaded.org.fusesource.leveldbjni.internal.NativeOptions.init(Native Method)
at org.apache.tez.shaded.org.fusesource.leveldbjni.internal.NativeOptions.<clinit>(NativeOptions.java:54)
at org.apache.tez.shaded.org.fusesource.leveldbjni.JniDBFactory$OptionsResourceHolder.init(JniDBFactory.java:98)
at org.apache.tez.shaded.org.fusesource.leveldbjni.JniDBFactory.open(JniDBFactory.java:167)
at org.apache.tez.auxservices.ShuffleHandler.startStore(ShuffleHandler.java:609)
at org.apache.tez.auxservices.ShuffleHandler.recoverState(ShuffleHandler.java:577)
at org.apache.tez.auxservices.ShuffleHandler.serviceStart(ShuffleHandler.java:510)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices.serviceStart(AuxServices.java:159)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStart(ContainerManagerImpl.java:490)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:369)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:637)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:684)
{code}

This is due to the shaded jar change from TEZ-3390.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)