[jira] [Created] (TAJO-8) MapReduce's ShuffleHandler and Tajo's PullServerAuxService conflict each other

["Hyunsik Choi (JIRA)" <ji...@apache.org>]

Hyunsik Choi created TAJO-8:
-------------------------------

             Summary: MapReduce's ShuffleHandler and Tajo's PullServerAuxService conflict each other
                 Key: TAJO-8
                 URL: https://issues.apache.org/jira/browse/TAJO-8
             Project: Tajo
          Issue Type: Bug
          Components: pullserver
            Reporter: Hyunsik Choi
            Priority: Minor


PullServerAuxService was implemented from some parts of MR's ShuffleHandler. Its metrics id seems to conflict each other. So, both AuxiliaryServices cannot work at the same time. When you start nodemanagers of Yarn with both AuxiliaryServices, you will see the following errors in nodemanagers' logs.

{noformat}
2013-03-05 19:44:53,213 FATAL org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting NodeManager
java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
        at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:128)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices.init(AuxServices.java:96)
        at org.apache.hadoop.yarn.service.CompositeService.init(CompositeService.java:58)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.init(ContainerManagerImpl.java:179)
        at org.apache.hadoop.yarn.service.CompositeService.init(CompositeService.java:58)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.init(NodeManager.java:165)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:274)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:291)
Caused by: java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
        at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:126)
        ... 7 more
Caused by: org.apache.hadoop.metrics2.MetricsException: Metrics source ShuffleMetrics already exists!
        at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:126)
        at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:107)
        at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:217)
        at org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:54)
        at tajo.pullserver.PullServerAuxService.<init>(PullServerAuxService.java:152)
        at tajo.pullserver.PullServerAuxService.<init>(PullServerAuxService.java:157)
        ... 12 more
{noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira