[jira] [Work stopped] (TAJO-8) MapReduce's ShuffleHandler and Tajo's PullServerAuxService conflict each other

["Jinho Kim (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/TAJO-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on TAJO-8 stopped by Jinho Kim.

> MapReduce's ShuffleHandler and Tajo's PullServerAuxService conflict each other
> ------------------------------------------------------------------------------
>
>                 Key: TAJO-8
>                 URL: https://issues.apache.org/jira/browse/TAJO-8
>             Project: Tajo
>          Issue Type: Bug
>          Components: repartitioning
>            Reporter: Hyunsik Choi
>            Assignee: Jinho Kim
>            Priority: Minor
>              Labels: newbie
>         Attachments: TAJO-8.patch
>
>
> PullServerAuxService was implemented from some parts of MR's ShuffleHandler. Its metrics id seems to conflict each other. So, both AuxiliaryServices cannot work at the same time. When you start nodemanagers of Yarn with both AuxiliaryServices, you will see the following errors in nodemanagers' logs.
> {noformat}
> 2013-03-05 19:44:53,213 FATAL org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting NodeManager
> java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
>         at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:128)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices.init(AuxServices.java:96)
>         at org.apache.hadoop.yarn.service.CompositeService.init(CompositeService.java:58)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.init(ContainerManagerImpl.java:179)
>         at org.apache.hadoop.yarn.service.CompositeService.init(CompositeService.java:58)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.init(NodeManager.java:165)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:274)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:291)
> Caused by: java.lang.reflect.InvocationTargetException
>         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>         at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>         at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>         at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
>         at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:126)
>         ... 7 more
> Caused by: org.apache.hadoop.metrics2.MetricsException: Metrics source ShuffleMetrics already exists!
>         at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:126)
>         at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:107)
>         at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:217)
>         at org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:54)
>         at tajo.pullserver.PullServerAuxService.<init>(PullServerAuxService.java:152)
>         at tajo.pullserver.PullServerAuxService.<init>(PullServerAuxService.java:157)
>         ... 12 more
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira