You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@myriad.apache.org by John Omernik <jo...@omernik.com> on 2015/08/19 00:06:34 UTC

Odd Errors

I am working to stumble through this as Santosh helped me get a pre
incubator version of Myriad running, and now I upgraded a bunch of stuff
and wanted to try some of the more recent features. I setup the remote
distribution, created what I think would be a good a json for marathon and
then I am getting the dreaded Null Pointer Exception without much help...

Based on the logs, it appears to be pulling my URI down with the proper
pathing and trying to execute the resource manager from the tar ball,
perhaps this will get me kicked off the dev list but my dev foo is weak,
thus I am not sure how to troubleshoot this. :) Any help would be
appreciated.


15/08/18 17:00:28 INFO mortbay.log: Started SelectChannelConnector@0.0.0.0:8192
15/08/18 17:00:28 INFO myriad.Main: Initializing HealthChecks
15/08/18 17:00:28 INFO myriad.Main: Initializing Profiles
15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile tiny
with CPU: 1 and Memory: 4096
15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile
small with CPU: 2 and Memory: 8192
15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile
medium with CPU: 4 and Memory: 16384
15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile
large with CPU: 8 and Memory: 32768
15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile huge
with CPU: 12 and Memory: 49152
15/08/18 17:00:28 INFO myriad.Main: Validating nmInstances..
15/08/18 17:00:28 INFO service.AbstractService: Service
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler
failed in state INITED; cause: java.lang.RuntimeException: Failed to
initialize myriad
java.lang.RuntimeException: Failed to initialize myriad
	at com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:35)
	at com.ebay.myriad.scheduler.yarn.interceptor.CompositeInterceptor.init(CompositeInterceptor.java:76)
	at com.ebay.myriad.scheduler.yarn.MyriadFairScheduler.serviceInit(MyriadFairScheduler.java:50)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
	at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:570)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:997)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:262)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1220)
Caused by: java.lang.NullPointerException
	at com.ebay.myriad.Main.validateNMInstances(Main.java:166)
	at com.ebay.myriad.Main.run(Main.java:98)
	at com.ebay.myriad.Main.initialize(Main.java:80)
	at com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:32)
	... 10 more
15/08/18 17:00:28 INFO service.AbstractService: Service
RMActiveServices failed in state INITED; cause:
java.lang.RuntimeException: Failed to initialize myriad
java.lang.RuntimeException: Failed to initialize myriad
	at com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:35)
	at com.ebay.myriad.scheduler.yarn.interceptor.CompositeInterceptor.init(CompositeInterceptor.java:76)
	at com.ebay.myriad.scheduler.yarn.MyriadFairScheduler.serviceInit(MyriadFairScheduler.java:50)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
	at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:570)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:997)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:262)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1220)
Caused by: java.lang.NullPointerException
	at com.ebay.myriad.Main.validateNMInstances(Main.java:166)
	at com.ebay.myriad.Main.run(Main.java:98)
	at com.ebay.myriad.Main.initialize(Main.java:80)
	at com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:32)
	... 10 more
15/08/18 17:00:28 INFO impl.MetricsSystemImpl: Stopping
ResourceManager metrics system...

Re: Odd Errors

Posted by John Omernik <jo...@omernik.com>.
This was 100% the fix, it's running now, thanks everyone. This is all
pretty awesome the way it's working. Thanks again!

On Tue, Aug 18, 2015 at 5:31 PM, Santosh Marella <sm...@maprtech.com>
wrote:

> Okay. Reported the problem in MYRIAD-126.
>
> Santosh
>
> On Tue, Aug 18, 2015 at 3:27 PM, John Omernik <jo...@omernik.com> wrote:
>
> > That's the issue (the yml) I'll merge tomorrow and try it. Thanks Santosh
> > On Aug 18, 2015 5:19 PM, "Santosh Marella" <sm...@maprtech.com>
> wrote:
> >
> > > I think your myriad-config-default.yml is missing a "nmInstances"
> > section.
> > > Are you running it with a older .yml file?
> > >
> > > Santosh
> > >
> > > On Tue, Aug 18, 2015 at 3:06 PM, John Omernik <jo...@omernik.com>
> wrote:
> > >
> > > > I am working to stumble through this as Santosh helped me get a pre
> > > > incubator version of Myriad running, and now I upgraded a bunch of
> > stuff
> > > > and wanted to try some of the more recent features. I setup the
> remote
> > > > distribution, created what I think would be a good a json for
> marathon
> > > and
> > > > then I am getting the dreaded Null Pointer Exception without much
> > help...
> > > >
> > > > Based on the logs, it appears to be pulling my URI down with the
> proper
> > > > pathing and trying to execute the resource manager from the tar ball,
> > > > perhaps this will get me kicked off the dev list but my dev foo is
> > weak,
> > > > thus I am not sure how to troubleshoot this. :) Any help would be
> > > > appreciated.
> > > >
> > > >
> > > > 15/08/18 17:00:28 INFO mortbay.log: Started
> > > > SelectChannelConnector@0.0.0.0:8192
> > > > 15/08/18 17:00:28 INFO myriad.Main: Initializing HealthChecks
> > > > 15/08/18 17:00:28 INFO myriad.Main: Initializing Profiles
> > > > 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile
> tiny
> > > > with CPU: 1 and Memory: 4096
> > > > 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile
> > > > small with CPU: 2 and Memory: 8192
> > > > 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile
> > > > medium with CPU: 4 and Memory: 16384
> > > > 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile
> > > > large with CPU: 8 and Memory: 32768
> > > > 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile
> huge
> > > > with CPU: 12 and Memory: 49152
> > > > 15/08/18 17:00:28 INFO myriad.Main: Validating nmInstances..
> > > > 15/08/18 17:00:28 INFO service.AbstractService: Service
> > > >
> > >
> >
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler
> > > > failed in state INITED; cause: java.lang.RuntimeException: Failed to
> > > > initialize myriad
> > > > java.lang.RuntimeException: Failed to initialize myriad
> > > >         at
> > > >
> > >
> >
> com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:35)
> > > >         at
> > > >
> > >
> >
> com.ebay.myriad.scheduler.yarn.interceptor.CompositeInterceptor.init(CompositeInterceptor.java:76)
> > > >         at
> > > >
> > >
> >
> com.ebay.myriad.scheduler.yarn.MyriadFairScheduler.serviceInit(MyriadFairScheduler.java:50)
> > > >         at
> > > >
> > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> > > >         at
> > > >
> > >
> >
> org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
> > > >         at
> > > >
> > >
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:570)
> > > >         at
> > > >
> > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> > > >         at
> > > >
> > >
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:997)
> > > >         at
> > > >
> > >
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:262)
> > > >         at
> > > >
> > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> > > >         at
> > > >
> > >
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1220)
> > > > Caused by: java.lang.NullPointerException
> > > >         at com.ebay.myriad.Main.validateNMInstances(Main.java:166)
> > > >         at com.ebay.myriad.Main.run(Main.java:98)
> > > >         at com.ebay.myriad.Main.initialize(Main.java:80)
> > > >         at
> > > >
> > >
> >
> com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:32)
> > > >         ... 10 more
> > > > 15/08/18 17:00:28 INFO service.AbstractService: Service
> > > > RMActiveServices failed in state INITED; cause:
> > > > java.lang.RuntimeException: Failed to initialize myriad
> > > > java.lang.RuntimeException: Failed to initialize myriad
> > > >         at
> > > >
> > >
> >
> com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:35)
> > > >         at
> > > >
> > >
> >
> com.ebay.myriad.scheduler.yarn.interceptor.CompositeInterceptor.init(CompositeInterceptor.java:76)
> > > >         at
> > > >
> > >
> >
> com.ebay.myriad.scheduler.yarn.MyriadFairScheduler.serviceInit(MyriadFairScheduler.java:50)
> > > >         at
> > > >
> > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> > > >         at
> > > >
> > >
> >
> org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
> > > >         at
> > > >
> > >
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:570)
> > > >         at
> > > >
> > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> > > >         at
> > > >
> > >
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:997)
> > > >         at
> > > >
> > >
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:262)
> > > >         at
> > > >
> > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> > > >         at
> > > >
> > >
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1220)
> > > > Caused by: java.lang.NullPointerException
> > > >         at com.ebay.myriad.Main.validateNMInstances(Main.java:166)
> > > >         at com.ebay.myriad.Main.run(Main.java:98)
> > > >         at com.ebay.myriad.Main.initialize(Main.java:80)
> > > >         at
> > > >
> > >
> >
> com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:32)
> > > >         ... 10 more
> > > > 15/08/18 17:00:28 INFO impl.MetricsSystemImpl: Stopping
> > > > ResourceManager metrics system...
> > > >
> > >
> >
>

Re: Odd Errors

Posted by Santosh Marella <sm...@maprtech.com>.
Okay. Reported the problem in MYRIAD-126.

Santosh

On Tue, Aug 18, 2015 at 3:27 PM, John Omernik <jo...@omernik.com> wrote:

> That's the issue (the yml) I'll merge tomorrow and try it. Thanks Santosh
> On Aug 18, 2015 5:19 PM, "Santosh Marella" <sm...@maprtech.com> wrote:
>
> > I think your myriad-config-default.yml is missing a "nmInstances"
> section.
> > Are you running it with a older .yml file?
> >
> > Santosh
> >
> > On Tue, Aug 18, 2015 at 3:06 PM, John Omernik <jo...@omernik.com> wrote:
> >
> > > I am working to stumble through this as Santosh helped me get a pre
> > > incubator version of Myriad running, and now I upgraded a bunch of
> stuff
> > > and wanted to try some of the more recent features. I setup the remote
> > > distribution, created what I think would be a good a json for marathon
> > and
> > > then I am getting the dreaded Null Pointer Exception without much
> help...
> > >
> > > Based on the logs, it appears to be pulling my URI down with the proper
> > > pathing and trying to execute the resource manager from the tar ball,
> > > perhaps this will get me kicked off the dev list but my dev foo is
> weak,
> > > thus I am not sure how to troubleshoot this. :) Any help would be
> > > appreciated.
> > >
> > >
> > > 15/08/18 17:00:28 INFO mortbay.log: Started
> > > SelectChannelConnector@0.0.0.0:8192
> > > 15/08/18 17:00:28 INFO myriad.Main: Initializing HealthChecks
> > > 15/08/18 17:00:28 INFO myriad.Main: Initializing Profiles
> > > 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile tiny
> > > with CPU: 1 and Memory: 4096
> > > 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile
> > > small with CPU: 2 and Memory: 8192
> > > 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile
> > > medium with CPU: 4 and Memory: 16384
> > > 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile
> > > large with CPU: 8 and Memory: 32768
> > > 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile huge
> > > with CPU: 12 and Memory: 49152
> > > 15/08/18 17:00:28 INFO myriad.Main: Validating nmInstances..
> > > 15/08/18 17:00:28 INFO service.AbstractService: Service
> > >
> >
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler
> > > failed in state INITED; cause: java.lang.RuntimeException: Failed to
> > > initialize myriad
> > > java.lang.RuntimeException: Failed to initialize myriad
> > >         at
> > >
> >
> com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:35)
> > >         at
> > >
> >
> com.ebay.myriad.scheduler.yarn.interceptor.CompositeInterceptor.init(CompositeInterceptor.java:76)
> > >         at
> > >
> >
> com.ebay.myriad.scheduler.yarn.MyriadFairScheduler.serviceInit(MyriadFairScheduler.java:50)
> > >         at
> > >
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> > >         at
> > >
> >
> org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
> > >         at
> > >
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:570)
> > >         at
> > >
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> > >         at
> > >
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:997)
> > >         at
> > >
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:262)
> > >         at
> > >
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> > >         at
> > >
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1220)
> > > Caused by: java.lang.NullPointerException
> > >         at com.ebay.myriad.Main.validateNMInstances(Main.java:166)
> > >         at com.ebay.myriad.Main.run(Main.java:98)
> > >         at com.ebay.myriad.Main.initialize(Main.java:80)
> > >         at
> > >
> >
> com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:32)
> > >         ... 10 more
> > > 15/08/18 17:00:28 INFO service.AbstractService: Service
> > > RMActiveServices failed in state INITED; cause:
> > > java.lang.RuntimeException: Failed to initialize myriad
> > > java.lang.RuntimeException: Failed to initialize myriad
> > >         at
> > >
> >
> com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:35)
> > >         at
> > >
> >
> com.ebay.myriad.scheduler.yarn.interceptor.CompositeInterceptor.init(CompositeInterceptor.java:76)
> > >         at
> > >
> >
> com.ebay.myriad.scheduler.yarn.MyriadFairScheduler.serviceInit(MyriadFairScheduler.java:50)
> > >         at
> > >
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> > >         at
> > >
> >
> org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
> > >         at
> > >
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:570)
> > >         at
> > >
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> > >         at
> > >
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:997)
> > >         at
> > >
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:262)
> > >         at
> > >
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> > >         at
> > >
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1220)
> > > Caused by: java.lang.NullPointerException
> > >         at com.ebay.myriad.Main.validateNMInstances(Main.java:166)
> > >         at com.ebay.myriad.Main.run(Main.java:98)
> > >         at com.ebay.myriad.Main.initialize(Main.java:80)
> > >         at
> > >
> >
> com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:32)
> > >         ... 10 more
> > > 15/08/18 17:00:28 INFO impl.MetricsSystemImpl: Stopping
> > > ResourceManager metrics system...
> > >
> >
>

Re: Odd Errors

Posted by John Omernik <jo...@omernik.com>.
That's the issue (the yml) I'll merge tomorrow and try it. Thanks Santosh
On Aug 18, 2015 5:19 PM, "Santosh Marella" <sm...@maprtech.com> wrote:

> I think your myriad-config-default.yml is missing a "nmInstances" section.
> Are you running it with a older .yml file?
>
> Santosh
>
> On Tue, Aug 18, 2015 at 3:06 PM, John Omernik <jo...@omernik.com> wrote:
>
> > I am working to stumble through this as Santosh helped me get a pre
> > incubator version of Myriad running, and now I upgraded a bunch of stuff
> > and wanted to try some of the more recent features. I setup the remote
> > distribution, created what I think would be a good a json for marathon
> and
> > then I am getting the dreaded Null Pointer Exception without much help...
> >
> > Based on the logs, it appears to be pulling my URI down with the proper
> > pathing and trying to execute the resource manager from the tar ball,
> > perhaps this will get me kicked off the dev list but my dev foo is weak,
> > thus I am not sure how to troubleshoot this. :) Any help would be
> > appreciated.
> >
> >
> > 15/08/18 17:00:28 INFO mortbay.log: Started
> > SelectChannelConnector@0.0.0.0:8192
> > 15/08/18 17:00:28 INFO myriad.Main: Initializing HealthChecks
> > 15/08/18 17:00:28 INFO myriad.Main: Initializing Profiles
> > 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile tiny
> > with CPU: 1 and Memory: 4096
> > 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile
> > small with CPU: 2 and Memory: 8192
> > 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile
> > medium with CPU: 4 and Memory: 16384
> > 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile
> > large with CPU: 8 and Memory: 32768
> > 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile huge
> > with CPU: 12 and Memory: 49152
> > 15/08/18 17:00:28 INFO myriad.Main: Validating nmInstances..
> > 15/08/18 17:00:28 INFO service.AbstractService: Service
> >
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler
> > failed in state INITED; cause: java.lang.RuntimeException: Failed to
> > initialize myriad
> > java.lang.RuntimeException: Failed to initialize myriad
> >         at
> >
> com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:35)
> >         at
> >
> com.ebay.myriad.scheduler.yarn.interceptor.CompositeInterceptor.init(CompositeInterceptor.java:76)
> >         at
> >
> com.ebay.myriad.scheduler.yarn.MyriadFairScheduler.serviceInit(MyriadFairScheduler.java:50)
> >         at
> > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> >         at
> >
> org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
> >         at
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:570)
> >         at
> > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> >         at
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:997)
> >         at
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:262)
> >         at
> > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> >         at
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1220)
> > Caused by: java.lang.NullPointerException
> >         at com.ebay.myriad.Main.validateNMInstances(Main.java:166)
> >         at com.ebay.myriad.Main.run(Main.java:98)
> >         at com.ebay.myriad.Main.initialize(Main.java:80)
> >         at
> >
> com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:32)
> >         ... 10 more
> > 15/08/18 17:00:28 INFO service.AbstractService: Service
> > RMActiveServices failed in state INITED; cause:
> > java.lang.RuntimeException: Failed to initialize myriad
> > java.lang.RuntimeException: Failed to initialize myriad
> >         at
> >
> com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:35)
> >         at
> >
> com.ebay.myriad.scheduler.yarn.interceptor.CompositeInterceptor.init(CompositeInterceptor.java:76)
> >         at
> >
> com.ebay.myriad.scheduler.yarn.MyriadFairScheduler.serviceInit(MyriadFairScheduler.java:50)
> >         at
> > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> >         at
> >
> org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
> >         at
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:570)
> >         at
> > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> >         at
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:997)
> >         at
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:262)
> >         at
> > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> >         at
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1220)
> > Caused by: java.lang.NullPointerException
> >         at com.ebay.myriad.Main.validateNMInstances(Main.java:166)
> >         at com.ebay.myriad.Main.run(Main.java:98)
> >         at com.ebay.myriad.Main.initialize(Main.java:80)
> >         at
> >
> com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:32)
> >         ... 10 more
> > 15/08/18 17:00:28 INFO impl.MetricsSystemImpl: Stopping
> > ResourceManager metrics system...
> >
>

Re: Odd Errors

Posted by Santosh Marella <sm...@maprtech.com>.
I think your myriad-config-default.yml is missing a "nmInstances" section.
Are you running it with a older .yml file?

Santosh

On Tue, Aug 18, 2015 at 3:06 PM, John Omernik <jo...@omernik.com> wrote:

> I am working to stumble through this as Santosh helped me get a pre
> incubator version of Myriad running, and now I upgraded a bunch of stuff
> and wanted to try some of the more recent features. I setup the remote
> distribution, created what I think would be a good a json for marathon and
> then I am getting the dreaded Null Pointer Exception without much help...
>
> Based on the logs, it appears to be pulling my URI down with the proper
> pathing and trying to execute the resource manager from the tar ball,
> perhaps this will get me kicked off the dev list but my dev foo is weak,
> thus I am not sure how to troubleshoot this. :) Any help would be
> appreciated.
>
>
> 15/08/18 17:00:28 INFO mortbay.log: Started
> SelectChannelConnector@0.0.0.0:8192
> 15/08/18 17:00:28 INFO myriad.Main: Initializing HealthChecks
> 15/08/18 17:00:28 INFO myriad.Main: Initializing Profiles
> 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile tiny
> with CPU: 1 and Memory: 4096
> 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile
> small with CPU: 2 and Memory: 8192
> 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile
> medium with CPU: 4 and Memory: 16384
> 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile
> large with CPU: 8 and Memory: 32768
> 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile huge
> with CPU: 12 and Memory: 49152
> 15/08/18 17:00:28 INFO myriad.Main: Validating nmInstances..
> 15/08/18 17:00:28 INFO service.AbstractService: Service
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler
> failed in state INITED; cause: java.lang.RuntimeException: Failed to
> initialize myriad
> java.lang.RuntimeException: Failed to initialize myriad
>         at
> com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:35)
>         at
> com.ebay.myriad.scheduler.yarn.interceptor.CompositeInterceptor.init(CompositeInterceptor.java:76)
>         at
> com.ebay.myriad.scheduler.yarn.MyriadFairScheduler.serviceInit(MyriadFairScheduler.java:50)
>         at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>         at
> org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
>         at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:570)
>         at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>         at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:997)
>         at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:262)
>         at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>         at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1220)
> Caused by: java.lang.NullPointerException
>         at com.ebay.myriad.Main.validateNMInstances(Main.java:166)
>         at com.ebay.myriad.Main.run(Main.java:98)
>         at com.ebay.myriad.Main.initialize(Main.java:80)
>         at
> com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:32)
>         ... 10 more
> 15/08/18 17:00:28 INFO service.AbstractService: Service
> RMActiveServices failed in state INITED; cause:
> java.lang.RuntimeException: Failed to initialize myriad
> java.lang.RuntimeException: Failed to initialize myriad
>         at
> com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:35)
>         at
> com.ebay.myriad.scheduler.yarn.interceptor.CompositeInterceptor.init(CompositeInterceptor.java:76)
>         at
> com.ebay.myriad.scheduler.yarn.MyriadFairScheduler.serviceInit(MyriadFairScheduler.java:50)
>         at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>         at
> org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
>         at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:570)
>         at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>         at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:997)
>         at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:262)
>         at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>         at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1220)
> Caused by: java.lang.NullPointerException
>         at com.ebay.myriad.Main.validateNMInstances(Main.java:166)
>         at com.ebay.myriad.Main.run(Main.java:98)
>         at com.ebay.myriad.Main.initialize(Main.java:80)
>         at
> com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:32)
>         ... 10 more
> 15/08/18 17:00:28 INFO impl.MetricsSystemImpl: Stopping
> ResourceManager metrics system...
>

Re: Odd Errors

Posted by Darin Johnson <db...@gmail.com>.
Could you paste the stderr/stdout of the executor as well?

I think this may be a bug so you won't get booted:).

Darin
On Aug 18, 2015 3:07 PM, "John Omernik" <jo...@omernik.com> wrote:

> I am working to stumble through this as Santosh helped me get a pre
> incubator version of Myriad running, and now I upgraded a bunch of stuff
> and wanted to try some of the more recent features. I setup the remote
> distribution, created what I think would be a good a json for marathon and
> then I am getting the dreaded Null Pointer Exception without much help...
>
> Based on the logs, it appears to be pulling my URI down with the proper
> pathing and trying to execute the resource manager from the tar ball,
> perhaps this will get me kicked off the dev list but my dev foo is weak,
> thus I am not sure how to troubleshoot this. :) Any help would be
> appreciated.
>
>
> 15/08/18 17:00:28 INFO mortbay.log: Started
> SelectChannelConnector@0.0.0.0:8192
> 15/08/18 17:00:28 INFO myriad.Main: Initializing HealthChecks
> 15/08/18 17:00:28 INFO myriad.Main: Initializing Profiles
> 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile tiny
> with CPU: 1 and Memory: 4096
> 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile
> small with CPU: 2 and Memory: 8192
> 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile
> medium with CPU: 4 and Memory: 16384
> 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile
> large with CPU: 8 and Memory: 32768
> 15/08/18 17:00:28 INFO scheduler.NMProfileManager: Adding profile huge
> with CPU: 12 and Memory: 49152
> 15/08/18 17:00:28 INFO myriad.Main: Validating nmInstances..
> 15/08/18 17:00:28 INFO service.AbstractService: Service
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler
> failed in state INITED; cause: java.lang.RuntimeException: Failed to
> initialize myriad
> java.lang.RuntimeException: Failed to initialize myriad
>         at
> com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:35)
>         at
> com.ebay.myriad.scheduler.yarn.interceptor.CompositeInterceptor.init(CompositeInterceptor.java:76)
>         at
> com.ebay.myriad.scheduler.yarn.MyriadFairScheduler.serviceInit(MyriadFairScheduler.java:50)
>         at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>         at
> org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
>         at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:570)
>         at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>         at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:997)
>         at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:262)
>         at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>         at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1220)
> Caused by: java.lang.NullPointerException
>         at com.ebay.myriad.Main.validateNMInstances(Main.java:166)
>         at com.ebay.myriad.Main.run(Main.java:98)
>         at com.ebay.myriad.Main.initialize(Main.java:80)
>         at
> com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:32)
>         ... 10 more
> 15/08/18 17:00:28 INFO service.AbstractService: Service
> RMActiveServices failed in state INITED; cause:
> java.lang.RuntimeException: Failed to initialize myriad
> java.lang.RuntimeException: Failed to initialize myriad
>         at
> com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:35)
>         at
> com.ebay.myriad.scheduler.yarn.interceptor.CompositeInterceptor.init(CompositeInterceptor.java:76)
>         at
> com.ebay.myriad.scheduler.yarn.MyriadFairScheduler.serviceInit(MyriadFairScheduler.java:50)
>         at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>         at
> org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
>         at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:570)
>         at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>         at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:997)
>         at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:262)
>         at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>         at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1220)
> Caused by: java.lang.NullPointerException
>         at com.ebay.myriad.Main.validateNMInstances(Main.java:166)
>         at com.ebay.myriad.Main.run(Main.java:98)
>         at com.ebay.myriad.Main.initialize(Main.java:80)
>         at
> com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:32)
>         ... 10 more
> 15/08/18 17:00:28 INFO impl.MetricsSystemImpl: Stopping
> ResourceManager metrics system...
>