You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@myriad.apache.org by Donald Hansen <do...@hansenfamily.us> on 2015/06/19 19:26:21 UTC
flexdown / not registered with resource manager
I'm new to Myriad and not sure if this is the right place to post this. Let
me know if it isn't.
I'm doing a POC to try and get Myriad integrated into Ambari. I got it all
working somewhat and am able to send a FlexUp from my Ambari UI. When I do
a FlexDown, I get this error:
15/06/19 17:12:10 INFO scheduler.MyriadOperations: About to flex down 1
instances
15/06/19 17:12:10 INFO scheduler.MyriadOperations: Will skip flexing down 2
Node Manager instances that were launched but have not yet registered with
Resource Manager.
15/06/19 17:12:10 INFO scheduler.MyriadOperations: Flexed down 0 of 1
instances including 0 staging instances, and 0 pending instances.
I also get this when calling the API directly as well as when using the
Myriad UI.
Any ideas?
Thanks.
Donald
Re: flexdown / not registered with resource manager
Posted by yuliya Feldman <yu...@yahoo.com.INVALID>.
Could you Check RM UI - namely :Nodes page to see that those NMs as operational before you flexdown
They may not have time to register back to RM
From: Donald Hansen <do...@hansenfamily.us>
To: dev@myriad.incubator.apache.org; yuliya Feldman <yu...@yahoo.com>
Sent: Friday, June 19, 2015 10:44 AM
Subject: Re: flexdown / not registered with resource manager
Thanks for the reply.
I called FlexUp twice and I see 2 Active Tasks in the Myriad UI as well as the Mesos UI. After calling FlexUp, I waited a few minutes and then tried FlexDown. I didn't try to run anything though.
On Fri, Jun 19, 2015 at 10:41 AM, yuliya Feldman <yu...@yahoo.com.invalid> wrote:
Great to hear you are trying Myriad.
When you did flexup - did any of NMs started based on that call and you were able to run some jobs?Seems like you can not flex down since "flexed up" NMs are not registered back with RM
From: Donald Hansen <do...@hansenfamily.us>
To: dev@myriad.incubator.apache.org
Sent: Friday, June 19, 2015 10:26 AM
Subject: flexdown / not registered with resource manager
I'm new to Myriad and not sure if this is the right place to post this. Let
me know if it isn't.
I'm doing a POC to try and get Myriad integrated into Ambari. I got it all
working somewhat and am able to send a FlexUp from my Ambari UI. When I do
a FlexDown, I get this error:
15/06/19 17:12:10 INFO scheduler.MyriadOperations: About to flex down 1
instances
15/06/19 17:12:10 INFO scheduler.MyriadOperations: Will skip flexing down 2
Node Manager instances that were launched but have not yet registered with
Resource Manager.
15/06/19 17:12:10 INFO scheduler.MyriadOperations: Flexed down 0 of 1
instances including 0 staging instances, and 0 pending instances.
I also get this when calling the API directly as well as when using the
Myriad UI.
Any ideas?
Thanks.
Donald
Re: flexdown / not registered with resource manager
Posted by Darin Johnson <db...@gmail.com>.
Donald,
If you haven't installed hadoop on the worker nodes you've got a couple
options:
1. Use mesos-hdfs and the remote-distribution feature.
2. Install hadoop on all nodes.
On Fri, Jun 19, 2015 at 2:43 PM, Donald Hansen <do...@hansenfamily.us>
wrote:
> Thanks for the replies. Found the problem. Whenever I did Flexup, Node
> Manager would start getting errors. The problem is that on my separate
> nodes, there was no folder "/hadoop/yarn". That folder only existed on my
> master.
>
>
> On Fri, Jun 19, 2015 at 10:59 AM, Darin Johnson <db...@gmail.com>
> wrote:
>
> > 15/06/19 17:12:10 INFO scheduler.MyriadOperations: Will skip flexing
> down 2
> > Node Manager instances that were launched but have not yet registered
> with
> > Resource Manager.
> >
> > This is an interesting line. Did you see the nodes in the resource
> mangers
> > ui?
> >
> > On Fri, Jun 19, 2015 at 1:44 PM, Donald Hansen <do...@hansenfamily.us>
> > wrote:
> >
> > > Thanks for the reply.
> > >
> > > I called FlexUp twice and I see 2 Active Tasks in the Myriad UI as well
> > as
> > > the Mesos UI. After calling FlexUp, I waited a few minutes and then
> tried
> > > FlexDown. I didn't try to run anything though.
> > >
> > >
> > > On Fri, Jun 19, 2015 at 10:41 AM, yuliya Feldman <
> > > yufeldman@yahoo.com.invalid> wrote:
> > >
> > > > Great to hear you are trying Myriad.
> > > > When you did flexup - did any of NMs started based on that call and
> you
> > > > were able to run some jobs?Seems like you can not flex down since
> > "flexed
> > > > up" NMs are not registered back with RM
> > > > From: Donald Hansen <do...@hansenfamily.us>
> > > > To: dev@myriad.incubator.apache.org
> > > > Sent: Friday, June 19, 2015 10:26 AM
> > > > Subject: flexdown / not registered with resource manager
> > > >
> > > > I'm new to Myriad and not sure if this is the right place to post
> this.
> > > Let
> > > > me know if it isn't.
> > > >
> > > > I'm doing a POC to try and get Myriad integrated into Ambari. I got
> it
> > > all
> > > > working somewhat and am able to send a FlexUp from my Ambari UI.
> When I
> > > do
> > > > a FlexDown, I get this error:
> > > >
> > > > 15/06/19 17:12:10 INFO scheduler.MyriadOperations: About to flex
> down 1
> > > > instances
> > > > 15/06/19 17:12:10 INFO scheduler.MyriadOperations: Will skip flexing
> > > down 2
> > > > Node Manager instances that were launched but have not yet registered
> > > with
> > > > Resource Manager.
> > > > 15/06/19 17:12:10 INFO scheduler.MyriadOperations: Flexed down 0 of 1
> > > > instances including 0 staging instances, and 0 pending instances.
> > > >
> > > > I also get this when calling the API directly as well as when using
> the
> > > > Myriad UI.
> > > >
> > > > Any ideas?
> > > >
> > > > Thanks.
> > > > Donald
> > > >
> > > >
> > > >
> > > >
> > >
> >
>
Re: flexdown / not registered with resource manager
Posted by Donald Hansen <do...@hansenfamily.us>.
Thanks for the replies. Found the problem. Whenever I did Flexup, Node
Manager would start getting errors. The problem is that on my separate
nodes, there was no folder "/hadoop/yarn". That folder only existed on my
master.
On Fri, Jun 19, 2015 at 10:59 AM, Darin Johnson <db...@gmail.com>
wrote:
> 15/06/19 17:12:10 INFO scheduler.MyriadOperations: Will skip flexing down 2
> Node Manager instances that were launched but have not yet registered with
> Resource Manager.
>
> This is an interesting line. Did you see the nodes in the resource mangers
> ui?
>
> On Fri, Jun 19, 2015 at 1:44 PM, Donald Hansen <do...@hansenfamily.us>
> wrote:
>
> > Thanks for the reply.
> >
> > I called FlexUp twice and I see 2 Active Tasks in the Myriad UI as well
> as
> > the Mesos UI. After calling FlexUp, I waited a few minutes and then tried
> > FlexDown. I didn't try to run anything though.
> >
> >
> > On Fri, Jun 19, 2015 at 10:41 AM, yuliya Feldman <
> > yufeldman@yahoo.com.invalid> wrote:
> >
> > > Great to hear you are trying Myriad.
> > > When you did flexup - did any of NMs started based on that call and you
> > > were able to run some jobs?Seems like you can not flex down since
> "flexed
> > > up" NMs are not registered back with RM
> > > From: Donald Hansen <do...@hansenfamily.us>
> > > To: dev@myriad.incubator.apache.org
> > > Sent: Friday, June 19, 2015 10:26 AM
> > > Subject: flexdown / not registered with resource manager
> > >
> > > I'm new to Myriad and not sure if this is the right place to post this.
> > Let
> > > me know if it isn't.
> > >
> > > I'm doing a POC to try and get Myriad integrated into Ambari. I got it
> > all
> > > working somewhat and am able to send a FlexUp from my Ambari UI. When I
> > do
> > > a FlexDown, I get this error:
> > >
> > > 15/06/19 17:12:10 INFO scheduler.MyriadOperations: About to flex down 1
> > > instances
> > > 15/06/19 17:12:10 INFO scheduler.MyriadOperations: Will skip flexing
> > down 2
> > > Node Manager instances that were launched but have not yet registered
> > with
> > > Resource Manager.
> > > 15/06/19 17:12:10 INFO scheduler.MyriadOperations: Flexed down 0 of 1
> > > instances including 0 staging instances, and 0 pending instances.
> > >
> > > I also get this when calling the API directly as well as when using the
> > > Myriad UI.
> > >
> > > Any ideas?
> > >
> > > Thanks.
> > > Donald
> > >
> > >
> > >
> > >
> >
>
Re: flexdown / not registered with resource manager
Posted by Darin Johnson <db...@gmail.com>.
15/06/19 17:12:10 INFO scheduler.MyriadOperations: Will skip flexing down 2
Node Manager instances that were launched but have not yet registered with
Resource Manager.
This is an interesting line. Did you see the nodes in the resource mangers
ui?
On Fri, Jun 19, 2015 at 1:44 PM, Donald Hansen <do...@hansenfamily.us>
wrote:
> Thanks for the reply.
>
> I called FlexUp twice and I see 2 Active Tasks in the Myriad UI as well as
> the Mesos UI. After calling FlexUp, I waited a few minutes and then tried
> FlexDown. I didn't try to run anything though.
>
>
> On Fri, Jun 19, 2015 at 10:41 AM, yuliya Feldman <
> yufeldman@yahoo.com.invalid> wrote:
>
> > Great to hear you are trying Myriad.
> > When you did flexup - did any of NMs started based on that call and you
> > were able to run some jobs?Seems like you can not flex down since "flexed
> > up" NMs are not registered back with RM
> > From: Donald Hansen <do...@hansenfamily.us>
> > To: dev@myriad.incubator.apache.org
> > Sent: Friday, June 19, 2015 10:26 AM
> > Subject: flexdown / not registered with resource manager
> >
> > I'm new to Myriad and not sure if this is the right place to post this.
> Let
> > me know if it isn't.
> >
> > I'm doing a POC to try and get Myriad integrated into Ambari. I got it
> all
> > working somewhat and am able to send a FlexUp from my Ambari UI. When I
> do
> > a FlexDown, I get this error:
> >
> > 15/06/19 17:12:10 INFO scheduler.MyriadOperations: About to flex down 1
> > instances
> > 15/06/19 17:12:10 INFO scheduler.MyriadOperations: Will skip flexing
> down 2
> > Node Manager instances that were launched but have not yet registered
> with
> > Resource Manager.
> > 15/06/19 17:12:10 INFO scheduler.MyriadOperations: Flexed down 0 of 1
> > instances including 0 staging instances, and 0 pending instances.
> >
> > I also get this when calling the API directly as well as when using the
> > Myriad UI.
> >
> > Any ideas?
> >
> > Thanks.
> > Donald
> >
> >
> >
> >
>
Re: flexdown / not registered with resource manager
Posted by Donald Hansen <do...@hansenfamily.us>.
Thanks for the reply.
I called FlexUp twice and I see 2 Active Tasks in the Myriad UI as well as
the Mesos UI. After calling FlexUp, I waited a few minutes and then tried
FlexDown. I didn't try to run anything though.
On Fri, Jun 19, 2015 at 10:41 AM, yuliya Feldman <
yufeldman@yahoo.com.invalid> wrote:
> Great to hear you are trying Myriad.
> When you did flexup - did any of NMs started based on that call and you
> were able to run some jobs?Seems like you can not flex down since "flexed
> up" NMs are not registered back with RM
> From: Donald Hansen <do...@hansenfamily.us>
> To: dev@myriad.incubator.apache.org
> Sent: Friday, June 19, 2015 10:26 AM
> Subject: flexdown / not registered with resource manager
>
> I'm new to Myriad and not sure if this is the right place to post this. Let
> me know if it isn't.
>
> I'm doing a POC to try and get Myriad integrated into Ambari. I got it all
> working somewhat and am able to send a FlexUp from my Ambari UI. When I do
> a FlexDown, I get this error:
>
> 15/06/19 17:12:10 INFO scheduler.MyriadOperations: About to flex down 1
> instances
> 15/06/19 17:12:10 INFO scheduler.MyriadOperations: Will skip flexing down 2
> Node Manager instances that were launched but have not yet registered with
> Resource Manager.
> 15/06/19 17:12:10 INFO scheduler.MyriadOperations: Flexed down 0 of 1
> instances including 0 staging instances, and 0 pending instances.
>
> I also get this when calling the API directly as well as when using the
> Myriad UI.
>
> Any ideas?
>
> Thanks.
> Donald
>
>
>
>
Re: flexdown / not registered with resource manager
Posted by yuliya Feldman <yu...@yahoo.com.INVALID>.
Great to hear you are trying Myriad.
When you did flexup - did any of NMs started based on that call and you were able to run some jobs?Seems like you can not flex down since "flexed up" NMs are not registered back with RM
From: Donald Hansen <do...@hansenfamily.us>
To: dev@myriad.incubator.apache.org
Sent: Friday, June 19, 2015 10:26 AM
Subject: flexdown / not registered with resource manager
I'm new to Myriad and not sure if this is the right place to post this. Let
me know if it isn't.
I'm doing a POC to try and get Myriad integrated into Ambari. I got it all
working somewhat and am able to send a FlexUp from my Ambari UI. When I do
a FlexDown, I get this error:
15/06/19 17:12:10 INFO scheduler.MyriadOperations: About to flex down 1
instances
15/06/19 17:12:10 INFO scheduler.MyriadOperations: Will skip flexing down 2
Node Manager instances that were launched but have not yet registered with
Resource Manager.
15/06/19 17:12:10 INFO scheduler.MyriadOperations: Flexed down 0 of 1
instances including 0 staging instances, and 0 pending instances.
I also get this when calling the API directly as well as when using the
Myriad UI.
Any ideas?
Thanks.
Donald