You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@myriad.apache.org by Haripriya Ayyalasomayajula <ah...@gmail.com> on 2015/09/14 21:24:44 UTC
Understanding Myriad workflows
Hi,
Is there any architecture document describing the basic workflows - on flex
up the methods called etc? I'm going through the source code on git hub and
was wondering if there is any such source which would help me understand
the internals more..
--
Regards,
Haripriya Ayyalasomayajula
Re: Understanding Myriad workflows
Posted by yuliya Feldman <yu...@yahoo.com.INVALID>.
Myriad implementation does not depend on Marathon, so you don't need to start MyraidScheduler/RM using Marathon.
In this case you need to take care of MyriadScheduler/RM restart in case of it's failure yourself.
Myriad HA feature will take care of preserving state, but restart and discoverability will be in your hands.
Thanks,Yuliya
From: Haripriya Ayyalasomayajula <ah...@gmail.com>
To: dev@myriad.incubator.apache.org
Sent: Monday, September 21, 2015 10:19 AM
Subject: Re: Understanding Myriad workflows
Hi Adam,
Thanks. I was aware of the possibility of starting RM using Marathon -
thats for clarifying. I was wondering if any of the Myriad implementation
is based on that of Marathon..
On Mon, Sep 21, 2015 at 10:08 AM, Adam Bordelon <ad...@mesosphere.io> wrote:
> Haripriya,
>
> You may want to use something like Marathon to start the RM/scheduler and
> keep it up, so that Marathon can restart it somewhere else if the RM
> app/process, or even its entire machine fails. You can, of course, start
> the RM/scheduler manually on a node, but you'll have to manage its HA on
> your own.
>
> On Mon, Sep 21, 2015 at 10:06 AM, Haripriya Ayyalasomayajula <
> aharipriya92@gmail.com> wrote:
>
> > Hi all,
> >
> > https://cwiki.apache.org/confluence/display/MYRIAD/Administration
> >
> > I see that there is a mention of Marathon in this document - I'm not sure
> > where in the Myriad workflow marathon is being used - can anyone help me
> > understand this better - or if I'm missing something ?
> >
> > On Wed, Sep 16, 2015 at 11:07 AM, Ruth Harris <rh...@maprtech.com>
> > wrote:
> >
> > > hi Haripriya,
> > >
> > > No problem. Let me know if you see any errors or inconsistencies.
> > >
> > > Regards, --ruth
> > >
> > > Ruth Harris
> > > Sr. Tech. Writer, MapR
> > >
> > > On Wed, Sep 16, 2015 at 9:44 AM, Haripriya Ayyalasomayajula <
> > > aharipriya92@gmail.com> wrote:
> > >
> > > > Thanks Ruth! That was helpful!
> > > >
> > > > On Mon, Sep 14, 2015 at 1:06 PM, Ruth Harris <rh...@maprtech.com>
> > > wrote:
> > > >
> > > > > The REST API is documented in the Apache wiki:
> > > > >
> > https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Cluster+API
> > > > >
> > > > > Also, in progress, documentation on fine-grained scaling:
> > > > >
> > >
> https://cwiki.apache.org/confluence/display/MYRIAD/Fine-grained+Scaling
> > > > >
> > > > > --ruth
> > > > >
> > > > > On Mon, Sep 14, 2015 at 12:24 PM, Haripriya Ayyalasomayajula <
> > > > > aharipriya92@gmail.com> wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > Is there any architecture document describing the basic
> workflows -
> > > on
> > > > > flex
> > > > > > up the methods called etc? I'm going through the source code on
> git
> > > hub
> > > > > and
> > > > > > was wondering if there is any such source which would help me
> > > > understand
> > > > > > the internals more..
> > > > > >
> > > > > > --
> > > > > > Regards,
> > > > > > Haripriya Ayyalasomayajula
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Ruth Harris
> > > > > Sr. Technical Writer, MapR
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Regards,
> > > > Haripriya Ayyalasomayajula
> > > >
> > >
> > >
> > >
> > > --
> > > Ruth Harris
> > > Sr. Technical Writer, MapR
> > >
> >
> >
> >
> > --
> > Regards,
> > Haripriya Ayyalasomayajula
> >
>
--
Regards,
Haripriya Ayyalasomayajula
Re: Understanding Myriad workflows
Posted by Haripriya Ayyalasomayajula <ah...@gmail.com>.
Hi Adam,
Thanks. I was aware of the possibility of starting RM using Marathon -
thats for clarifying. I was wondering if any of the Myriad implementation
is based on that of Marathon..
On Mon, Sep 21, 2015 at 10:08 AM, Adam Bordelon <ad...@mesosphere.io> wrote:
> Haripriya,
>
> You may want to use something like Marathon to start the RM/scheduler and
> keep it up, so that Marathon can restart it somewhere else if the RM
> app/process, or even its entire machine fails. You can, of course, start
> the RM/scheduler manually on a node, but you'll have to manage its HA on
> your own.
>
> On Mon, Sep 21, 2015 at 10:06 AM, Haripriya Ayyalasomayajula <
> aharipriya92@gmail.com> wrote:
>
> > Hi all,
> >
> > https://cwiki.apache.org/confluence/display/MYRIAD/Administration
> >
> > I see that there is a mention of Marathon in this document - I'm not sure
> > where in the Myriad workflow marathon is being used - can anyone help me
> > understand this better - or if I'm missing something ?
> >
> > On Wed, Sep 16, 2015 at 11:07 AM, Ruth Harris <rh...@maprtech.com>
> > wrote:
> >
> > > hi Haripriya,
> > >
> > > No problem. Let me know if you see any errors or inconsistencies.
> > >
> > > Regards, --ruth
> > >
> > > Ruth Harris
> > > Sr. Tech. Writer, MapR
> > >
> > > On Wed, Sep 16, 2015 at 9:44 AM, Haripriya Ayyalasomayajula <
> > > aharipriya92@gmail.com> wrote:
> > >
> > > > Thanks Ruth! That was helpful!
> > > >
> > > > On Mon, Sep 14, 2015 at 1:06 PM, Ruth Harris <rh...@maprtech.com>
> > > wrote:
> > > >
> > > > > The REST API is documented in the Apache wiki:
> > > > >
> > https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Cluster+API
> > > > >
> > > > > Also, in progress, documentation on fine-grained scaling:
> > > > >
> > >
> https://cwiki.apache.org/confluence/display/MYRIAD/Fine-grained+Scaling
> > > > >
> > > > > --ruth
> > > > >
> > > > > On Mon, Sep 14, 2015 at 12:24 PM, Haripriya Ayyalasomayajula <
> > > > > aharipriya92@gmail.com> wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > Is there any architecture document describing the basic
> workflows -
> > > on
> > > > > flex
> > > > > > up the methods called etc? I'm going through the source code on
> git
> > > hub
> > > > > and
> > > > > > was wondering if there is any such source which would help me
> > > > understand
> > > > > > the internals more..
> > > > > >
> > > > > > --
> > > > > > Regards,
> > > > > > Haripriya Ayyalasomayajula
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Ruth Harris
> > > > > Sr. Technical Writer, MapR
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Regards,
> > > > Haripriya Ayyalasomayajula
> > > >
> > >
> > >
> > >
> > > --
> > > Ruth Harris
> > > Sr. Technical Writer, MapR
> > >
> >
> >
> >
> > --
> > Regards,
> > Haripriya Ayyalasomayajula
> >
>
--
Regards,
Haripriya Ayyalasomayajula
Re: Understanding Myriad workflows
Posted by Adam Bordelon <ad...@mesosphere.io>.
Haripriya,
You may want to use something like Marathon to start the RM/scheduler and
keep it up, so that Marathon can restart it somewhere else if the RM
app/process, or even its entire machine fails. You can, of course, start
the RM/scheduler manually on a node, but you'll have to manage its HA on
your own.
On Mon, Sep 21, 2015 at 10:06 AM, Haripriya Ayyalasomayajula <
aharipriya92@gmail.com> wrote:
> Hi all,
>
> https://cwiki.apache.org/confluence/display/MYRIAD/Administration
>
> I see that there is a mention of Marathon in this document - I'm not sure
> where in the Myriad workflow marathon is being used - can anyone help me
> understand this better - or if I'm missing something ?
>
> On Wed, Sep 16, 2015 at 11:07 AM, Ruth Harris <rh...@maprtech.com>
> wrote:
>
> > hi Haripriya,
> >
> > No problem. Let me know if you see any errors or inconsistencies.
> >
> > Regards, --ruth
> >
> > Ruth Harris
> > Sr. Tech. Writer, MapR
> >
> > On Wed, Sep 16, 2015 at 9:44 AM, Haripriya Ayyalasomayajula <
> > aharipriya92@gmail.com> wrote:
> >
> > > Thanks Ruth! That was helpful!
> > >
> > > On Mon, Sep 14, 2015 at 1:06 PM, Ruth Harris <rh...@maprtech.com>
> > wrote:
> > >
> > > > The REST API is documented in the Apache wiki:
> > > >
> https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Cluster+API
> > > >
> > > > Also, in progress, documentation on fine-grained scaling:
> > > >
> > https://cwiki.apache.org/confluence/display/MYRIAD/Fine-grained+Scaling
> > > >
> > > > --ruth
> > > >
> > > > On Mon, Sep 14, 2015 at 12:24 PM, Haripriya Ayyalasomayajula <
> > > > aharipriya92@gmail.com> wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > Is there any architecture document describing the basic workflows -
> > on
> > > > flex
> > > > > up the methods called etc? I'm going through the source code on git
> > hub
> > > > and
> > > > > was wondering if there is any such source which would help me
> > > understand
> > > > > the internals more..
> > > > >
> > > > > --
> > > > > Regards,
> > > > > Haripriya Ayyalasomayajula
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Ruth Harris
> > > > Sr. Technical Writer, MapR
> > > >
> > >
> > >
> > >
> > > --
> > > Regards,
> > > Haripriya Ayyalasomayajula
> > >
> >
> >
> >
> > --
> > Ruth Harris
> > Sr. Technical Writer, MapR
> >
>
>
>
> --
> Regards,
> Haripriya Ayyalasomayajula
>
Re: Understanding Myriad workflows
Posted by Haripriya Ayyalasomayajula <ah...@gmail.com>.
Hi all,
https://cwiki.apache.org/confluence/display/MYRIAD/Administration
I see that there is a mention of Marathon in this document - I'm not sure
where in the Myriad workflow marathon is being used - can anyone help me
understand this better - or if I'm missing something ?
On Wed, Sep 16, 2015 at 11:07 AM, Ruth Harris <rh...@maprtech.com> wrote:
> hi Haripriya,
>
> No problem. Let me know if you see any errors or inconsistencies.
>
> Regards, --ruth
>
> Ruth Harris
> Sr. Tech. Writer, MapR
>
> On Wed, Sep 16, 2015 at 9:44 AM, Haripriya Ayyalasomayajula <
> aharipriya92@gmail.com> wrote:
>
> > Thanks Ruth! That was helpful!
> >
> > On Mon, Sep 14, 2015 at 1:06 PM, Ruth Harris <rh...@maprtech.com>
> wrote:
> >
> > > The REST API is documented in the Apache wiki:
> > > https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Cluster+API
> > >
> > > Also, in progress, documentation on fine-grained scaling:
> > >
> https://cwiki.apache.org/confluence/display/MYRIAD/Fine-grained+Scaling
> > >
> > > --ruth
> > >
> > > On Mon, Sep 14, 2015 at 12:24 PM, Haripriya Ayyalasomayajula <
> > > aharipriya92@gmail.com> wrote:
> > >
> > > > Hi,
> > > >
> > > > Is there any architecture document describing the basic workflows -
> on
> > > flex
> > > > up the methods called etc? I'm going through the source code on git
> hub
> > > and
> > > > was wondering if there is any such source which would help me
> > understand
> > > > the internals more..
> > > >
> > > > --
> > > > Regards,
> > > > Haripriya Ayyalasomayajula
> > > >
> > >
> > >
> > >
> > > --
> > > Ruth Harris
> > > Sr. Technical Writer, MapR
> > >
> >
> >
> >
> > --
> > Regards,
> > Haripriya Ayyalasomayajula
> >
>
>
>
> --
> Ruth Harris
> Sr. Technical Writer, MapR
>
--
Regards,
Haripriya Ayyalasomayajula
Re: Understanding Myriad workflows
Posted by Ruth Harris <rh...@maprtech.com>.
hi Haripriya,
No problem. Let me know if you see any errors or inconsistencies.
Regards, --ruth
Ruth Harris
Sr. Tech. Writer, MapR
On Wed, Sep 16, 2015 at 9:44 AM, Haripriya Ayyalasomayajula <
aharipriya92@gmail.com> wrote:
> Thanks Ruth! That was helpful!
>
> On Mon, Sep 14, 2015 at 1:06 PM, Ruth Harris <rh...@maprtech.com> wrote:
>
> > The REST API is documented in the Apache wiki:
> > https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Cluster+API
> >
> > Also, in progress, documentation on fine-grained scaling:
> > https://cwiki.apache.org/confluence/display/MYRIAD/Fine-grained+Scaling
> >
> > --ruth
> >
> > On Mon, Sep 14, 2015 at 12:24 PM, Haripriya Ayyalasomayajula <
> > aharipriya92@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > Is there any architecture document describing the basic workflows - on
> > flex
> > > up the methods called etc? I'm going through the source code on git hub
> > and
> > > was wondering if there is any such source which would help me
> understand
> > > the internals more..
> > >
> > > --
> > > Regards,
> > > Haripriya Ayyalasomayajula
> > >
> >
> >
> >
> > --
> > Ruth Harris
> > Sr. Technical Writer, MapR
> >
>
>
>
> --
> Regards,
> Haripriya Ayyalasomayajula
>
--
Ruth Harris
Sr. Technical Writer, MapR
Re: Understanding Myriad workflows
Posted by Haripriya Ayyalasomayajula <ah...@gmail.com>.
Thanks Ruth! That was helpful!
On Mon, Sep 14, 2015 at 1:06 PM, Ruth Harris <rh...@maprtech.com> wrote:
> The REST API is documented in the Apache wiki:
> https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Cluster+API
>
> Also, in progress, documentation on fine-grained scaling:
> https://cwiki.apache.org/confluence/display/MYRIAD/Fine-grained+Scaling
>
> --ruth
>
> On Mon, Sep 14, 2015 at 12:24 PM, Haripriya Ayyalasomayajula <
> aharipriya92@gmail.com> wrote:
>
> > Hi,
> >
> > Is there any architecture document describing the basic workflows - on
> flex
> > up the methods called etc? I'm going through the source code on git hub
> and
> > was wondering if there is any such source which would help me understand
> > the internals more..
> >
> > --
> > Regards,
> > Haripriya Ayyalasomayajula
> >
>
>
>
> --
> Ruth Harris
> Sr. Technical Writer, MapR
>
--
Regards,
Haripriya Ayyalasomayajula
Re: Understanding Myriad workflows
Posted by Ruth Harris <rh...@maprtech.com>.
The REST API is documented in the Apache wiki:
https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Cluster+API
Also, in progress, documentation on fine-grained scaling:
https://cwiki.apache.org/confluence/display/MYRIAD/Fine-grained+Scaling
--ruth
On Mon, Sep 14, 2015 at 12:24 PM, Haripriya Ayyalasomayajula <
aharipriya92@gmail.com> wrote:
> Hi,
>
> Is there any architecture document describing the basic workflows - on flex
> up the methods called etc? I'm going through the source code on git hub and
> was wondering if there is any such source which would help me understand
> the internals more..
>
> --
> Regards,
> Haripriya Ayyalasomayajula
>
--
Ruth Harris
Sr. Technical Writer, MapR