Re: Notebook dependency based scheduling

[moon soo Lee <mo...@apache.org>]

Hi Sanda,

I think it can be done using external scheduler (like oozie) with REST api
that zeppelin provides. It is not planned, but if Zeppelin have built-in
flow orchestration feature in addition to built-in scheduler, that would be
useful.

Thanks,
moon

On Wed, Dec 30, 2015 at 11:20 PM Skanda <sk...@gmail.com> wrote:

> Hi All
>
> I would like to orchestrate the notebook dependencies as part of the
> Schedule. As an example, I would like to execute a note first and then if
> it completes successfully, I would like to trigger 2 other notes in
> parallel. This is something that a scheduler like Oozie offers (flow
> orchestration). Do I need to plugin my own scheduler to achieve something
> like this? Or is such a feature part of the plans of Zeppelin?
>
> Thanks,
> Skanda
>

Re: Notebook dependency based scheduling

[Skanda <sk...@gmail.com>]

Hi moon

I will see if i can contribute.

Thanks,
Skanda

On Fri, Jan 1, 2016 at 7:01 AM, moon soo Lee <mo...@apache.org> wrote:

> Hi Sanda,
>
> I think it can be done using external scheduler (like oozie) with REST api
> that zeppelin provides. It is not planned, but if Zeppelin have built-in
> flow orchestration feature in addition to built-in scheduler, that would be
> useful.
>
> Thanks,
> moon
>
>
> On Wed, Dec 30, 2015 at 11:20 PM Skanda <sk...@gmail.com>
> wrote:
>
>> Hi All
>>
>> I would like to orchestrate the notebook dependencies as part of the
>> Schedule. As an example, I would like to execute a note first and then if
>> it completes successfully, I would like to trigger 2 other notes in
>> parallel. This is something that a scheduler like Oozie offers (flow
>> orchestration). Do I need to plugin my own scheduler to achieve something
>> like this? Or is such a feature part of the plans of Zeppelin?
>>
>> Thanks,
>> Skanda
>>
>