You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Radim Kolar <hs...@filez.com> on 2012/07/30 21:29:20 UTC
server side DAG of jobs in YARN
Is there some support for server side control of DAG jobs? I mean
something which in Tool creates Jobs and submits them with list of
dependencies and then exits without waiting for end of jobs. I currently
have this implemented in client side, i have to wait until all jobs are
finished before System.exit().
JobControl and ControlledJob is client side thing. I think about Spring
Batch, it has some limited support for server side DAG.
Re: server side DAG of jobs in YARN
Posted by Bo Wang <bo...@cloudera.com>.
Not working yet. I expect to finish it in one month or so.
On Tue, Jul 31, 2012 at 3:15 AM, Radim Kolar <hs...@filez.com> wrote:
>
> I am working on the server side DAG execution actually. Here is a JIRA.
>>
>> https://issues.apache.org/**jira/browse/MAPREDUCE-4495<https://issues.apache.org/jira/browse/MAPREDUCE-4495>
>>
> do you have some code in hand?
>
Re: server side DAG of jobs in YARN
Posted by Radim Kolar <hs...@filez.com>.
> I am working on the server side DAG execution actually. Here is a JIRA.
>
> https://issues.apache.org/jira/browse/MAPREDUCE-4495
do you have some code in hand?
Re: server side DAG of jobs in YARN
Posted by Bo Wang <bo...@cloudera.com>.
Hi Radim,
Thanks for the mail. I am working on the server side DAG execution
actually. Here is a JIRA.
https://issues.apache.org/jira/browse/MAPREDUCE-4495
Thanks,
Bo
On Mon, Jul 30, 2012 at 12:29 PM, Radim Kolar <hs...@filez.com> wrote:
>
> Is there some support for server side control of DAG jobs? I mean something which in Tool creates Jobs and submits them with list of dependencies and then exits without waiting for end of jobs. I currently have this implemented in client side, i have to wait until all jobs are finished before System.exit().
>
> JobControl and ControlledJob is client side thing. I think about Spring Batch, it has some limited support for server side DAG.
>
>
Re: server side DAG of jobs in YARN
Posted by Bo Wang <bo...@cloudera.com>.
Hi Radim,
Thanks for the mail. I am working on the server side DAG execution
actually. Here is a JIRA.
https://issues.apache.org/jira/browse/MAPREDUCE-4495
Thanks,
Bo
On Mon, Jul 30, 2012 at 12:29 PM, Radim Kolar <hs...@filez.com> wrote:
>
> Is there some support for server side control of DAG jobs? I mean
> something which in Tool creates Jobs and submits them with list of
> dependencies and then exits without waiting for end of jobs. I currently
> have this implemented in client side, i have to wait until all jobs are
> finished before System.exit().
>
> JobControl and ControlledJob is client side thing. I think about Spring
> Batch, it has some limited support for server side DAG.
>
>
>
>