You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@tez.apache.org by Johannes Zillmann <jz...@googlemail.com> on 2014/08/15 10:28:30 UTC
DAG failed but YARN app successful
Hey guys,
just wandering, is it intended behaviour that the yarn app is showed as success even if a DAG fails ?
Like:
Johannes
Re: DAG failed but YARN app successful
Posted by Johannes Zillmann <jz...@googlemail.com>.
Yep!
Johannes
On 15 Aug 2014, at 19:43, Bikas Saha <bi...@hortonworks.com> wrote:
> Are you using sessions?
>
> From: Johannes Zillmann [mailto:jzillmann@googlemail.com]
> Sent: Friday, August 15, 2014 1:29 AM
> To: user@tez.apache.org
> Subject: DAG failed but YARN app successful
>
> Hey guys,
>
> just wandering, is it intended behaviour that the yarn app is showed as success even if a DAG fails ?
> Like:
> <image001.png>
>
> Johannes
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: DAG failed but YARN app successful
Posted by Johannes Zillmann <jz...@googlemail.com>.
The use of Tez is still evolving, but the with the information from the ticket i get now then problem/situation!
Thanks
Johannes
On 15 Aug 2014, at 19:45, Bikas Saha <bi...@hortonworks.com> wrote:
> Are you running multiple DAGs in a session or a single DAG? If you are running a single DAG then there is no benefit from sessions. If the code follows the recommendations per the 0.5 API then the same code can run in session or non-session mode based on config. So it should be easy for you to not use session mode when not necessary.
>
> Bikas
>
> From: Bikas Saha [mailto:bikas@hortonworks.com]
> Sent: Friday, August 15, 2014 10:44 AM
> To: user@tez.apache.org
> Subject: RE: DAG failed but YARN app successful
>
> Are you using sessions?
>
> From: Johannes Zillmann [mailto:jzillmann@googlemail.com]
> Sent: Friday, August 15, 2014 1:29 AM
> To: user@tez.apache.org
> Subject: DAG failed but YARN app successful
>
> Hey guys,
>
> just wandering, is it intended behaviour that the yarn app is showed as success even if a DAG fails ?
> Like:
> <image001.png>
>
> Johannes
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
RE: DAG failed but YARN app successful
Posted by Bikas Saha <bi...@hortonworks.com>.
Are you running multiple DAGs in a session or a single DAG? If you are
running a single DAG then there is no benefit from sessions. If the code
follows the recommendations per the 0.5 API then the same code can run in
session or non-session mode based on config. So it should be easy for you
to not use session mode when not necessary.
Bikas
*From:* Bikas Saha [mailto:bikas@hortonworks.com]
*Sent:* Friday, August 15, 2014 10:44 AM
*To:* user@tez.apache.org
*Subject:* RE: DAG failed but YARN app successful
Are you using sessions?
*From:* Johannes Zillmann [mailto:jzillmann@googlemail.com]
*Sent:* Friday, August 15, 2014 1:29 AM
*To:* user@tez.apache.org
*Subject:* DAG failed but YARN app successful
Hey guys,
just wandering, is it intended behaviour that the yarn app is showed as
success even if a DAG fails ?
Like:
Johannes
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
RE: DAG failed but YARN app successful
Posted by Bikas Saha <bi...@hortonworks.com>.
Are you using sessions?
*From:* Johannes Zillmann [mailto:jzillmann@googlemail.com]
*Sent:* Friday, August 15, 2014 1:29 AM
*To:* user@tez.apache.org
*Subject:* DAG failed but YARN app successful
Hey guys,
just wandering, is it intended behaviour that the yarn app is showed as
success even if a DAG fails ?
Like:
Johannes
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: DAG failed but YARN app successful
Posted by Johannes Zillmann <jz...@googlemail.com>.
Ok, i see, thanks!
On 15 Aug 2014, at 10:50, Jianfeng (Jeff) Zhang <jz...@hortonworks.com> wrote:
> Hi Johannes,
>
> TEZ-1117 track this issue, and has some discussion there.
>
> Best Regards,
> Jeff Zhang
>
>
>
> On Fri, Aug 15, 2014 at 4:28 PM, Johannes Zillmann <jz...@googlemail.com> wrote:
> Hey guys,
>
> just wandering, is it intended behaviour that the yarn app is showed as success even if a DAG fails ?
> Like:
> <Screen Shot 2014-08-15 at 10.27.23.png>
>
> Johannes
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: DAG failed but YARN app successful
Posted by "Jianfeng (Jeff) Zhang" <jz...@hortonworks.com>.
Hi Johannes,
TEZ-1117 <https://issues.apache.org/jira/browse/TEZ-1117> track this issue,
and has some discussion there.
Best Regards,
Jeff Zhang
On Fri, Aug 15, 2014 at 4:28 PM, Johannes Zillmann <jzillmann@googlemail.com
> wrote:
> Hey guys,
>
> just wandering, is it intended behaviour that the yarn app is showed as
> success even if a DAG fails ?
> Like:
>
> Johannes
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.