You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Manuel Sopena Ballesteros <ma...@garvan.org.au> on 2019/11/27 03:49:29 UTC

how to list yarn applications by creation time and filter by username?

Dear Hadoop community,

I am learning yarn and would like to find an application id based on creation time.

This is what I am trying to do:

yarn app -list -appStates KILLED,FAILED

But I would like to show the creation time on the output and also be able to sort by creation time and if possible filter out all applications that does not belongs to me

I know that the web interface can do what I am after but I am more keen on working with command line.

Any advice?

Thank you
NOTICE
Please consider the environment before printing this email. This message and any attachments are intended for the addressee named and may contain legally privileged/confidential/copyright information. If you are not the intended recipient, you should not read, use, disclose, copy or distribute this communication. If you have received this message in error please notify us at once by return email and then delete both messages. We accept no liability for the distribution of viruses or similar in electronic communications. This notice should not be removed.

Re: how to list yarn applications by creation time and filter by username?

Posted by Prabhu Josephraj <pj...@cloudera.com.INVALID>.
The startTime field from ApplicationReport is the application creation
time. The CLI yarn application -list does not print the application
startTime.
But we can use YARN REST Api "http://<RM_HOST>:<RM_PORT>/ws/v1/cluster/apps"
which provides the startTime.

On Thu, Nov 28, 2019 at 5:10 AM Manuel Sopena Ballesteros <
manuel.sb@garvan.org.au> wrote:

> Thanks Prabhu,
>
>
>
> Do you know which yarn command can I use in order to get application
> creation time?
>
>
>
> Thank you
>
>
>
> Manuel
>
>
>
> *From:* Prabhu Josephraj [mailto:pjoseph@cloudera.com]
> *Sent:* Wednesday, November 27, 2019 8:09 PM
> *To:* Manuel Sopena Ballesteros
> *Cc:* user@hadoop.apache.org
> *Subject:* Re: how to list yarn applications by creation time and filter
> by username?
>
>
>
> Yarn CLI does not do that, i think u need to write a script which does
> that on top of the output provided by YARN CLI.
>
>
>
> On Wed, Nov 27, 2019 at 9:19 AM Manuel Sopena Ballesteros <
> manuel.sb@garvan.org.au> wrote:
>
> Dear Hadoop community,
>
>
>
> I am learning yarn and would like to find an application id based on
> creation time.
>
>
>
> This is what I am trying to do:
>
>
>
> yarn app -list -appStates KILLED,FAILED
>
>
>
> But I would like to show the creation time on the output and also be able
> to sort by creation time and if possible filter out all applications that
> does not belongs to me
>
>
>
> I know that the web interface can do what I am after but I am more keen on
> working with command line.
>
>
>
> Any advice?
>
>
>
> Thank you
>
> NOTICE
>
> Please consider the environment before printing this email. This message
> and any attachments are intended for the addressee named and may contain
> legally privileged/confidential/copyright information. If you are not the
> intended recipient, you should not read, use, disclose, copy or distribute
> this communication. If you have received this message in error please
> notify us at once by return email and then delete both messages. We accept
> no liability for the distribution of viruses or similar in electronic
> communications. This notice should not be removed.
>
> NOTICE
> Please consider the environment before printing this email. This message
> and any attachments are intended for the addressee named and may contain
> legally privileged/confidential/copyright information. If you are not the
> intended recipient, you should not read, use, disclose, copy or distribute
> this communication. If you have received this message in error please
> notify us at once by return email and then delete both messages. We accept
> no liability for the distribution of viruses or similar in electronic
> communications. This notice should not be removed.
>

RE: how to list yarn applications by creation time and filter by username?

Posted by Manuel Sopena Ballesteros <ma...@garvan.org.au>.
Thanks Prabhu,

Do you know which yarn command can I use in order to get application creation time?

Thank you

Manuel

From: Prabhu Josephraj [mailto:pjoseph@cloudera.com]
Sent: Wednesday, November 27, 2019 8:09 PM
To: Manuel Sopena Ballesteros
Cc: user@hadoop.apache.org
Subject: Re: how to list yarn applications by creation time and filter by username?

Yarn CLI does not do that, i think u need to write a script which does that on top of the output provided by YARN CLI.

On Wed, Nov 27, 2019 at 9:19 AM Manuel Sopena Ballesteros <ma...@garvan.org.au>> wrote:
Dear Hadoop community,

I am learning yarn and would like to find an application id based on creation time.

This is what I am trying to do:

yarn app -list -appStates KILLED,FAILED

But I would like to show the creation time on the output and also be able to sort by creation time and if possible filter out all applications that does not belongs to me

I know that the web interface can do what I am after but I am more keen on working with command line.

Any advice?

Thank you
NOTICE
Please consider the environment before printing this email. This message and any attachments are intended for the addressee named and may contain legally privileged/confidential/copyright information. If you are not the intended recipient, you should not read, use, disclose, copy or distribute this communication. If you have received this message in error please notify us at once by return email and then delete both messages. We accept no liability for the distribution of viruses or similar in electronic communications. This notice should not be removed.
NOTICE
Please consider the environment before printing this email. This message and any attachments are intended for the addressee named and may contain legally privileged/confidential/copyright information. If you are not the intended recipient, you should not read, use, disclose, copy or distribute this communication. If you have received this message in error please notify us at once by return email and then delete both messages. We accept no liability for the distribution of viruses or similar in electronic communications. This notice should not be removed.

Re: how to list yarn applications by creation time and filter by username?

Posted by Prabhu Josephraj <pj...@cloudera.com.INVALID>.
Yarn CLI does not do that, i think u need to write a script which does that
on top of the output provided by YARN CLI.

On Wed, Nov 27, 2019 at 9:19 AM Manuel Sopena Ballesteros <
manuel.sb@garvan.org.au> wrote:

> Dear Hadoop community,
>
>
>
> I am learning yarn and would like to find an application id based on
> creation time.
>
>
>
> This is what I am trying to do:
>
>
>
> yarn app -list -appStates KILLED,FAILED
>
>
>
> But I would like to show the creation time on the output and also be able
> to sort by creation time and if possible filter out all applications that
> does not belongs to me
>
>
>
> I know that the web interface can do what I am after but I am more keen on
> working with command line.
>
>
>
> Any advice?
>
>
>
> Thank you
> NOTICE
> Please consider the environment before printing this email. This message
> and any attachments are intended for the addressee named and may contain
> legally privileged/confidential/copyright information. If you are not the
> intended recipient, you should not read, use, disclose, copy or distribute
> this communication. If you have received this message in error please
> notify us at once by return email and then delete both messages. We accept
> no liability for the distribution of viruses or similar in electronic
> communications. This notice should not be removed.
>