You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@samza.apache.org by Yi Pan <ni...@gmail.com> on 2017/10/02 09:10:27 UTC
Re: Historical container logs in YARN UI
Hi, XiaoChuan,
Our SRE team have been using timeline server in YARN at LinkedIn to get the
historical container logs in our admin dashboard. @Jon Bringburst, can you
share some experience regarding to how to configure timeline server in YARN?
Thanks a lot!
-Yi
On Sat, Sep 30, 2017 at 1:08 PM, XiaoChuan Yu <xi...@kik.com> wrote:
> Hi,
>
> Is there a way to view historical container logs in YARN UI?
> When I try view historical logs from YARN UI right now I get the follow
> message:
> Failed while trying to construct the redirect url to the log server. Log
> Server url may not be configured
> ...
>
> I configured log aggregation and timeline server in YARN.
> I know there's a history server implementation for Map Reduce. Is there a
> similar history server implementation available for Samza?
>
> Thanks,
> Xiaochuan Yu
>
Re: Historical container logs in YARN UI
Posted by Navina Ramesh <nr...@linkedin.com>.
+Jon (Adding Jon to cc)
________________________________
From: Yi Pan <ni...@gmail.com>
Sent: Monday, October 2, 2017 2:10:27 AM
To: dev@samza.apache.org
Subject: Re: Historical container logs in YARN UI
Hi, XiaoChuan,
Our SRE team have been using timeline server in YARN at LinkedIn to get the
historical container logs in our admin dashboard. @Jon Bringburst, can you
share some experience regarding to how to configure timeline server in YARN?
Thanks a lot!
-Yi
On Sat, Sep 30, 2017 at 1:08 PM, XiaoChuan Yu <xi...@kik.com> wrote:
> Hi,
>
> Is there a way to view historical container logs in YARN UI?
> When I try view historical logs from YARN UI right now I get the follow
> message:
> Failed while trying to construct the redirect url to the log server. Log
> Server url may not be configured
> ...
>
> I configured log aggregation and timeline server in YARN.
> I know there's a history server implementation for Map Reduce. Is there a
> similar history server implementation available for Samza?
>
> Thanks,
> Xiaochuan Yu
>
Re: Historical container logs in YARN UI
Posted by Abhishek Shivanna <ab...@gmail.com>.
Hi XiaoChuan,
Samza by itself does not maintain history on container launches.
But that said you should be able to use YARN to get logs from containers
similar to Map Reduce jobs.
A quick code search for the error message tells me that you are probably
missing the following config.
<property>
<name>yarn.log.server.url</name>
<value>http://node:19888/jobhistory/logs/</value>
</property>
Thanks,
Abhishek
On Mon, Oct 2, 2017 at 2:10 AM, Yi Pan <ni...@gmail.com> wrote:
> Hi, XiaoChuan,
>
> Our SRE team have been using timeline server in YARN at LinkedIn to get the
> historical container logs in our admin dashboard. @Jon Bringburst, can you
> share some experience regarding to how to configure timeline server in
> YARN?
>
> Thanks a lot!
>
> -Yi
>
> On Sat, Sep 30, 2017 at 1:08 PM, XiaoChuan Yu <xi...@kik.com>
> wrote:
>
> > Hi,
> >
> > Is there a way to view historical container logs in YARN UI?
> > When I try view historical logs from YARN UI right now I get the follow
> > message:
> > Failed while trying to construct the redirect url to the log server. Log
> > Server url may not be configured
> > ...
> >
> > I configured log aggregation and timeline server in YARN.
> > I know there's a history server implementation for Map Reduce. Is there a
> > similar history server implementation available for Samza?
> >
> > Thanks,
> > Xiaochuan Yu
> >
>