You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by ni...@free.fr on 2015/10/08 19:37:19 UTC
Applicative logs on Yarn
Hello,
I submit spark streaming inside Yarn, I have configured yarn to generate custom logs.
It works fine and yarn aggregate very well the logs inside HDFS, nevertheless the log files are only usable via "yarn logs" command.
I would prefer to be able to navigate inside via hdfs command like a text file, is it possible to aggregate those files as text file ?
Tks
Nicolas
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Applicative logs on Yarn
Posted by Ted Yu <yu...@gmail.com>.
This question seems better suited for user@hadoop.apache.org
FYI
On Thu, Oct 8, 2015 at 10:37 AM, <ni...@free.fr> wrote:
> Hello,
> I submit spark streaming inside Yarn, I have configured yarn to generate
> custom logs.
> It works fine and yarn aggregate very well the logs inside HDFS,
> nevertheless the log files are only usable via "yarn logs" command.
> I would prefer to be able to navigate inside via hdfs command like a text
> file, is it possible to aggregate those files as text file ?
>
> Tks
> Nicolas
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>