You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@giraph.apache.org by Cheng Wang <su...@gmail.com> on 2015/05/12 17:26:50 UTC
where is the log files
Hello,
I am sure if it is good to ask here.. I am new to Giraph.
I found that in the example codes provided by Giraph package, there are
many outputs are stored into log4j files... e.g.
SimplePageRankComputation.java.
I am wondering where are the log files stored in the log4j?
Thanks
Cheng
Re: where is the log files
Posted by D Cao <cl...@gmail.com>.
Hello My Dear Giraph Buddy,
Anyone knows how to unsubscribe from this email list? The strong
interest and engagements have been making my normal email invisible.
Very appreciate any help!
Thanks,
On Tue, May 12, 2015 at 9:24 AM, Young Han <yo...@uwaterloo.ca> wrote:
> Suppose you've created HDFS in ~/. Then the log files are in
> ~/hadoop_data/hadoop_local-YOURUSER/userlogs/job_yyyymmdd_xxxx/attempt_yyyymmdd_xxxx_*/log-file
> where:
>
> - yyyymmdd is the date you started Hadoop
> - xxxx is the job number
> - attempt_* will be different for different workers
> - log-file can be stderr, stdout, or syslog
>
> Typically you want to look at syslog for anything printed using log4j.
> Metrics, if enabled, will show up in stderr.
>
> If you're running distributed, each machine will log things to their local
> disk. You can also get to the logs by going to (assuming your Hadoop files
> are in ~/) ~/hadoop-x.y.z/logs/userlogs: the folders in here contain
> symlinks to the directories above.
>
> Young
>
>
>
> On Tue, May 12, 2015 at 11:26 AM, Cheng Wang <su...@gmail.com>
> wrote:
>
>> Hello,
>>
>> I am sure if it is good to ask here.. I am new to Giraph.
>> I found that in the example codes provided by Giraph package, there are
>> many outputs are stored into log4j files... e.g.
>> SimplePageRankComputation.java.
>>
>> I am wondering where are the log files stored in the log4j?
>>
>>
>> Thanks
>> Cheng
>>
>
>
Re: where is the log files
Posted by Young Han <yo...@uwaterloo.ca>.
Oops, the job names have year, month, day and also hour, minute. So
something like job_201505121130_0001.
Young
On Tue, May 12, 2015 at 12:24 PM, Young Han <yo...@uwaterloo.ca> wrote:
> Suppose you've created HDFS in ~/. Then the log files are in
> ~/hadoop_data/hadoop_local-YOURUSER/userlogs/job_yyyymmdd_xxxx/attempt_yyyymmdd_xxxx_*/log-file
> where:
>
> - yyyymmdd is the date you started Hadoop
> - xxxx is the job number
> - attempt_* will be different for different workers
> - log-file can be stderr, stdout, or syslog
>
> Typically you want to look at syslog for anything printed using log4j.
> Metrics, if enabled, will show up in stderr.
>
> If you're running distributed, each machine will log things to their local
> disk. You can also get to the logs by going to (assuming your Hadoop files
> are in ~/) ~/hadoop-x.y.z/logs/userlogs: the folders in here contain
> symlinks to the directories above.
>
> Young
>
>
>
> On Tue, May 12, 2015 at 11:26 AM, Cheng Wang <su...@gmail.com>
> wrote:
>
>> Hello,
>>
>> I am sure if it is good to ask here.. I am new to Giraph.
>> I found that in the example codes provided by Giraph package, there are
>> many outputs are stored into log4j files... e.g.
>> SimplePageRankComputation.java.
>>
>> I am wondering where are the log files stored in the log4j?
>>
>>
>> Thanks
>> Cheng
>>
>
>
Re: where is the log files
Posted by Young Han <yo...@uwaterloo.ca>.
Suppose you've created HDFS in ~/. Then the log files are in
~/hadoop_data/hadoop_local-YOURUSER/userlogs/job_yyyymmdd_xxxx/attempt_yyyymmdd_xxxx_*/log-file
where:
- yyyymmdd is the date you started Hadoop
- xxxx is the job number
- attempt_* will be different for different workers
- log-file can be stderr, stdout, or syslog
Typically you want to look at syslog for anything printed using log4j.
Metrics, if enabled, will show up in stderr.
If you're running distributed, each machine will log things to their local
disk. You can also get to the logs by going to (assuming your Hadoop files
are in ~/) ~/hadoop-x.y.z/logs/userlogs: the folders in here contain
symlinks to the directories above.
Young
On Tue, May 12, 2015 at 11:26 AM, Cheng Wang <su...@gmail.com>
wrote:
> Hello,
>
> I am sure if it is good to ask here.. I am new to Giraph.
> I found that in the example codes provided by Giraph package, there are
> many outputs are stored into log4j files... e.g.
> SimplePageRankComputation.java.
>
> I am wondering where are the log files stored in the log4j?
>
>
> Thanks
> Cheng
>