where do I see all hadoop logs?

[Mark Kerzner <ma...@gmail.com>]

Hi,

do all nodes send their System.out.println() logs to the same place in
Hadoop job console? I don't see the mixture I would expect.

Thank you,
Mark

Re: where do I see all hadoop logs?

[Jeff Hammerbacher <ha...@cloudera.com>]

Hey Mark,

You might find this blog post useful:
http://www.cloudera.com/blog/2009/09/apache-hadoop-log-files-where-to-find-them-in-cdh-and-what-info-they-contain/.
Given that it's a year old now, I expect it's out of date, but it might help
fill in some gaps.

Thanks,
Jeff

On Mon, Aug 30, 2010 at 1:51 PM, abhishek sharma <ab...@usc.edu> wrote:

> On Mon, Aug 30, 2010 at 1:43 PM, Mark Kerzner <ma...@gmail.com>
> wrote:
> > The statements are in my code. When I am running one node, I see them,
> but I
> > am not sure what happens when I am running more.
> >
>
> Do you see them in the ".out" files produced for each node?
>
> Abhishek
> > On Mon, Aug 30, 2010 at 3:41 PM, abhishek sharma <ab...@usc.edu>
> wrote:
> >
> >> Hi Mark,
> >>
> >> Are these print statements in the code of your job or the Hadoop
> >> components (JobTracker, TaskTracker, etc.)?
> >> Depending on where you place them, they might show up in the *.out
> >> files that are created along with the log files (and not show up on
> >> the console).
> >>
> >> Abhishek
> >>
> >>
> >> On Mon, Aug 30, 2010 at 1:35 PM, Mark Kerzner <ma...@gmail.com>
> >> wrote:
> >> > Hi,
> >> >
> >> > do all nodes send their System.out.println() logs to the same place in
> >> > Hadoop job console? I don't see the mixture I would expect.
> >> >
> >> > Thank you,
> >> > Mark
> >> >
> >>
> >
>

Re: where do I see all hadoop logs?

[abhishek sharma <ab...@usc.edu>]

On Mon, Aug 30, 2010 at 1:43 PM, Mark Kerzner <ma...@gmail.com> wrote:
> The statements are in my code. When I am running one node, I see them, but I
> am not sure what happens when I am running more.
>

Do you see them in the ".out" files produced for each node?

Abhishek
> On Mon, Aug 30, 2010 at 3:41 PM, abhishek sharma <ab...@usc.edu> wrote:
>
>> Hi Mark,
>>
>> Are these print statements in the code of your job or the Hadoop
>> components (JobTracker, TaskTracker, etc.)?
>> Depending on where you place them, they might show up in the *.out
>> files that are created along with the log files (and not show up on
>> the console).
>>
>> Abhishek
>>
>>
>> On Mon, Aug 30, 2010 at 1:35 PM, Mark Kerzner <ma...@gmail.com>
>> wrote:
>> > Hi,
>> >
>> > do all nodes send their System.out.println() logs to the same place in
>> > Hadoop job console? I don't see the mixture I would expect.
>> >
>> > Thank you,
>> > Mark
>> >
>>
>

Re: where do I see all hadoop logs?

[Mark Kerzner <ma...@gmail.com>]

The statements are in my code. When I am running one node, I see them, but I
am not sure what happens when I am running more.

On Mon, Aug 30, 2010 at 3:41 PM, abhishek sharma <ab...@usc.edu> wrote:

> Hi Mark,
>
> Are these print statements in the code of your job or the Hadoop
> components (JobTracker, TaskTracker, etc.)?
> Depending on where you place them, they might show up in the *.out
> files that are created along with the log files (and not show up on
> the console).
>
> Abhishek
>
>
> On Mon, Aug 30, 2010 at 1:35 PM, Mark Kerzner <ma...@gmail.com>
> wrote:
> > Hi,
> >
> > do all nodes send their System.out.println() logs to the same place in
> > Hadoop job console? I don't see the mixture I would expect.
> >
> > Thank you,
> > Mark
> >
>

Re: where do I see all hadoop logs?

[abhishek sharma <ab...@usc.edu>]

Hi Mark,

Are these print statements in the code of your job or the Hadoop
components (JobTracker, TaskTracker, etc.)?
Depending on where you place them, they might show up in the *.out
files that are created along with the log files (and not show up on
the console).

Abhishek


On Mon, Aug 30, 2010 at 1:35 PM, Mark Kerzner <ma...@gmail.com> wrote:
> Hi,
>
> do all nodes send their System.out.println() logs to the same place in
> Hadoop job console? I don't see the mixture I would expect.
>
> Thank you,
> Mark
>