You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by Steven Wong <sw...@netflix.com> on 2010/09/26 08:27:09 UTC
Logging level
How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG?
Thanks.
Steven
RE: Logging level
Posted by Steven Wong <sw...@netflix.com>.
Hmm, it doesn't seem possible before MAPREDUCE-336 is fixed.
-----Original Message-----
From: Steven Wong [mailto:swong@netflix.com]
Sent: Monday, September 27, 2010 10:31 AM
To: hive-user@hadoop.apache.org
Cc: <hi...@hadoop.apache.org>
Subject: RE: Logging level
Yes, I need a way to change the logging level of map/reduce tasks for the jobs of my Hive query, without affecting the logging level of other jobs or Hadoop daemons. How do I set hadoop.root.logger to do that?
-----Original Message-----
From: Shrijeet Paliwal [mailto:shrijeet@rocketfuel.com]
Sent: Sunday, September 26, 2010 1:51 AM
To: hive-user@hadoop.apache.org
Cc: <hi...@hadoop.apache.org>
Subject: Re: Logging level
You need to set hadoop looging level to debug if you are looking at
map task logs. I guess hadoop.root.logger is your friend.
On Sun, Sep 26, 2010 at 12:06 AM, Steven Wong <sw...@netflix.com> wrote:
>
> Tried your suggestion, but it still logs at INFO level in /mnt/var/log/hadoop/userlogs/attempt_201008140123_5752_m_000018_0/syslog. Am I looking in the wrong file?
>
>
>
>
>
> From: Ning Zhang [mailto:nzhang@facebook.com]
> Sent: Saturday, September 25, 2010 11:45 PM
> To: <hi...@hadoop.apache.org>
> Cc: <hi...@hadoop.apache.org>
> Subject: Re: Logging level
>
>
>
> hive -hiveconf hive.root.logger=DEBUG,DRFA
>
>
>
> On Sep 25, 2010, at 11:27 PM, Steven Wong wrote:
>
> How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG?
>
>
>
> Thanks.
>
> Steven
>
>
>
>
RE: Logging level
Posted by Steven Wong <sw...@netflix.com>.
Hmm, it doesn't seem possible before MAPREDUCE-336 is fixed.
-----Original Message-----
From: Steven Wong [mailto:swong@netflix.com]
Sent: Monday, September 27, 2010 10:31 AM
To: hive-user@hadoop.apache.org
Cc: <hi...@hadoop.apache.org>
Subject: RE: Logging level
Yes, I need a way to change the logging level of map/reduce tasks for the jobs of my Hive query, without affecting the logging level of other jobs or Hadoop daemons. How do I set hadoop.root.logger to do that?
-----Original Message-----
From: Shrijeet Paliwal [mailto:shrijeet@rocketfuel.com]
Sent: Sunday, September 26, 2010 1:51 AM
To: hive-user@hadoop.apache.org
Cc: <hi...@hadoop.apache.org>
Subject: Re: Logging level
You need to set hadoop looging level to debug if you are looking at
map task logs. I guess hadoop.root.logger is your friend.
On Sun, Sep 26, 2010 at 12:06 AM, Steven Wong <sw...@netflix.com> wrote:
>
> Tried your suggestion, but it still logs at INFO level in /mnt/var/log/hadoop/userlogs/attempt_201008140123_5752_m_000018_0/syslog. Am I looking in the wrong file?
>
>
>
>
>
> From: Ning Zhang [mailto:nzhang@facebook.com]
> Sent: Saturday, September 25, 2010 11:45 PM
> To: <hi...@hadoop.apache.org>
> Cc: <hi...@hadoop.apache.org>
> Subject: Re: Logging level
>
>
>
> hive -hiveconf hive.root.logger=DEBUG,DRFA
>
>
>
> On Sep 25, 2010, at 11:27 PM, Steven Wong wrote:
>
> How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG?
>
>
>
> Thanks.
>
> Steven
>
>
>
>
RE: Logging level
Posted by Steven Wong <sw...@netflix.com>.
Yes, I need a way to change the logging level of map/reduce tasks for the jobs of my Hive query, without affecting the logging level of other jobs or Hadoop daemons. How do I set hadoop.root.logger to do that?
-----Original Message-----
From: Shrijeet Paliwal [mailto:shrijeet@rocketfuel.com]
Sent: Sunday, September 26, 2010 1:51 AM
To: hive-user@hadoop.apache.org
Cc: <hi...@hadoop.apache.org>
Subject: Re: Logging level
You need to set hadoop looging level to debug if you are looking at
map task logs. I guess hadoop.root.logger is your friend.
On Sun, Sep 26, 2010 at 12:06 AM, Steven Wong <sw...@netflix.com> wrote:
>
> Tried your suggestion, but it still logs at INFO level in /mnt/var/log/hadoop/userlogs/attempt_201008140123_5752_m_000018_0/syslog. Am I looking in the wrong file?
>
>
>
>
>
> From: Ning Zhang [mailto:nzhang@facebook.com]
> Sent: Saturday, September 25, 2010 11:45 PM
> To: <hi...@hadoop.apache.org>
> Cc: <hi...@hadoop.apache.org>
> Subject: Re: Logging level
>
>
>
> hive -hiveconf hive.root.logger=DEBUG,DRFA
>
>
>
> On Sep 25, 2010, at 11:27 PM, Steven Wong wrote:
>
> How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG?
>
>
>
> Thanks.
>
> Steven
>
>
>
>
Re: Logging level
Posted by Narendra <un...@gmail.com>.
Hi,
I have a similar problem -
I need to control the logging level and log file path for Hive (and Pig) at
runtime from my shell script. Is there a way I could do that?
Cheers!
On Sun, Sep 26, 2010 at 2:20 PM, Shrijeet Paliwal
<sh...@rocketfuel.com>wrote:
> You need to set hadoop looging level to debug if you are looking at
> map task logs. I guess hadoop.root.logger is your friend.
>
> On Sun, Sep 26, 2010 at 12:06 AM, Steven Wong <sw...@netflix.com> wrote:
> >
> > Tried your suggestion, but it still logs at INFO level in
> /mnt/var/log/hadoop/userlogs/attempt_201008140123_5752_m_000018_0/syslog. Am
> I looking in the wrong file?
> >
> >
> >
> >
> >
> > From: Ning Zhang [mailto:nzhang@facebook.com]
> > Sent: Saturday, September 25, 2010 11:45 PM
> > To: <hi...@hadoop.apache.org>
> > Cc: <hi...@hadoop.apache.org>
> > Subject: Re: Logging level
> >
> >
> >
> > hive -hiveconf hive.root.logger=DEBUG,DRFA
> >
> >
> >
> > On Sep 25, 2010, at 11:27 PM, Steven Wong wrote:
> >
> > How can I control the logging level of Hive code that runs in the
> mappers/reducers? For example, how to set it to DEBUG?
> >
> >
> >
> > Thanks.
> >
> > Steven
> >
> >
> >
> >
>
RE: Logging level
Posted by Steven Wong <sw...@netflix.com>.
Yes, I need a way to change the logging level of map/reduce tasks for the jobs of my Hive query, without affecting the logging level of other jobs or Hadoop daemons. How do I set hadoop.root.logger to do that?
-----Original Message-----
From: Shrijeet Paliwal [mailto:shrijeet@rocketfuel.com]
Sent: Sunday, September 26, 2010 1:51 AM
To: hive-user@hadoop.apache.org
Cc: <hi...@hadoop.apache.org>
Subject: Re: Logging level
You need to set hadoop looging level to debug if you are looking at
map task logs. I guess hadoop.root.logger is your friend.
On Sun, Sep 26, 2010 at 12:06 AM, Steven Wong <sw...@netflix.com> wrote:
>
> Tried your suggestion, but it still logs at INFO level in /mnt/var/log/hadoop/userlogs/attempt_201008140123_5752_m_000018_0/syslog. Am I looking in the wrong file?
>
>
>
>
>
> From: Ning Zhang [mailto:nzhang@facebook.com]
> Sent: Saturday, September 25, 2010 11:45 PM
> To: <hi...@hadoop.apache.org>
> Cc: <hi...@hadoop.apache.org>
> Subject: Re: Logging level
>
>
>
> hive -hiveconf hive.root.logger=DEBUG,DRFA
>
>
>
> On Sep 25, 2010, at 11:27 PM, Steven Wong wrote:
>
> How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG?
>
>
>
> Thanks.
>
> Steven
>
>
>
>
Re: Logging level
Posted by Shrijeet Paliwal <sh...@rocketfuel.com>.
You need to set hadoop looging level to debug if you are looking at
map task logs. I guess hadoop.root.logger is your friend.
On Sun, Sep 26, 2010 at 12:06 AM, Steven Wong <sw...@netflix.com> wrote:
>
> Tried your suggestion, but it still logs at INFO level in /mnt/var/log/hadoop/userlogs/attempt_201008140123_5752_m_000018_0/syslog. Am I looking in the wrong file?
>
>
>
>
>
> From: Ning Zhang [mailto:nzhang@facebook.com]
> Sent: Saturday, September 25, 2010 11:45 PM
> To: <hi...@hadoop.apache.org>
> Cc: <hi...@hadoop.apache.org>
> Subject: Re: Logging level
>
>
>
> hive -hiveconf hive.root.logger=DEBUG,DRFA
>
>
>
> On Sep 25, 2010, at 11:27 PM, Steven Wong wrote:
>
> How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG?
>
>
>
> Thanks.
>
> Steven
>
>
>
>
RE: Logging level
Posted by Steven Wong <sw...@netflix.com>.
Tried your suggestion, but it still logs at INFO level in /mnt/var/log/hadoop/userlogs/attempt_201008140123_5752_m_000018_0/syslog. Am I looking in the wrong file?
From: Ning Zhang [mailto:nzhang@facebook.com]
Sent: Saturday, September 25, 2010 11:45 PM
To: <hi...@hadoop.apache.org>
Cc: <hi...@hadoop.apache.org>
Subject: Re: Logging level
hive -hiveconf hive.root.logger=DEBUG,DRFA
On Sep 25, 2010, at 11:27 PM, Steven Wong wrote:
How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG?
Thanks.
Steven
RE: Logging level
Posted by Steven Wong <sw...@netflix.com>.
Tried your suggestion, but it still logs at INFO level in /mnt/var/log/hadoop/userlogs/attempt_201008140123_5752_m_000018_0/syslog. Am I looking in the wrong file?
From: Ning Zhang [mailto:nzhang@facebook.com]
Sent: Saturday, September 25, 2010 11:45 PM
To: <hi...@hadoop.apache.org>
Cc: <hi...@hadoop.apache.org>
Subject: Re: Logging level
hive -hiveconf hive.root.logger=DEBUG,DRFA
On Sep 25, 2010, at 11:27 PM, Steven Wong wrote:
How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG?
Thanks.
Steven
Re: Logging level
Posted by Ning Zhang <nz...@facebook.com>.
hive -hiveconf hive.root.logger=DEBUG,DRFA
On Sep 25, 2010, at 11:27 PM, Steven Wong wrote:
How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG?
Thanks.
Steven
Re: Logging level
Posted by Ning Zhang <nz...@facebook.com>.
hive -hiveconf hive.root.logger=DEBUG,DRFA
On Sep 25, 2010, at 11:27 PM, Steven Wong wrote:
How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG?
Thanks.
Steven