You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@chukwa.apache.org by Ying Tang <iv...@gmail.com> on 2011/08/26 05:38:11 UTC
chukwa agent stopped collecting log
Hi Eric,
I met with two problems.
1. Chukwa agent suddenly stopped again. After checking the agent log , we
found these logs
2011-08-26 00:42:16,589 ERROR Thread-1 PidFile - Delete pid file,
No such file or directory: /tmp/chukwa/pidDir/Agent.pid
2011-08-26 00:42:16,598 ERROR Thread-1 PidFile - Delete pid file
failed, /tmp/chukwa/pidDir/Agent.pid
Which circumstance would cause these logs?
2. The chukwa agent was still on , but it stopped collecting log.
2011-08-26 11:10:49,807 WARN Thread-2 FileTailingAdaptor -
bufferRead == MAX_READ_SIZE AND bytesUsed == 0, dropping current buffer:
startOffset=26653892, MAX_READ_SIZE=131072, for /var/log/gamelog
2011-08-26 11:10:51,817 WARN Thread-2 FileTailingAdaptor -
bufferRead == MAX_READ_SIZE AND bytesUsed == 0, dropping current buffer:
startOffset=26784964, MAX_READ_SIZE=131072, for /var/log/gamelog
2011-08-26 11:10:53,826 WARN Thread-2 FileTailingAdaptor -
bufferRead == MAX_READ_SIZE AND bytesUsed == 0, dropping current buffer:
startOffset=26916036, MAX_READ_SIZE=131072, for /var/log/gamelog
2011-08-26 11:10:54,881 INFO Timer-1 HttpConnector - # http chunks
ACK'ed since last report: 19
--
Best regards,
Ivy Tang
Re: chukwa agent stopped collecting log
Posted by Ying Tang <iv...@gmail.com>.
And after i restart the chukwa agent ,the log
2011-08-26 11:10:49,807 WARN Thread-2 FileTailingAdaptor -
bufferRead == MAX_READ_SIZE AND bytesUsed == 0, dropping current buffer:
startOffset=26653892, MAX_READ_SIZE=131072, for /var/log/gamelog
appeared frequently . Once it appeared , i only can restart the chukwa
agent.
On Fri, Aug 26, 2011 at 11:38 AM, Ying Tang <iv...@gmail.com> wrote:
>
> Hi Eric,
>
> I met with two problems.
> 1. Chukwa agent suddenly stopped again. After checking the agent log ,
> we found these logs
> 2011-08-26 00:42:16,589 ERROR Thread-1 PidFile - Delete pid
> file, No such file or directory: /tmp/chukwa/pidDir/Agent.pid
> 2011-08-26 00:42:16,598 ERROR Thread-1 PidFile - Delete pid file
> failed, /tmp/chukwa/pidDir/Agent.pid
> Which circumstance would cause these logs?
>
> 2. The chukwa agent was still on , but it stopped collecting log.
> 2011-08-26 11:10:49,807 WARN Thread-2 FileTailingAdaptor -
> bufferRead == MAX_READ_SIZE AND bytesUsed == 0, dropping current buffer:
> startOffset=26653892, MAX_READ_SIZE=131072, for /var/log/gamelog
> 2011-08-26 11:10:51,817 WARN Thread-2 FileTailingAdaptor -
> bufferRead == MAX_READ_SIZE AND bytesUsed == 0, dropping current buffer:
> startOffset=26784964, MAX_READ_SIZE=131072, for /var/log/gamelog
> 2011-08-26 11:10:53,826 WARN Thread-2 FileTailingAdaptor -
> bufferRead == MAX_READ_SIZE AND bytesUsed == 0, dropping current buffer:
> startOffset=26916036, MAX_READ_SIZE=131072, for /var/log/gamelog
> 2011-08-26 11:10:54,881 INFO Timer-1 HttpConnector - # http
> chunks ACK'ed since last report: 19
>
> --
> Best regards,
>
> Ivy Tang
>
>
>
>
--
Best regards,
Ivy Tang
Re: chukwa agent stopped collecting log
Posted by Eric Yang <er...@gmail.com>.
Hi Ivy,
1. configure CHUKWA_PID_DIR to some where outside of /tmp directory to ensure the pid file doesn't get removed by the OS.
2. Chukwa has a predefined limit for chukwaAgent.fileTailingAdaptor.maxReadSize to be 128kb. It looks like you have entry longer than 128kb. You can increase the number to 1024000 in chukwa-agent-conf.xml file, and see if this helps.
regards,
Eric
On Aug 25, 2011, at 8:38 PM, Ying Tang wrote:
>
> Hi Eric,
>
> I met with two problems.
> 1. Chukwa agent suddenly stopped again. After checking the agent log , we found these logs
> 2011-08-26 00:42:16,589 ERROR Thread-1 PidFile - Delete pid file, No such file or directory: /tmp/chukwa/pidDir/Agent.pid
> 2011-08-26 00:42:16,598 ERROR Thread-1 PidFile - Delete pid file failed, /tmp/chukwa/pidDir/Agent.pid
> Which circumstance would cause these logs?
>
> 2. The chukwa agent was still on , but it stopped collecting log.
> 2011-08-26 11:10:49,807 WARN Thread-2 FileTailingAdaptor - bufferRead == MAX_READ_SIZE AND bytesUsed == 0, dropping current buffer: startOffset=26653892, MAX_READ_SIZE=131072, for /var/log/gamelog
> 2011-08-26 11:10:51,817 WARN Thread-2 FileTailingAdaptor - bufferRead == MAX_READ_SIZE AND bytesUsed == 0, dropping current buffer: startOffset=26784964, MAX_READ_SIZE=131072, for /var/log/gamelog
> 2011-08-26 11:10:53,826 WARN Thread-2 FileTailingAdaptor - bufferRead == MAX_READ_SIZE AND bytesUsed == 0, dropping current buffer: startOffset=26916036, MAX_READ_SIZE=131072, for /var/log/gamelog
> 2011-08-26 11:10:54,881 INFO Timer-1 HttpConnector - # http chunks ACK'ed since last report: 19
>
> --
> Best regards,
>
> Ivy Tang
>
>
>