You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@chukwa.apache.org by Eric Yang <ey...@yahoo-inc.com> on 2009/12/13 22:13:01 UTC

Configuration for Chukwa Collector Writer

Hi all,

I plan to write some widgets for real time monitoring for small cluster.  As
I recall, there were some writers that have been implemented to mirror data
and send to different writers.  I don't have full knowledge of how to
configure writers. Could someone show me how to use the existing
SocketTeeWriter and PipelineStageWriter?

Regards,
Eric

Re: Configuration for Chukwa Collector Writer

Posted by Eric Yang <ey...@yahoo-inc.com>.
Looks very easy.  I will try this out.
Thanks Thushara.

Regards,
Eric

On 12/13/09 1:26 PM, "Thushara Wijeratna" <th...@gmail.com> wrote:

> the conf/chukwa-collector-conf.xml should have something like this:
> 
>  <property>
>    <name>chukwaCollector.writerClass</name>
>    
> <value>org.apache.hadoop.chukwa.datacollection.writer.PipelineStageWriter</val
> ue>
>  </property>
> 
>  <property>
>    <name>chukwaCollector.pipeline</name>
>    
> <value>org.apache.hadoop.chukwa.datacollection.writer.SocketTeeWriter</value>
>  </property>
> 
> SocketTeeWriter writes the data to a socket. You'd be writing a
> different program to listen to the socket and read this data in real
> time.
> 
> thx,
> thushara
> 
> On Sun, Dec 13, 2009 at 1:13 PM, Eric Yang <ey...@yahoo-inc.com> wrote:
>> Hi all,
>> 
>> I plan to write some widgets for real time monitoring for small cluster.  As
>> I recall, there were some writers that have been implemented to mirror data
>> and send to different writers.  I don't have full knowledge of how to
>> configure writers. Could someone show me how to use the existing
>> SocketTeeWriter and PipelineStageWriter?
>> 
>> Regards,
>> Eric
>> 
>>

Re: Configuration for Chukwa Collector Writer

Posted by Thushara Wijeratna <th...@gmail.com>.
the conf/chukwa-collector-conf.xml should have something like this:

 <property>
   <name>chukwaCollector.writerClass</name>
   <value>org.apache.hadoop.chukwa.datacollection.writer.PipelineStageWriter</value>
 </property>

 <property>
   <name>chukwaCollector.pipeline</name>
   <value>org.apache.hadoop.chukwa.datacollection.writer.SocketTeeWriter</value>
 </property>

SocketTeeWriter writes the data to a socket. You'd be writing a
different program to listen to the socket and read this data in real
time.

thx,
thushara

On Sun, Dec 13, 2009 at 1:13 PM, Eric Yang <ey...@yahoo-inc.com> wrote:
> Hi all,
>
> I plan to write some widgets for real time monitoring for small cluster.  As
> I recall, there were some writers that have been implemented to mirror data
> and send to different writers.  I don't have full knowledge of how to
> configure writers. Could someone show me how to use the existing
> SocketTeeWriter and PipelineStageWriter?
>
> Regards,
> Eric
>
>