You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@chukwa.apache.org by Corbin Hoenes <co...@tynt.com> on 2010/02/01 17:28:59 UTC

Re: Config files

Kim,  

When you tail your logs/collector.log file do you see any exceptions or does it look like the collector is up and running?  Those messages would help figure out what is wrong.

Once issue I had was to setup iptables to allow a connection to my collectors over port 8080.  Once I did that I could curl http://10.1.1.101:8080/chukwa?ping=true (where ip or hostname is your collector) to know that it was "up".

From there you can configure a test agent to tail a file and just append some text into that file to see it get sent over.  Tailing collector.log to watch it all happen.

Here is my conf/chukwa-collector-conf.xml:

<!-- Put site-specific property overrides in this file. -->

<configuration>

  <property>
    <name>writer.hdfs.filesystem</name>
    <value>hdfs://10.1.1.100:8020/</value>
    <description>HDFS to dump to (e.g. matches your hdfs config in hadoop)</description>
  </property>
  
  <property>
    <name>chukwaCollector.outputDir</name>
    <value>/chukwa/logs/</value>
    <description>Chukwa data sink directory</description>
  </property>

  <property>
    <name>chukwaCollector.rotateInterval</name>
    <value>300000</value>
    <description>Chukwa rotate interval (ms)</description>
  </property>

  <property>
    <name>chukwaCollector.http.port</name>
    <value>8080</value>
    <description>The HTTP port number the collector will listen on</description>
  </property>

</configuration>

On Jan 29, 2010, at 4:25 PM, Kim Vogt wrote:

> Hi Ari,
> 
> I'm trying to set up chukwa on the same cluster from which it's monitoring.
> The files I've been modifying include: chukwa-env.sh,
> chukwa-collector-conf.xml, the collectors file and the initial_adaptors
> file.  I can't seem to get the collectors working as I can't access them
> with the browser.  I'm thinking it might be something I messed up in the
> config files and if I see some examples I might figure out the problem.
> 
> -Kim
> 
> On 1/28/10 4:22 PM, "Ariel Rabkin" <as...@gmail.com> wrote:
> 
>> Howdy!
>> 
>> It's certainly not crazy talk.  I think I can tar up and make
>> available some of the ones we use on my site.  But I don't know how
>> interesting they'll be.  Mostly, we just leave things at the defaults.
>> 
>> Can you say a bit about what configuration aspects you think examples
>> would help?
>> 
>> --Ari
>> 
>> On Thu, Jan 28, 2010 at 4:13 PM, Kim Vogt <vo...@llnl.gov> wrote:
>>> Is anyone willing to share their config files, or is that just crazy talk?
>>>  Perhaps there’s some examples buried on the interwebs?
>>> 
>>> -Kim
>> 
>> 
> 
>