You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@chukwa.apache.org by Corbin Hoenes <co...@tynt.com> on 2010/02/01 17:28:59 UTC
Re: Config files
Kim,
When you tail your logs/collector.log file do you see any exceptions or does it look like the collector is up and running? Those messages would help figure out what is wrong.
Once issue I had was to setup iptables to allow a connection to my collectors over port 8080. Once I did that I could curl http://10.1.1.101:8080/chukwa?ping=true (where ip or hostname is your collector) to know that it was "up".
From there you can configure a test agent to tail a file and just append some text into that file to see it get sent over. Tailing collector.log to watch it all happen.
Here is my conf/chukwa-collector-conf.xml:
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>writer.hdfs.filesystem</name>
<value>hdfs://10.1.1.100:8020/</value>
<description>HDFS to dump to (e.g. matches your hdfs config in hadoop)</description>
</property>
<property>
<name>chukwaCollector.outputDir</name>
<value>/chukwa/logs/</value>
<description>Chukwa data sink directory</description>
</property>
<property>
<name>chukwaCollector.rotateInterval</name>
<value>300000</value>
<description>Chukwa rotate interval (ms)</description>
</property>
<property>
<name>chukwaCollector.http.port</name>
<value>8080</value>
<description>The HTTP port number the collector will listen on</description>
</property>
</configuration>
On Jan 29, 2010, at 4:25 PM, Kim Vogt wrote:
> Hi Ari,
>
> I'm trying to set up chukwa on the same cluster from which it's monitoring.
> The files I've been modifying include: chukwa-env.sh,
> chukwa-collector-conf.xml, the collectors file and the initial_adaptors
> file. I can't seem to get the collectors working as I can't access them
> with the browser. I'm thinking it might be something I messed up in the
> config files and if I see some examples I might figure out the problem.
>
> -Kim
>
> On 1/28/10 4:22 PM, "Ariel Rabkin" <as...@gmail.com> wrote:
>
>> Howdy!
>>
>> It's certainly not crazy talk. I think I can tar up and make
>> available some of the ones we use on my site. But I don't know how
>> interesting they'll be. Mostly, we just leave things at the defaults.
>>
>> Can you say a bit about what configuration aspects you think examples
>> would help?
>>
>> --Ari
>>
>> On Thu, Jan 28, 2010 at 4:13 PM, Kim Vogt <vo...@llnl.gov> wrote:
>>> Is anyone willing to share their config files, or is that just crazy talk?
>>> Perhaps there’s some examples buried on the interwebs?
>>>
>>> -Kim
>>
>>
>
>