You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@chukwa.apache.org by Mohammad Tariq <do...@gmail.com> on 2011/11/21 08:40:37 UTC
Using Chukwa on windows
Could anyone just provide me the outline on how to collect files
stored on a windows machine through a Chukwa setup on a linux
machine???What could be the necessary steps???
Many thanks in advance.
Regards,
Mohammad Tariq
Re: Using Chukwa on windows
Posted by Eric Yang <er...@gmail.com>.
>From the stack trace, it looks like the classpath to chukwa jar file
is not setup properly.
Can you check the shell script to make sure that the class path is
setup properly for shell expansion?
Try running:
bash -x bin/chukwa collector
And verify the classpath construction is correct on cygwin.
regards,
Eric
On Mon, Nov 21, 2011 at 4:20 AM, Mohammad Tariq <do...@gmail.com> wrote:
> I am trying to collect simple text files using FileTailer and trying
> to dump them into the HDFS. I have configured Hadoop and Chukwa on a
> linux machine and on a windows machine using cygwin..Is there anything
> specific that i need?? I can'i find log files in the log directory,
> only " .out " files are there. Also in the pidDir I am not able to
> find agent.pid and collector.pid files.Here is the contents of "
> chukwa-chukwa-agent-blr-ws-201.out " file -
>
> java.lang.NoClassDefFoundError:
> org/apache/hadoop/chukwa/datacollection/agent/ChukwaAgent
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.chukwa.datacollection.agent.ChukwaAgent
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> Could not find the main class:
> org.apache.hadoop.chukwa.datacollection.agent.ChukwaAgent. Program
> will exit.
> Exception in thread "main"
>
> And the " chukwa-chukwa-collector-blr-ws-201.out " file has -
> java.lang.NoClassDefFoundError:
> org/apache/hadoop/chukwa/datacollection/collector/CollectorStub
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.chukwa.datacollection.collector.CollectorStub
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> Could not find the main class:
> org.apache.hadoop.chukwa.datacollection.collector.CollectorStub.
> Program will exit.
> Exception in thread "main"
>
> Regards,
> Mohammad Tariq
>
>
>
> On Mon, Nov 21, 2011 at 5:35 PM, AD <st...@gmail.com> wrote:
>> what type of files? have you tried just using a normal windows path in your
>> initial_adaptors, like d:\setup\...
>> i dont think windows supports "tail" so not sure about the windows support
>> if thats what you are trying to do .
>>
>> On Mon, Nov 21, 2011 at 2:40 AM, Mohammad Tariq <do...@gmail.com> wrote:
>>>
>>> Could anyone just provide me the outline on how to collect files
>>> stored on a windows machine through a Chukwa setup on a linux
>>> machine???What could be the necessary steps???
>>> Many thanks in advance.
>>>
>>> Regards,
>>> Mohammad Tariq
>>
>>
>
Re: Using Chukwa on windows
Posted by Mohammad Tariq <do...@gmail.com>.
I am trying to collect simple text files using FileTailer and trying
to dump them into the HDFS. I have configured Hadoop and Chukwa on a
linux machine and on a windows machine using cygwin..Is there anything
specific that i need?? I can'i find log files in the log directory,
only " .out " files are there. Also in the pidDir I am not able to
find agent.pid and collector.pid files.Here is the contents of "
chukwa-chukwa-agent-blr-ws-201.out " file -
java.lang.NoClassDefFoundError:
org/apache/hadoop/chukwa/datacollection/agent/ChukwaAgent
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.chukwa.datacollection.agent.ChukwaAgent
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Could not find the main class:
org.apache.hadoop.chukwa.datacollection.agent.ChukwaAgent. Program
will exit.
Exception in thread "main"
And the " chukwa-chukwa-collector-blr-ws-201.out " file has -
java.lang.NoClassDefFoundError:
org/apache/hadoop/chukwa/datacollection/collector/CollectorStub
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.chukwa.datacollection.collector.CollectorStub
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Could not find the main class:
org.apache.hadoop.chukwa.datacollection.collector.CollectorStub.
Program will exit.
Exception in thread "main"
Regards,
Mohammad Tariq
On Mon, Nov 21, 2011 at 5:35 PM, AD <st...@gmail.com> wrote:
> what type of files? have you tried just using a normal windows path in your
> initial_adaptors, like d:\setup\...
> i dont think windows supports "tail" so not sure about the windows support
> if thats what you are trying to do .
>
> On Mon, Nov 21, 2011 at 2:40 AM, Mohammad Tariq <do...@gmail.com> wrote:
>>
>> Could anyone just provide me the outline on how to collect files
>> stored on a windows machine through a Chukwa setup on a linux
>> machine???What could be the necessary steps???
>> Many thanks in advance.
>>
>> Regards,
>> Mohammad Tariq
>
>
Re: Using Chukwa on windows
Posted by AD <st...@gmail.com>.
what type of files? have you tried just using a normal windows path in
your initial_adaptors, like d:\setup\...
i dont think windows supports "tail" so not sure about the windows support
if thats what you are trying to do .
On Mon, Nov 21, 2011 at 2:40 AM, Mohammad Tariq <do...@gmail.com> wrote:
> Could anyone just provide me the outline on how to collect files
> stored on a windows machine through a Chukwa setup on a linux
> machine???What could be the necessary steps???
> Many thanks in advance.
>
> Regards,
> Mohammad Tariq
>