You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Frank Lanitz <fr...@sql-ag.de> on 2015/01/28 14:39:58 UTC
How to debug why example not finishing (or even starting)
Hi,
I've got a simple 3-node-setup where I wanted to test the grep function
based on some examples. So
$ hadoop fs -put /home/hadoop/hadoop/etc/hadoop hadoop-config
$ hadoop jar
hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-*.jar grep
/user/hadoop/hadoop-config /user/hadoop/output 'dfs[a-z.]+'
When running this I've get
> 15/01/28 14:32:14 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> 15/01/28 14:32:15 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/<ip>:8032
> 15/01/28 14:32:15 WARN mapreduce.JobSubmitter: No job jar file set. User classes may not be found. See Job or Job#setJar(String).
> 15/01/28 14:32:15 INFO input.FileInputFormat: Total input paths to process : 30
> 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: number of splits:30
> 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1422451252723_0002
> 15/01/28 14:32:16 INFO mapred.YARNRunner: Job jar is not present. Not adding any jar to the list of resources.
> 15/01/28 14:32:16 INFO impl.YarnClientImpl: Submitted application application_1422451252723_0002
> 15/01/28 14:32:16 INFO mapreduce.Job: The url to track the job: http://hadoopm:8088/proxy/application_1422451252723_0002/
> 15/01/28 14:32:16 INFO mapreduce.Job: Running job: job_1422451252723_0002
and nothing more seems to happen. When checking
http://hadoopm:8088/cluster/apps I can see, that the job is accepted,
but in undefined state. However, when killing the job and restarting a
new one it might starts to work. Obviously something is not working well
here -- so I'm wondering how to debug what's going wrong here.
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Ravi Prakash <ra...@ymail.com>.
Do you have capacity on your cluster? Did you submit it to the right queue? Go to your scheduler page: http://YOUR-RESOURCE-MANAGER-HOSTNAME:8088/cluster/scheduler
On Thursday, January 29, 2015 4:48 AM, Frank Lanitz <fr...@sql-ag.de> wrote:
Hi,
Sorry for spamming the list. ;)
Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
> Job.setJarByClass is missing in the grep job.
>
> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>
> Did you run another example job (ex. PiEstimator)?
> Other example jobs are setting user classes by Job.setJarByClass.
> I'm thinking they would work in your environment.
Well, finally some of the other examples are working but seem to also
get stuck at some point.
E.g.
> $ hadoop jar /home/hadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar pi 16 100000
> Number of Maps = 16
> Samples per Map = 100000
> 15/01/29 13:38:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> Wrote input for Map #0
> Wrote input for Map #1
> Wrote input for Map #2
> Wrote input for Map #3
> Wrote input for Map #4
> Wrote input for Map #5
> Wrote input for Map #6
> Wrote input for Map #7
> Wrote input for Map #8
> Wrote input for Map #9
> Wrote input for Map #10
> Wrote input for Map #11
> Wrote input for Map #12
> Wrote input for Map #13
> Wrote input for Map #14
> Wrote input for Map #15
> Starting Job
> 15/01/29 13:38:19 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/192.168.20.235:8032
> 15/01/29 13:38:19 INFO input.FileInputFormat: Total input paths to process : 16
> 15/01/29 13:38:19 INFO mapreduce.JobSubmitter: number of splits:16
> 15/01/29 13:38:20 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1422524123097_0008
> 15/01/29 13:38:20 INFO impl.YarnClientImpl: Submitted application application_1422524123097_0008
> 15/01/29 13:38:20 INFO mapreduce.Job: The url to track the job: http://hadoopm:8088/proxy/application_1422524123097_0008/
> 15/01/29 13:38:20 INFO mapreduce.Job: Running job: job_1422524123097_0008
and then noting more happens. When checking the job-list it's saying
that it is still in prep mode:
> $ mapred job -list
> 15/01/29 13:45:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> 15/01/29 13:45:18 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/192.168.20.235:8032
> Total jobs:1
> JobId State StartTime UserName Queue Priority UsedContainers RsvdContainers UsedMem RsvdMem NeededMem AM info
> job_1422524123097_0008 PREP 1422535100215 hadoop default NORMAL 1 0 2048M 0M 2048M http://hadoopm:8088/proxy/application_1422524123097_0008/
So my original question is still active: Where I have to dig in to see,
why it's not starting. What am I looking for?
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Ravi Prakash <ra...@ymail.com>.
Do you have capacity on your cluster? Did you submit it to the right queue? Go to your scheduler page: http://YOUR-RESOURCE-MANAGER-HOSTNAME:8088/cluster/scheduler
On Thursday, January 29, 2015 4:48 AM, Frank Lanitz <fr...@sql-ag.de> wrote:
Hi,
Sorry for spamming the list. ;)
Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
> Job.setJarByClass is missing in the grep job.
>
> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>
> Did you run another example job (ex. PiEstimator)?
> Other example jobs are setting user classes by Job.setJarByClass.
> I'm thinking they would work in your environment.
Well, finally some of the other examples are working but seem to also
get stuck at some point.
E.g.
> $ hadoop jar /home/hadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar pi 16 100000
> Number of Maps = 16
> Samples per Map = 100000
> 15/01/29 13:38:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> Wrote input for Map #0
> Wrote input for Map #1
> Wrote input for Map #2
> Wrote input for Map #3
> Wrote input for Map #4
> Wrote input for Map #5
> Wrote input for Map #6
> Wrote input for Map #7
> Wrote input for Map #8
> Wrote input for Map #9
> Wrote input for Map #10
> Wrote input for Map #11
> Wrote input for Map #12
> Wrote input for Map #13
> Wrote input for Map #14
> Wrote input for Map #15
> Starting Job
> 15/01/29 13:38:19 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/192.168.20.235:8032
> 15/01/29 13:38:19 INFO input.FileInputFormat: Total input paths to process : 16
> 15/01/29 13:38:19 INFO mapreduce.JobSubmitter: number of splits:16
> 15/01/29 13:38:20 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1422524123097_0008
> 15/01/29 13:38:20 INFO impl.YarnClientImpl: Submitted application application_1422524123097_0008
> 15/01/29 13:38:20 INFO mapreduce.Job: The url to track the job: http://hadoopm:8088/proxy/application_1422524123097_0008/
> 15/01/29 13:38:20 INFO mapreduce.Job: Running job: job_1422524123097_0008
and then noting more happens. When checking the job-list it's saying
that it is still in prep mode:
> $ mapred job -list
> 15/01/29 13:45:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> 15/01/29 13:45:18 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/192.168.20.235:8032
> Total jobs:1
> JobId State StartTime UserName Queue Priority UsedContainers RsvdContainers UsedMem RsvdMem NeededMem AM info
> job_1422524123097_0008 PREP 1422535100215 hadoop default NORMAL 1 0 2048M 0M 2048M http://hadoopm:8088/proxy/application_1422524123097_0008/
So my original question is still active: Where I have to dig in to see,
why it's not starting. What am I looking for?
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Ravi Prakash <ra...@ymail.com>.
Do you have capacity on your cluster? Did you submit it to the right queue? Go to your scheduler page: http://YOUR-RESOURCE-MANAGER-HOSTNAME:8088/cluster/scheduler
On Thursday, January 29, 2015 4:48 AM, Frank Lanitz <fr...@sql-ag.de> wrote:
Hi,
Sorry for spamming the list. ;)
Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
> Job.setJarByClass is missing in the grep job.
>
> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>
> Did you run another example job (ex. PiEstimator)?
> Other example jobs are setting user classes by Job.setJarByClass.
> I'm thinking they would work in your environment.
Well, finally some of the other examples are working but seem to also
get stuck at some point.
E.g.
> $ hadoop jar /home/hadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar pi 16 100000
> Number of Maps = 16
> Samples per Map = 100000
> 15/01/29 13:38:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> Wrote input for Map #0
> Wrote input for Map #1
> Wrote input for Map #2
> Wrote input for Map #3
> Wrote input for Map #4
> Wrote input for Map #5
> Wrote input for Map #6
> Wrote input for Map #7
> Wrote input for Map #8
> Wrote input for Map #9
> Wrote input for Map #10
> Wrote input for Map #11
> Wrote input for Map #12
> Wrote input for Map #13
> Wrote input for Map #14
> Wrote input for Map #15
> Starting Job
> 15/01/29 13:38:19 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/192.168.20.235:8032
> 15/01/29 13:38:19 INFO input.FileInputFormat: Total input paths to process : 16
> 15/01/29 13:38:19 INFO mapreduce.JobSubmitter: number of splits:16
> 15/01/29 13:38:20 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1422524123097_0008
> 15/01/29 13:38:20 INFO impl.YarnClientImpl: Submitted application application_1422524123097_0008
> 15/01/29 13:38:20 INFO mapreduce.Job: The url to track the job: http://hadoopm:8088/proxy/application_1422524123097_0008/
> 15/01/29 13:38:20 INFO mapreduce.Job: Running job: job_1422524123097_0008
and then noting more happens. When checking the job-list it's saying
that it is still in prep mode:
> $ mapred job -list
> 15/01/29 13:45:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> 15/01/29 13:45:18 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/192.168.20.235:8032
> Total jobs:1
> JobId State StartTime UserName Queue Priority UsedContainers RsvdContainers UsedMem RsvdMem NeededMem AM info
> job_1422524123097_0008 PREP 1422535100215 hadoop default NORMAL 1 0 2048M 0M 2048M http://hadoopm:8088/proxy/application_1422524123097_0008/
So my original question is still active: Where I have to dig in to see,
why it's not starting. What am I looking for?
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Ravi Prakash <ra...@ymail.com>.
Do you have capacity on your cluster? Did you submit it to the right queue? Go to your scheduler page: http://YOUR-RESOURCE-MANAGER-HOSTNAME:8088/cluster/scheduler
On Thursday, January 29, 2015 4:48 AM, Frank Lanitz <fr...@sql-ag.de> wrote:
Hi,
Sorry for spamming the list. ;)
Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
> Job.setJarByClass is missing in the grep job.
>
> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>
> Did you run another example job (ex. PiEstimator)?
> Other example jobs are setting user classes by Job.setJarByClass.
> I'm thinking they would work in your environment.
Well, finally some of the other examples are working but seem to also
get stuck at some point.
E.g.
> $ hadoop jar /home/hadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar pi 16 100000
> Number of Maps = 16
> Samples per Map = 100000
> 15/01/29 13:38:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> Wrote input for Map #0
> Wrote input for Map #1
> Wrote input for Map #2
> Wrote input for Map #3
> Wrote input for Map #4
> Wrote input for Map #5
> Wrote input for Map #6
> Wrote input for Map #7
> Wrote input for Map #8
> Wrote input for Map #9
> Wrote input for Map #10
> Wrote input for Map #11
> Wrote input for Map #12
> Wrote input for Map #13
> Wrote input for Map #14
> Wrote input for Map #15
> Starting Job
> 15/01/29 13:38:19 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/192.168.20.235:8032
> 15/01/29 13:38:19 INFO input.FileInputFormat: Total input paths to process : 16
> 15/01/29 13:38:19 INFO mapreduce.JobSubmitter: number of splits:16
> 15/01/29 13:38:20 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1422524123097_0008
> 15/01/29 13:38:20 INFO impl.YarnClientImpl: Submitted application application_1422524123097_0008
> 15/01/29 13:38:20 INFO mapreduce.Job: The url to track the job: http://hadoopm:8088/proxy/application_1422524123097_0008/
> 15/01/29 13:38:20 INFO mapreduce.Job: Running job: job_1422524123097_0008
and then noting more happens. When checking the job-list it's saying
that it is still in prep mode:
> $ mapred job -list
> 15/01/29 13:45:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> 15/01/29 13:45:18 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/192.168.20.235:8032
> Total jobs:1
> JobId State StartTime UserName Queue Priority UsedContainers RsvdContainers UsedMem RsvdMem NeededMem AM info
> job_1422524123097_0008 PREP 1422535100215 hadoop default NORMAL 1 0 2048M 0M 2048M http://hadoopm:8088/proxy/application_1422524123097_0008/
So my original question is still active: Where I have to dig in to see,
why it's not starting. What am I looking for?
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Hi,
Sorry for spamming the list. ;)
Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
> Job.setJarByClass is missing in the grep job.
>
> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>
> Did you run another example job (ex. PiEstimator)?
> Other example jobs are setting user classes by Job.setJarByClass.
> I'm thinking they would work in your environment.
Well, finally some of the other examples are working but seem to also
get stuck at some point.
E.g.
> $ hadoop jar /home/hadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar pi 16 100000
> Number of Maps = 16
> Samples per Map = 100000
> 15/01/29 13:38:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> Wrote input for Map #0
> Wrote input for Map #1
> Wrote input for Map #2
> Wrote input for Map #3
> Wrote input for Map #4
> Wrote input for Map #5
> Wrote input for Map #6
> Wrote input for Map #7
> Wrote input for Map #8
> Wrote input for Map #9
> Wrote input for Map #10
> Wrote input for Map #11
> Wrote input for Map #12
> Wrote input for Map #13
> Wrote input for Map #14
> Wrote input for Map #15
> Starting Job
> 15/01/29 13:38:19 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/192.168.20.235:8032
> 15/01/29 13:38:19 INFO input.FileInputFormat: Total input paths to process : 16
> 15/01/29 13:38:19 INFO mapreduce.JobSubmitter: number of splits:16
> 15/01/29 13:38:20 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1422524123097_0008
> 15/01/29 13:38:20 INFO impl.YarnClientImpl: Submitted application application_1422524123097_0008
> 15/01/29 13:38:20 INFO mapreduce.Job: The url to track the job: http://hadoopm:8088/proxy/application_1422524123097_0008/
> 15/01/29 13:38:20 INFO mapreduce.Job: Running job: job_1422524123097_0008
and then noting more happens. When checking the job-list it's saying
that it is still in prep mode:
> $ mapred job -list
> 15/01/29 13:45:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> 15/01/29 13:45:18 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/192.168.20.235:8032
> Total jobs:1
> JobId State StartTime UserName Queue Priority UsedContainers RsvdContainers UsedMem RsvdMem NeededMem AM info
> job_1422524123097_0008 PREP 1422535100215 hadoop default NORMAL 1 0 2048M 0M 2048M http://hadoopm:8088/proxy/application_1422524123097_0008/
So my original question is still active: Where I have to dig in to see,
why it's not starting. What am I looking for?
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 29.01.2015 um 11:24 schrieb Frank Lanitz:
> Am 29.01.2015 um 11:12 schrieb Frank Lanitz:
>> Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
>>> Job.setJarByClass is missing in the grep job.
>>>
>>> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>>>
>>> Did you run another example job (ex. PiEstimator)? Other example
>>> jobs are setting user classes by Job.setJarByClass. I'm thinking
>>> they would work in your environment.
>>
>> Not yet, as I'm getting error messages such like "Not a valid jar".
>
> So actually:
>
>> hadoop@hadoopm:~$ hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar grep input output 'dfs[a-z.]+'
>> Not a valid JAR: /home/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar
>
> running on openJDk.
OK. At least this point Iw as able to solve. Stupid misstake by myself
(wrong path).
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 29.01.2015 um 11:24 schrieb Frank Lanitz:
> Am 29.01.2015 um 11:12 schrieb Frank Lanitz:
>> Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
>>> Job.setJarByClass is missing in the grep job.
>>>
>>> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>>>
>>> Did you run another example job (ex. PiEstimator)? Other example
>>> jobs are setting user classes by Job.setJarByClass. I'm thinking
>>> they would work in your environment.
>>
>> Not yet, as I'm getting error messages such like "Not a valid jar".
>
> So actually:
>
>> hadoop@hadoopm:~$ hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar grep input output 'dfs[a-z.]+'
>> Not a valid JAR: /home/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar
>
> running on openJDk.
OK. At least this point Iw as able to solve. Stupid misstake by myself
(wrong path).
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 29.01.2015 um 11:24 schrieb Frank Lanitz:
> Am 29.01.2015 um 11:12 schrieb Frank Lanitz:
>> Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
>>> Job.setJarByClass is missing in the grep job.
>>>
>>> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>>>
>>> Did you run another example job (ex. PiEstimator)? Other example
>>> jobs are setting user classes by Job.setJarByClass. I'm thinking
>>> they would work in your environment.
>>
>> Not yet, as I'm getting error messages such like "Not a valid jar".
>
> So actually:
>
>> hadoop@hadoopm:~$ hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar grep input output 'dfs[a-z.]+'
>> Not a valid JAR: /home/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar
>
> running on openJDk.
OK. At least this point Iw as able to solve. Stupid misstake by myself
(wrong path).
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 29.01.2015 um 11:24 schrieb Frank Lanitz:
> Am 29.01.2015 um 11:12 schrieb Frank Lanitz:
>> Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
>>> Job.setJarByClass is missing in the grep job.
>>>
>>> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>>>
>>> Did you run another example job (ex. PiEstimator)? Other example
>>> jobs are setting user classes by Job.setJarByClass. I'm thinking
>>> they would work in your environment.
>>
>> Not yet, as I'm getting error messages such like "Not a valid jar".
>
> So actually:
>
>> hadoop@hadoopm:~$ hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar grep input output 'dfs[a-z.]+'
>> Not a valid JAR: /home/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar
>
> running on openJDk.
OK. At least this point Iw as able to solve. Stupid misstake by myself
(wrong path).
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 29.01.2015 um 11:12 schrieb Frank Lanitz:
> Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
>> Job.setJarByClass is missing in the grep job.
>>
>> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>>
>> Did you run another example job (ex. PiEstimator)? Other example
>> jobs are setting user classes by Job.setJarByClass. I'm thinking
>> they would work in your environment.
>
> Not yet, as I'm getting error messages such like "Not a valid jar".
So actually:
> hadoop@hadoopm:~$ hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar grep input output 'dfs[a-z.]+'
> Not a valid JAR: /home/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar
running on openJDk.
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 29.01.2015 um 11:12 schrieb Frank Lanitz:
> Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
>> Job.setJarByClass is missing in the grep job.
>>
>> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>>
>> Did you run another example job (ex. PiEstimator)? Other example
>> jobs are setting user classes by Job.setJarByClass. I'm thinking
>> they would work in your environment.
>
> Not yet, as I'm getting error messages such like "Not a valid jar".
So actually:
> hadoop@hadoopm:~$ hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar grep input output 'dfs[a-z.]+'
> Not a valid JAR: /home/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar
running on openJDk.
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 29.01.2015 um 11:12 schrieb Frank Lanitz:
> Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
>> Job.setJarByClass is missing in the grep job.
>>
>> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>>
>> Did you run another example job (ex. PiEstimator)? Other example
>> jobs are setting user classes by Job.setJarByClass. I'm thinking
>> they would work in your environment.
>
> Not yet, as I'm getting error messages such like "Not a valid jar".
So actually:
> hadoop@hadoopm:~$ hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar grep input output 'dfs[a-z.]+'
> Not a valid JAR: /home/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar
running on openJDk.
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 29.01.2015 um 11:12 schrieb Frank Lanitz:
> Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
>> Job.setJarByClass is missing in the grep job.
>>
>> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>>
>> Did you run another example job (ex. PiEstimator)? Other example
>> jobs are setting user classes by Job.setJarByClass. I'm thinking
>> they would work in your environment.
>
> Not yet, as I'm getting error messages such like "Not a valid jar".
So actually:
> hadoop@hadoopm:~$ hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar grep input output 'dfs[a-z.]+'
> Not a valid JAR: /home/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar
running on openJDk.
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
> Job.setJarByClass is missing in the grep job.
>
> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>
> Did you run another example job (ex. PiEstimator)?
> Other example jobs are setting user classes by Job.setJarByClass.
> I'm thinking they would work in your environment.
Not yet, as I'm getting error messages such like "Not a valid jar".
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Hi,
Sorry for spamming the list. ;)
Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
> Job.setJarByClass is missing in the grep job.
>
> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>
> Did you run another example job (ex. PiEstimator)?
> Other example jobs are setting user classes by Job.setJarByClass.
> I'm thinking they would work in your environment.
Well, finally some of the other examples are working but seem to also
get stuck at some point.
E.g.
> $ hadoop jar /home/hadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar pi 16 100000
> Number of Maps = 16
> Samples per Map = 100000
> 15/01/29 13:38:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> Wrote input for Map #0
> Wrote input for Map #1
> Wrote input for Map #2
> Wrote input for Map #3
> Wrote input for Map #4
> Wrote input for Map #5
> Wrote input for Map #6
> Wrote input for Map #7
> Wrote input for Map #8
> Wrote input for Map #9
> Wrote input for Map #10
> Wrote input for Map #11
> Wrote input for Map #12
> Wrote input for Map #13
> Wrote input for Map #14
> Wrote input for Map #15
> Starting Job
> 15/01/29 13:38:19 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/192.168.20.235:8032
> 15/01/29 13:38:19 INFO input.FileInputFormat: Total input paths to process : 16
> 15/01/29 13:38:19 INFO mapreduce.JobSubmitter: number of splits:16
> 15/01/29 13:38:20 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1422524123097_0008
> 15/01/29 13:38:20 INFO impl.YarnClientImpl: Submitted application application_1422524123097_0008
> 15/01/29 13:38:20 INFO mapreduce.Job: The url to track the job: http://hadoopm:8088/proxy/application_1422524123097_0008/
> 15/01/29 13:38:20 INFO mapreduce.Job: Running job: job_1422524123097_0008
and then noting more happens. When checking the job-list it's saying
that it is still in prep mode:
> $ mapred job -list
> 15/01/29 13:45:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> 15/01/29 13:45:18 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/192.168.20.235:8032
> Total jobs:1
> JobId State StartTime UserName Queue Priority UsedContainers RsvdContainers UsedMem RsvdMem NeededMem AM info
> job_1422524123097_0008 PREP 1422535100215 hadoop default NORMAL 1 0 2048M 0M 2048M http://hadoopm:8088/proxy/application_1422524123097_0008/
So my original question is still active: Where I have to dig in to see,
why it's not starting. What am I looking for?
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
> Job.setJarByClass is missing in the grep job.
>
> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>
> Did you run another example job (ex. PiEstimator)?
> Other example jobs are setting user classes by Job.setJarByClass.
> I'm thinking they would work in your environment.
Not yet, as I'm getting error messages such like "Not a valid jar".
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
> Job.setJarByClass is missing in the grep job.
>
> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>
> Did you run another example job (ex. PiEstimator)?
> Other example jobs are setting user classes by Job.setJarByClass.
> I'm thinking they would work in your environment.
Not yet, as I'm getting error messages such like "Not a valid jar".
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
> Job.setJarByClass is missing in the grep job.
>
> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>
> Did you run another example job (ex. PiEstimator)?
> Other example jobs are setting user classes by Job.setJarByClass.
> I'm thinking they would work in your environment.
Not yet, as I'm getting error messages such like "Not a valid jar".
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Hi,
Sorry for spamming the list. ;)
Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
> Job.setJarByClass is missing in the grep job.
>
> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>
> Did you run another example job (ex. PiEstimator)?
> Other example jobs are setting user classes by Job.setJarByClass.
> I'm thinking they would work in your environment.
Well, finally some of the other examples are working but seem to also
get stuck at some point.
E.g.
> $ hadoop jar /home/hadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar pi 16 100000
> Number of Maps = 16
> Samples per Map = 100000
> 15/01/29 13:38:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> Wrote input for Map #0
> Wrote input for Map #1
> Wrote input for Map #2
> Wrote input for Map #3
> Wrote input for Map #4
> Wrote input for Map #5
> Wrote input for Map #6
> Wrote input for Map #7
> Wrote input for Map #8
> Wrote input for Map #9
> Wrote input for Map #10
> Wrote input for Map #11
> Wrote input for Map #12
> Wrote input for Map #13
> Wrote input for Map #14
> Wrote input for Map #15
> Starting Job
> 15/01/29 13:38:19 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/192.168.20.235:8032
> 15/01/29 13:38:19 INFO input.FileInputFormat: Total input paths to process : 16
> 15/01/29 13:38:19 INFO mapreduce.JobSubmitter: number of splits:16
> 15/01/29 13:38:20 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1422524123097_0008
> 15/01/29 13:38:20 INFO impl.YarnClientImpl: Submitted application application_1422524123097_0008
> 15/01/29 13:38:20 INFO mapreduce.Job: The url to track the job: http://hadoopm:8088/proxy/application_1422524123097_0008/
> 15/01/29 13:38:20 INFO mapreduce.Job: Running job: job_1422524123097_0008
and then noting more happens. When checking the job-list it's saying
that it is still in prep mode:
> $ mapred job -list
> 15/01/29 13:45:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> 15/01/29 13:45:18 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/192.168.20.235:8032
> Total jobs:1
> JobId State StartTime UserName Queue Priority UsedContainers RsvdContainers UsedMem RsvdMem NeededMem AM info
> job_1422524123097_0008 PREP 1422535100215 hadoop default NORMAL 1 0 2048M 0M 2048M http://hadoopm:8088/proxy/application_1422524123097_0008/
So my original question is still active: Where I have to dig in to see,
why it's not starting. What am I looking for?
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Hi,
Sorry for spamming the list. ;)
Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
> Job.setJarByClass is missing in the grep job.
>
> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>
> Did you run another example job (ex. PiEstimator)?
> Other example jobs are setting user classes by Job.setJarByClass.
> I'm thinking they would work in your environment.
Well, finally some of the other examples are working but seem to also
get stuck at some point.
E.g.
> $ hadoop jar /home/hadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar pi 16 100000
> Number of Maps = 16
> Samples per Map = 100000
> 15/01/29 13:38:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> Wrote input for Map #0
> Wrote input for Map #1
> Wrote input for Map #2
> Wrote input for Map #3
> Wrote input for Map #4
> Wrote input for Map #5
> Wrote input for Map #6
> Wrote input for Map #7
> Wrote input for Map #8
> Wrote input for Map #9
> Wrote input for Map #10
> Wrote input for Map #11
> Wrote input for Map #12
> Wrote input for Map #13
> Wrote input for Map #14
> Wrote input for Map #15
> Starting Job
> 15/01/29 13:38:19 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/192.168.20.235:8032
> 15/01/29 13:38:19 INFO input.FileInputFormat: Total input paths to process : 16
> 15/01/29 13:38:19 INFO mapreduce.JobSubmitter: number of splits:16
> 15/01/29 13:38:20 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1422524123097_0008
> 15/01/29 13:38:20 INFO impl.YarnClientImpl: Submitted application application_1422524123097_0008
> 15/01/29 13:38:20 INFO mapreduce.Job: The url to track the job: http://hadoopm:8088/proxy/application_1422524123097_0008/
> 15/01/29 13:38:20 INFO mapreduce.Job: Running job: job_1422524123097_0008
and then noting more happens. When checking the job-list it's saying
that it is still in prep mode:
> $ mapred job -list
> 15/01/29 13:45:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> 15/01/29 13:45:18 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/192.168.20.235:8032
> Total jobs:1
> JobId State StartTime UserName Queue Priority UsedContainers RsvdContainers UsedMem RsvdMem NeededMem AM info
> job_1422524123097_0008 PREP 1422535100215 hadoop default NORMAL 1 0 2048M 0M 2048M http://hadoopm:8088/proxy/application_1422524123097_0008/
So my original question is still active: Where I have to dig in to see,
why it's not starting. What am I looking for?
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
Job.setJarByClass is missing in the grep job.
https://issues.apache.org/jira/browse/MAPREDUCE-6231
Did you run another example job (ex. PiEstimator)?
Other example jobs are setting user classes by Job.setJarByClass.
I'm thinking they would work in your environment.
Regards,
Akira
On 1/29/15 04:09, Frank Lanitz wrote:
> Am 28.01.2015 um 19:00 schrieb Akira AJISAKA:
>
>> I reproduced the condition. It seems to be a bug.
>
> Can you please give the JIRA or describe what was triggering the thing?
>
> Cheers,
> Frank
>
Re: How to debug why example not finishing (or even starting)
Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
Job.setJarByClass is missing in the grep job.
https://issues.apache.org/jira/browse/MAPREDUCE-6231
Did you run another example job (ex. PiEstimator)?
Other example jobs are setting user classes by Job.setJarByClass.
I'm thinking they would work in your environment.
Regards,
Akira
On 1/29/15 04:09, Frank Lanitz wrote:
> Am 28.01.2015 um 19:00 schrieb Akira AJISAKA:
>
>> I reproduced the condition. It seems to be a bug.
>
> Can you please give the JIRA or describe what was triggering the thing?
>
> Cheers,
> Frank
>
Re: How to debug why example not finishing (or even starting)
Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
Job.setJarByClass is missing in the grep job.
https://issues.apache.org/jira/browse/MAPREDUCE-6231
Did you run another example job (ex. PiEstimator)?
Other example jobs are setting user classes by Job.setJarByClass.
I'm thinking they would work in your environment.
Regards,
Akira
On 1/29/15 04:09, Frank Lanitz wrote:
> Am 28.01.2015 um 19:00 schrieb Akira AJISAKA:
>
>> I reproduced the condition. It seems to be a bug.
>
> Can you please give the JIRA or describe what was triggering the thing?
>
> Cheers,
> Frank
>
Re: How to debug why example not finishing (or even starting)
Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
Job.setJarByClass is missing in the grep job.
https://issues.apache.org/jira/browse/MAPREDUCE-6231
Did you run another example job (ex. PiEstimator)?
Other example jobs are setting user classes by Job.setJarByClass.
I'm thinking they would work in your environment.
Regards,
Akira
On 1/29/15 04:09, Frank Lanitz wrote:
> Am 28.01.2015 um 19:00 schrieb Akira AJISAKA:
>
>> I reproduced the condition. It seems to be a bug.
>
> Can you please give the JIRA or describe what was triggering the thing?
>
> Cheers,
> Frank
>
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 28.01.2015 um 19:00 schrieb Akira AJISAKA:
> I reproduced the condition. It seems to be a bug.
Can you please give the JIRA or describe what was triggering the thing?
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 28.01.2015 um 19:00 schrieb Akira AJISAKA:
> I reproduced the condition. It seems to be a bug.
Can you please give the JIRA or describe what was triggering the thing?
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 28.01.2015 um 19:00 schrieb Akira AJISAKA:
> I reproduced the condition. It seems to be a bug.
Can you please give the JIRA or describe what was triggering the thing?
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 28.01.2015 um 19:00 schrieb Akira AJISAKA:
> I reproduced the condition. It seems to be a bug.
Can you please give the JIRA or describe what was triggering the thing?
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
Hi Frank,
I reproduced the condition. It seems to be a bug.
>> 15/01/28 14:32:15 WARN mapreduce.JobSubmitter: No job jar file set.
User classes may not be found. See Job or Job#setJar(String).
I found user classes are not set in Grep.java.
I'll file a jira and create a patch shortly.
Thanks,
Akira
On 1/28/15 22:39, Frank Lanitz wrote:
> Hi,
>
> I've got a simple 3-node-setup where I wanted to test the grep function
> based on some examples. So
>
> $ hadoop fs -put /home/hadoop/hadoop/etc/hadoop hadoop-config
> $ hadoop jar
> hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-*.jar grep
> /user/hadoop/hadoop-config /user/hadoop/output 'dfs[a-z.]+'
>
> When running this I've get
>
>> 15/01/28 14:32:14 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
>> 15/01/28 14:32:15 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/<ip>:8032
>> 15/01/28 14:32:15 WARN mapreduce.JobSubmitter: No job jar file set. User classes may not be found. See Job or Job#setJar(String).
>> 15/01/28 14:32:15 INFO input.FileInputFormat: Total input paths to process : 30
>> 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: number of splits:30
>> 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1422451252723_0002
>> 15/01/28 14:32:16 INFO mapred.YARNRunner: Job jar is not present. Not adding any jar to the list of resources.
>> 15/01/28 14:32:16 INFO impl.YarnClientImpl: Submitted application application_1422451252723_0002
>> 15/01/28 14:32:16 INFO mapreduce.Job: The url to track the job: http://hadoopm:8088/proxy/application_1422451252723_0002/
>> 15/01/28 14:32:16 INFO mapreduce.Job: Running job: job_1422451252723_0002
>
> and nothing more seems to happen. When checking
> http://hadoopm:8088/cluster/apps I can see, that the job is accepted,
> but in undefined state. However, when killing the job and restarting a
> new one it might starts to work. Obviously something is not working well
> here -- so I'm wondering how to debug what's going wrong here.
>
> Cheers,
> Frank
>
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 28.01.2015 um 20:14 schrieb Kiran Dangeti:
> Did you set the debug mode ??
Yes, I tried that by putting DEBUG into log4j.properties. Was hit by the
amount of output, but didn't found any usable one as I had no clue what
I was looking after.
However, after a little more searching around I've got the feeling that
this might could be related to some missing memory, as I'm only running
most of the nodes on some test virtual machines with <4GB of Ram. But
wasn't able to go ahead at this point.
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 28.01.2015 um 20:14 schrieb Kiran Dangeti:
> Did you set the debug mode ??
Yes, I tried that by putting DEBUG into log4j.properties. Was hit by the
amount of output, but didn't found any usable one as I had no clue what
I was looking after.
However, after a little more searching around I've got the feeling that
this might could be related to some missing memory, as I'm only running
most of the nodes on some test virtual machines with <4GB of Ram. But
wasn't able to go ahead at this point.
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 28.01.2015 um 20:14 schrieb Kiran Dangeti:
> Did you set the debug mode ??
Yes, I tried that by putting DEBUG into log4j.properties. Was hit by the
amount of output, but didn't found any usable one as I had no clue what
I was looking after.
However, after a little more searching around I've got the feeling that
this might could be related to some missing memory, as I'm only running
most of the nodes on some test virtual machines with <4GB of Ram. But
wasn't able to go ahead at this point.
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 28.01.2015 um 20:14 schrieb Kiran Dangeti:
> Did you set the debug mode ??
Yes, I tried that by putting DEBUG into log4j.properties. Was hit by the
amount of output, but didn't found any usable one as I had no clue what
I was looking after.
However, after a little more searching around I've got the feeling that
this might could be related to some missing memory, as I'm only running
most of the nodes on some test virtual machines with <4GB of Ram. But
wasn't able to go ahead at this point.
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Kiran Dangeti <ki...@gmail.com>.
Frank,
Did you set the debug mode ??
On Jan 28, 2015 7:10 PM, "Frank Lanitz" <fr...@sql-ag.de> wrote:
> Hi,
>
> I've got a simple 3-node-setup where I wanted to test the grep function
> based on some examples. So
>
> $ hadoop fs -put /home/hadoop/hadoop/etc/hadoop hadoop-config
> $ hadoop jar
> hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-*.jar grep
> /user/hadoop/hadoop-config /user/hadoop/output 'dfs[a-z.]+'
>
> When running this I've get
>
> > 15/01/28 14:32:14 WARN util.NativeCodeLoader: Unable to load
> native-hadoop library for your platform... using builtin-java classes where
> applicable
> > 15/01/28 14:32:15 INFO client.RMProxy: Connecting to ResourceManager at
> hadoopm/<ip>:8032
> > 15/01/28 14:32:15 WARN mapreduce.JobSubmitter: No job jar file set.
> User classes may not be found. See Job or Job#setJar(String).
> > 15/01/28 14:32:15 INFO input.FileInputFormat: Total input paths to
> process : 30
> > 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: number of splits:30
> > 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: Submitting tokens for
> job: job_1422451252723_0002
> > 15/01/28 14:32:16 INFO mapred.YARNRunner: Job jar is not present. Not
> adding any jar to the list of resources.
> > 15/01/28 14:32:16 INFO impl.YarnClientImpl: Submitted application
> application_1422451252723_0002
> > 15/01/28 14:32:16 INFO mapreduce.Job: The url to track the job:
> http://hadoopm:8088/proxy/application_1422451252723_0002/
> > 15/01/28 14:32:16 INFO mapreduce.Job: Running job: job_1422451252723_0002
>
> and nothing more seems to happen. When checking
> http://hadoopm:8088/cluster/apps I can see, that the job is accepted,
> but in undefined state. However, when killing the job and restarting a
> new one it might starts to work. Obviously something is not working well
> here -- so I'm wondering how to debug what's going wrong here.
>
> Cheers,
> Frank
>
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 28.01.2015 um 14:39 schrieb Frank Lanitz:
> Hi,
>
> I've got a simple 3-node-setup where I wanted to test the grep function
> based on some examples. So
>
> $ hadoop fs -put /home/hadoop/hadoop/etc/hadoop hadoop-config
> $ hadoop jar
> hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-*.jar grep
> /user/hadoop/hadoop-config /user/hadoop/output 'dfs[a-z.]+'
>
> When running this I've get
>
>> 15/01/28 14:32:14 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
>> 15/01/28 14:32:15 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/<ip>:8032
>> 15/01/28 14:32:15 WARN mapreduce.JobSubmitter: No job jar file set. User classes may not be found. See Job or Job#setJar(String).
>> 15/01/28 14:32:15 INFO input.FileInputFormat: Total input paths to process : 30
>> 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: number of splits:30
>> 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1422451252723_0002
>> 15/01/28 14:32:16 INFO mapred.YARNRunner: Job jar is not present. Not adding any jar to the list of resources.
>> 15/01/28 14:32:16 INFO impl.YarnClientImpl: Submitted application application_1422451252723_0002
>> 15/01/28 14:32:16 INFO mapreduce.Job: The url to track the job: http://hadoopm:8088/proxy/application_1422451252723_0002/
>> 15/01/28 14:32:16 INFO mapreduce.Job: Running job: job_1422451252723_0002
>
> and nothing more seems to happen. When checking
> http://hadoopm:8088/cluster/apps I can see, that the job is accepted,
> but in undefined state. However, when killing the job and restarting a
> new one it might starts to work. Obviously something is not working well
> here -- so I'm wondering how to debug what's going wrong here.
At least I was able to figure out one part of the reasons behind:
The bigger nodes inside my test cluster wasn't properly configured
inside DNS so name resolving failed at process of assigning a job to
this box. I was able to find this by digging into ResouceManager-Logfile
after enabling debug level for log4j checking for exceptions.
However, this is not solving my complete issue, because it appears that
still the other nodes of the cluster are not getting recognized of being
able to process some part of the data.
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 28.01.2015 um 14:39 schrieb Frank Lanitz:
> Hi,
>
> I've got a simple 3-node-setup where I wanted to test the grep function
> based on some examples. So
>
> $ hadoop fs -put /home/hadoop/hadoop/etc/hadoop hadoop-config
> $ hadoop jar
> hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-*.jar grep
> /user/hadoop/hadoop-config /user/hadoop/output 'dfs[a-z.]+'
>
> When running this I've get
>
>> 15/01/28 14:32:14 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
>> 15/01/28 14:32:15 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/<ip>:8032
>> 15/01/28 14:32:15 WARN mapreduce.JobSubmitter: No job jar file set. User classes may not be found. See Job or Job#setJar(String).
>> 15/01/28 14:32:15 INFO input.FileInputFormat: Total input paths to process : 30
>> 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: number of splits:30
>> 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1422451252723_0002
>> 15/01/28 14:32:16 INFO mapred.YARNRunner: Job jar is not present. Not adding any jar to the list of resources.
>> 15/01/28 14:32:16 INFO impl.YarnClientImpl: Submitted application application_1422451252723_0002
>> 15/01/28 14:32:16 INFO mapreduce.Job: The url to track the job: http://hadoopm:8088/proxy/application_1422451252723_0002/
>> 15/01/28 14:32:16 INFO mapreduce.Job: Running job: job_1422451252723_0002
>
> and nothing more seems to happen. When checking
> http://hadoopm:8088/cluster/apps I can see, that the job is accepted,
> but in undefined state. However, when killing the job and restarting a
> new one it might starts to work. Obviously something is not working well
> here -- so I'm wondering how to debug what's going wrong here.
At least I was able to figure out one part of the reasons behind:
The bigger nodes inside my test cluster wasn't properly configured
inside DNS so name resolving failed at process of assigning a job to
this box. I was able to find this by digging into ResouceManager-Logfile
after enabling debug level for log4j checking for exceptions.
However, this is not solving my complete issue, because it appears that
still the other nodes of the cluster are not getting recognized of being
able to process some part of the data.
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
Hi Frank,
I reproduced the condition. It seems to be a bug.
>> 15/01/28 14:32:15 WARN mapreduce.JobSubmitter: No job jar file set.
User classes may not be found. See Job or Job#setJar(String).
I found user classes are not set in Grep.java.
I'll file a jira and create a patch shortly.
Thanks,
Akira
On 1/28/15 22:39, Frank Lanitz wrote:
> Hi,
>
> I've got a simple 3-node-setup where I wanted to test the grep function
> based on some examples. So
>
> $ hadoop fs -put /home/hadoop/hadoop/etc/hadoop hadoop-config
> $ hadoop jar
> hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-*.jar grep
> /user/hadoop/hadoop-config /user/hadoop/output 'dfs[a-z.]+'
>
> When running this I've get
>
>> 15/01/28 14:32:14 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
>> 15/01/28 14:32:15 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/<ip>:8032
>> 15/01/28 14:32:15 WARN mapreduce.JobSubmitter: No job jar file set. User classes may not be found. See Job or Job#setJar(String).
>> 15/01/28 14:32:15 INFO input.FileInputFormat: Total input paths to process : 30
>> 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: number of splits:30
>> 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1422451252723_0002
>> 15/01/28 14:32:16 INFO mapred.YARNRunner: Job jar is not present. Not adding any jar to the list of resources.
>> 15/01/28 14:32:16 INFO impl.YarnClientImpl: Submitted application application_1422451252723_0002
>> 15/01/28 14:32:16 INFO mapreduce.Job: The url to track the job: http://hadoopm:8088/proxy/application_1422451252723_0002/
>> 15/01/28 14:32:16 INFO mapreduce.Job: Running job: job_1422451252723_0002
>
> and nothing more seems to happen. When checking
> http://hadoopm:8088/cluster/apps I can see, that the job is accepted,
> but in undefined state. However, when killing the job and restarting a
> new one it might starts to work. Obviously something is not working well
> here -- so I'm wondering how to debug what's going wrong here.
>
> Cheers,
> Frank
>
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 28.01.2015 um 14:39 schrieb Frank Lanitz:
> Hi,
>
> I've got a simple 3-node-setup where I wanted to test the grep function
> based on some examples. So
>
> $ hadoop fs -put /home/hadoop/hadoop/etc/hadoop hadoop-config
> $ hadoop jar
> hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-*.jar grep
> /user/hadoop/hadoop-config /user/hadoop/output 'dfs[a-z.]+'
>
> When running this I've get
>
>> 15/01/28 14:32:14 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
>> 15/01/28 14:32:15 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/<ip>:8032
>> 15/01/28 14:32:15 WARN mapreduce.JobSubmitter: No job jar file set. User classes may not be found. See Job or Job#setJar(String).
>> 15/01/28 14:32:15 INFO input.FileInputFormat: Total input paths to process : 30
>> 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: number of splits:30
>> 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1422451252723_0002
>> 15/01/28 14:32:16 INFO mapred.YARNRunner: Job jar is not present. Not adding any jar to the list of resources.
>> 15/01/28 14:32:16 INFO impl.YarnClientImpl: Submitted application application_1422451252723_0002
>> 15/01/28 14:32:16 INFO mapreduce.Job: The url to track the job: http://hadoopm:8088/proxy/application_1422451252723_0002/
>> 15/01/28 14:32:16 INFO mapreduce.Job: Running job: job_1422451252723_0002
>
> and nothing more seems to happen. When checking
> http://hadoopm:8088/cluster/apps I can see, that the job is accepted,
> but in undefined state. However, when killing the job and restarting a
> new one it might starts to work. Obviously something is not working well
> here -- so I'm wondering how to debug what's going wrong here.
At least I was able to figure out one part of the reasons behind:
The bigger nodes inside my test cluster wasn't properly configured
inside DNS so name resolving failed at process of assigning a job to
this box. I was able to find this by digging into ResouceManager-Logfile
after enabling debug level for log4j checking for exceptions.
However, this is not solving my complete issue, because it appears that
still the other nodes of the cluster are not getting recognized of being
able to process some part of the data.
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
Hi Frank,
I reproduced the condition. It seems to be a bug.
>> 15/01/28 14:32:15 WARN mapreduce.JobSubmitter: No job jar file set.
User classes may not be found. See Job or Job#setJar(String).
I found user classes are not set in Grep.java.
I'll file a jira and create a patch shortly.
Thanks,
Akira
On 1/28/15 22:39, Frank Lanitz wrote:
> Hi,
>
> I've got a simple 3-node-setup where I wanted to test the grep function
> based on some examples. So
>
> $ hadoop fs -put /home/hadoop/hadoop/etc/hadoop hadoop-config
> $ hadoop jar
> hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-*.jar grep
> /user/hadoop/hadoop-config /user/hadoop/output 'dfs[a-z.]+'
>
> When running this I've get
>
>> 15/01/28 14:32:14 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
>> 15/01/28 14:32:15 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/<ip>:8032
>> 15/01/28 14:32:15 WARN mapreduce.JobSubmitter: No job jar file set. User classes may not be found. See Job or Job#setJar(String).
>> 15/01/28 14:32:15 INFO input.FileInputFormat: Total input paths to process : 30
>> 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: number of splits:30
>> 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1422451252723_0002
>> 15/01/28 14:32:16 INFO mapred.YARNRunner: Job jar is not present. Not adding any jar to the list of resources.
>> 15/01/28 14:32:16 INFO impl.YarnClientImpl: Submitted application application_1422451252723_0002
>> 15/01/28 14:32:16 INFO mapreduce.Job: The url to track the job: http://hadoopm:8088/proxy/application_1422451252723_0002/
>> 15/01/28 14:32:16 INFO mapreduce.Job: Running job: job_1422451252723_0002
>
> and nothing more seems to happen. When checking
> http://hadoopm:8088/cluster/apps I can see, that the job is accepted,
> but in undefined state. However, when killing the job and restarting a
> new one it might starts to work. Obviously something is not working well
> here -- so I'm wondering how to debug what's going wrong here.
>
> Cheers,
> Frank
>
Re: How to debug why example not finishing (or even starting)
Posted by Frank Lanitz <fr...@sql-ag.de>.
Am 28.01.2015 um 14:39 schrieb Frank Lanitz:
> Hi,
>
> I've got a simple 3-node-setup where I wanted to test the grep function
> based on some examples. So
>
> $ hadoop fs -put /home/hadoop/hadoop/etc/hadoop hadoop-config
> $ hadoop jar
> hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-*.jar grep
> /user/hadoop/hadoop-config /user/hadoop/output 'dfs[a-z.]+'
>
> When running this I've get
>
>> 15/01/28 14:32:14 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
>> 15/01/28 14:32:15 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/<ip>:8032
>> 15/01/28 14:32:15 WARN mapreduce.JobSubmitter: No job jar file set. User classes may not be found. See Job or Job#setJar(String).
>> 15/01/28 14:32:15 INFO input.FileInputFormat: Total input paths to process : 30
>> 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: number of splits:30
>> 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1422451252723_0002
>> 15/01/28 14:32:16 INFO mapred.YARNRunner: Job jar is not present. Not adding any jar to the list of resources.
>> 15/01/28 14:32:16 INFO impl.YarnClientImpl: Submitted application application_1422451252723_0002
>> 15/01/28 14:32:16 INFO mapreduce.Job: The url to track the job: http://hadoopm:8088/proxy/application_1422451252723_0002/
>> 15/01/28 14:32:16 INFO mapreduce.Job: Running job: job_1422451252723_0002
>
> and nothing more seems to happen. When checking
> http://hadoopm:8088/cluster/apps I can see, that the job is accepted,
> but in undefined state. However, when killing the job and restarting a
> new one it might starts to work. Obviously something is not working well
> here -- so I'm wondering how to debug what's going wrong here.
At least I was able to figure out one part of the reasons behind:
The bigger nodes inside my test cluster wasn't properly configured
inside DNS so name resolving failed at process of assigning a job to
this box. I was able to find this by digging into ResouceManager-Logfile
after enabling debug level for log4j checking for exceptions.
However, this is not solving my complete issue, because it appears that
still the other nodes of the cluster are not getting recognized of being
able to process some part of the data.
Cheers,
Frank
Re: How to debug why example not finishing (or even starting)
Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
Hi Frank,
I reproduced the condition. It seems to be a bug.
>> 15/01/28 14:32:15 WARN mapreduce.JobSubmitter: No job jar file set.
User classes may not be found. See Job or Job#setJar(String).
I found user classes are not set in Grep.java.
I'll file a jira and create a patch shortly.
Thanks,
Akira
On 1/28/15 22:39, Frank Lanitz wrote:
> Hi,
>
> I've got a simple 3-node-setup where I wanted to test the grep function
> based on some examples. So
>
> $ hadoop fs -put /home/hadoop/hadoop/etc/hadoop hadoop-config
> $ hadoop jar
> hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-*.jar grep
> /user/hadoop/hadoop-config /user/hadoop/output 'dfs[a-z.]+'
>
> When running this I've get
>
>> 15/01/28 14:32:14 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
>> 15/01/28 14:32:15 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/<ip>:8032
>> 15/01/28 14:32:15 WARN mapreduce.JobSubmitter: No job jar file set. User classes may not be found. See Job or Job#setJar(String).
>> 15/01/28 14:32:15 INFO input.FileInputFormat: Total input paths to process : 30
>> 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: number of splits:30
>> 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1422451252723_0002
>> 15/01/28 14:32:16 INFO mapred.YARNRunner: Job jar is not present. Not adding any jar to the list of resources.
>> 15/01/28 14:32:16 INFO impl.YarnClientImpl: Submitted application application_1422451252723_0002
>> 15/01/28 14:32:16 INFO mapreduce.Job: The url to track the job: http://hadoopm:8088/proxy/application_1422451252723_0002/
>> 15/01/28 14:32:16 INFO mapreduce.Job: Running job: job_1422451252723_0002
>
> and nothing more seems to happen. When checking
> http://hadoopm:8088/cluster/apps I can see, that the job is accepted,
> but in undefined state. However, when killing the job and restarting a
> new one it might starts to work. Obviously something is not working well
> here -- so I'm wondering how to debug what's going wrong here.
>
> Cheers,
> Frank
>
Re: How to debug why example not finishing (or even starting)
Posted by Kiran Dangeti <ki...@gmail.com>.
Frank,
Did you set the debug mode ??
On Jan 28, 2015 7:10 PM, "Frank Lanitz" <fr...@sql-ag.de> wrote:
> Hi,
>
> I've got a simple 3-node-setup where I wanted to test the grep function
> based on some examples. So
>
> $ hadoop fs -put /home/hadoop/hadoop/etc/hadoop hadoop-config
> $ hadoop jar
> hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-*.jar grep
> /user/hadoop/hadoop-config /user/hadoop/output 'dfs[a-z.]+'
>
> When running this I've get
>
> > 15/01/28 14:32:14 WARN util.NativeCodeLoader: Unable to load
> native-hadoop library for your platform... using builtin-java classes where
> applicable
> > 15/01/28 14:32:15 INFO client.RMProxy: Connecting to ResourceManager at
> hadoopm/<ip>:8032
> > 15/01/28 14:32:15 WARN mapreduce.JobSubmitter: No job jar file set.
> User classes may not be found. See Job or Job#setJar(String).
> > 15/01/28 14:32:15 INFO input.FileInputFormat: Total input paths to
> process : 30
> > 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: number of splits:30
> > 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: Submitting tokens for
> job: job_1422451252723_0002
> > 15/01/28 14:32:16 INFO mapred.YARNRunner: Job jar is not present. Not
> adding any jar to the list of resources.
> > 15/01/28 14:32:16 INFO impl.YarnClientImpl: Submitted application
> application_1422451252723_0002
> > 15/01/28 14:32:16 INFO mapreduce.Job: The url to track the job:
> http://hadoopm:8088/proxy/application_1422451252723_0002/
> > 15/01/28 14:32:16 INFO mapreduce.Job: Running job: job_1422451252723_0002
>
> and nothing more seems to happen. When checking
> http://hadoopm:8088/cluster/apps I can see, that the job is accepted,
> but in undefined state. However, when killing the job and restarting a
> new one it might starts to work. Obviously something is not working well
> here -- so I'm wondering how to debug what's going wrong here.
>
> Cheers,
> Frank
>
Re: How to debug why example not finishing (or even starting)
Posted by Kiran Dangeti <ki...@gmail.com>.
Frank,
Did you set the debug mode ??
On Jan 28, 2015 7:10 PM, "Frank Lanitz" <fr...@sql-ag.de> wrote:
> Hi,
>
> I've got a simple 3-node-setup where I wanted to test the grep function
> based on some examples. So
>
> $ hadoop fs -put /home/hadoop/hadoop/etc/hadoop hadoop-config
> $ hadoop jar
> hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-*.jar grep
> /user/hadoop/hadoop-config /user/hadoop/output 'dfs[a-z.]+'
>
> When running this I've get
>
> > 15/01/28 14:32:14 WARN util.NativeCodeLoader: Unable to load
> native-hadoop library for your platform... using builtin-java classes where
> applicable
> > 15/01/28 14:32:15 INFO client.RMProxy: Connecting to ResourceManager at
> hadoopm/<ip>:8032
> > 15/01/28 14:32:15 WARN mapreduce.JobSubmitter: No job jar file set.
> User classes may not be found. See Job or Job#setJar(String).
> > 15/01/28 14:32:15 INFO input.FileInputFormat: Total input paths to
> process : 30
> > 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: number of splits:30
> > 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: Submitting tokens for
> job: job_1422451252723_0002
> > 15/01/28 14:32:16 INFO mapred.YARNRunner: Job jar is not present. Not
> adding any jar to the list of resources.
> > 15/01/28 14:32:16 INFO impl.YarnClientImpl: Submitted application
> application_1422451252723_0002
> > 15/01/28 14:32:16 INFO mapreduce.Job: The url to track the job:
> http://hadoopm:8088/proxy/application_1422451252723_0002/
> > 15/01/28 14:32:16 INFO mapreduce.Job: Running job: job_1422451252723_0002
>
> and nothing more seems to happen. When checking
> http://hadoopm:8088/cluster/apps I can see, that the job is accepted,
> but in undefined state. However, when killing the job and restarting a
> new one it might starts to work. Obviously something is not working well
> here -- so I'm wondering how to debug what's going wrong here.
>
> Cheers,
> Frank
>
Re: How to debug why example not finishing (or even starting)
Posted by Kiran Dangeti <ki...@gmail.com>.
Frank,
Did you set the debug mode ??
On Jan 28, 2015 7:10 PM, "Frank Lanitz" <fr...@sql-ag.de> wrote:
> Hi,
>
> I've got a simple 3-node-setup where I wanted to test the grep function
> based on some examples. So
>
> $ hadoop fs -put /home/hadoop/hadoop/etc/hadoop hadoop-config
> $ hadoop jar
> hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-*.jar grep
> /user/hadoop/hadoop-config /user/hadoop/output 'dfs[a-z.]+'
>
> When running this I've get
>
> > 15/01/28 14:32:14 WARN util.NativeCodeLoader: Unable to load
> native-hadoop library for your platform... using builtin-java classes where
> applicable
> > 15/01/28 14:32:15 INFO client.RMProxy: Connecting to ResourceManager at
> hadoopm/<ip>:8032
> > 15/01/28 14:32:15 WARN mapreduce.JobSubmitter: No job jar file set.
> User classes may not be found. See Job or Job#setJar(String).
> > 15/01/28 14:32:15 INFO input.FileInputFormat: Total input paths to
> process : 30
> > 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: number of splits:30
> > 15/01/28 14:32:16 INFO mapreduce.JobSubmitter: Submitting tokens for
> job: job_1422451252723_0002
> > 15/01/28 14:32:16 INFO mapred.YARNRunner: Job jar is not present. Not
> adding any jar to the list of resources.
> > 15/01/28 14:32:16 INFO impl.YarnClientImpl: Submitted application
> application_1422451252723_0002
> > 15/01/28 14:32:16 INFO mapreduce.Job: The url to track the job:
> http://hadoopm:8088/proxy/application_1422451252723_0002/
> > 15/01/28 14:32:16 INFO mapreduce.Job: Running job: job_1422451252723_0002
>
> and nothing more seems to happen. When checking
> http://hadoopm:8088/cluster/apps I can see, that the job is accepted,
> but in undefined state. However, when killing the job and restarting a
> new one it might starts to work. Obviously something is not working well
> here -- so I'm wondering how to debug what's going wrong here.
>
> Cheers,
> Frank
>