You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Anand Murali <an...@yahoo.com> on 2015/04/28 08:40:24 UTC
Beginner Hadoop Code
Dear All:
I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit 2.6. When I run though I get runtime exception.
anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar MaxTemperature /user/anand_vihar/max/input output
15/04/28 11:46:57 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process : 1
15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local117348325_0001
15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job: http://localhost:8080/
15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in config null
15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task: attempt_local117348325_0001_m_000000_0
15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
java.lang.Exception: java.lang.RuntimeException: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at java.lang.Class.getConstructor0(Class.java:2892)
at java.lang.Class.getDeclaredConstructor(Class.java:2058)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
... 8 more
15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running in uber mode : false
15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed with state FAILED due to: NA
15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
The job, mapper and reducer class is packaged in the jar before deployment. Can somebody here explain.
Thanks
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
Re: Beginner Hadoop Code
Posted by Chris Mawata <ch...@gmail.com>.
Great! Good luck with your exploration.
Chris
On Apr 28, 2015 9:30 AM, "Anand Murali" <an...@yahoo.com> wrote:
> Many thanks Chris. It works.
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
> On Tuesday, April 28, 2015 4:53 PM, Chris Mawata <ch...@gmail.com>
> wrote:
>
>
> Looks like the framework is having difficulty instantiating your Mapper.
> The problem is probably because you made it an instance inner class. Make
> it a static nested class
> public static class MaxTemperatureMapper ...
> and the same for your reducer
>
> On Tue, Apr 28, 2015 at 4:27 AM, Anand Murali <an...@yahoo.com>
> wrote:
>
> Rudra:
>
> Request you to be more specific. Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
> On Tuesday, April 28, 2015 1:14 PM, Rudra Tripathy <ru...@gmail.com>
> wrote:
>
>
> Please check max temperature format
> On Apr 28, 2015 12:14 PM, "Anand Murali" <an...@yahoo.com> wrote:
>
> Dear All:
>
> I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit
> 2.6. When I run though I get runtime exception.
>
> anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar
> MaxTemperature /user/anand_vihar/max/input output
> 15/04/28 11:46:57 INFO Configuration.deprecation: session.id is
> deprecated. Instead, use dfs.metrics.session-id
> 15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> processName=JobTracker, sessionId=
> 15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option
> parsing not performed. Implement the Tool interface and execute your
> application with ToolRunner to remedy this.
> 15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process
> : 1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_local117348325_0001
> 15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job:
> http://localhost:8080/
> 15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in
> config null
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task:
> attempt_local117348325_0001_m_000000_0
> 15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree :
> [ ]
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
> 15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
> java.lang.Exception: java.lang.RuntimeException:
> java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
> Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at java.lang.Class.getConstructor0(Class.java:2892)
> at java.lang.Class.getDeclaredConstructor(Class.java:2058)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
> ... 8 more
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running
> in uber mode : false
> 15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed
> with state FAILED due to: NA
> 15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
>
> The job, mapper and reducer class is packaged in the jar before
> deployment. Can somebody here explain.
>
> Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
>
>
>
>
Re: Beginner Hadoop Code
Posted by Chris Mawata <ch...@gmail.com>.
Great! Good luck with your exploration.
Chris
On Apr 28, 2015 9:30 AM, "Anand Murali" <an...@yahoo.com> wrote:
> Many thanks Chris. It works.
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
> On Tuesday, April 28, 2015 4:53 PM, Chris Mawata <ch...@gmail.com>
> wrote:
>
>
> Looks like the framework is having difficulty instantiating your Mapper.
> The problem is probably because you made it an instance inner class. Make
> it a static nested class
> public static class MaxTemperatureMapper ...
> and the same for your reducer
>
> On Tue, Apr 28, 2015 at 4:27 AM, Anand Murali <an...@yahoo.com>
> wrote:
>
> Rudra:
>
> Request you to be more specific. Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
> On Tuesday, April 28, 2015 1:14 PM, Rudra Tripathy <ru...@gmail.com>
> wrote:
>
>
> Please check max temperature format
> On Apr 28, 2015 12:14 PM, "Anand Murali" <an...@yahoo.com> wrote:
>
> Dear All:
>
> I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit
> 2.6. When I run though I get runtime exception.
>
> anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar
> MaxTemperature /user/anand_vihar/max/input output
> 15/04/28 11:46:57 INFO Configuration.deprecation: session.id is
> deprecated. Instead, use dfs.metrics.session-id
> 15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> processName=JobTracker, sessionId=
> 15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option
> parsing not performed. Implement the Tool interface and execute your
> application with ToolRunner to remedy this.
> 15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process
> : 1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_local117348325_0001
> 15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job:
> http://localhost:8080/
> 15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in
> config null
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task:
> attempt_local117348325_0001_m_000000_0
> 15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree :
> [ ]
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
> 15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
> java.lang.Exception: java.lang.RuntimeException:
> java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
> Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at java.lang.Class.getConstructor0(Class.java:2892)
> at java.lang.Class.getDeclaredConstructor(Class.java:2058)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
> ... 8 more
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running
> in uber mode : false
> 15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed
> with state FAILED due to: NA
> 15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
>
> The job, mapper and reducer class is packaged in the jar before
> deployment. Can somebody here explain.
>
> Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
>
>
>
>
Re: Beginner Hadoop Code
Posted by Chris Mawata <ch...@gmail.com>.
Great! Good luck with your exploration.
Chris
On Apr 28, 2015 9:30 AM, "Anand Murali" <an...@yahoo.com> wrote:
> Many thanks Chris. It works.
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
> On Tuesday, April 28, 2015 4:53 PM, Chris Mawata <ch...@gmail.com>
> wrote:
>
>
> Looks like the framework is having difficulty instantiating your Mapper.
> The problem is probably because you made it an instance inner class. Make
> it a static nested class
> public static class MaxTemperatureMapper ...
> and the same for your reducer
>
> On Tue, Apr 28, 2015 at 4:27 AM, Anand Murali <an...@yahoo.com>
> wrote:
>
> Rudra:
>
> Request you to be more specific. Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
> On Tuesday, April 28, 2015 1:14 PM, Rudra Tripathy <ru...@gmail.com>
> wrote:
>
>
> Please check max temperature format
> On Apr 28, 2015 12:14 PM, "Anand Murali" <an...@yahoo.com> wrote:
>
> Dear All:
>
> I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit
> 2.6. When I run though I get runtime exception.
>
> anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar
> MaxTemperature /user/anand_vihar/max/input output
> 15/04/28 11:46:57 INFO Configuration.deprecation: session.id is
> deprecated. Instead, use dfs.metrics.session-id
> 15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> processName=JobTracker, sessionId=
> 15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option
> parsing not performed. Implement the Tool interface and execute your
> application with ToolRunner to remedy this.
> 15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process
> : 1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_local117348325_0001
> 15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job:
> http://localhost:8080/
> 15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in
> config null
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task:
> attempt_local117348325_0001_m_000000_0
> 15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree :
> [ ]
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
> 15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
> java.lang.Exception: java.lang.RuntimeException:
> java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
> Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at java.lang.Class.getConstructor0(Class.java:2892)
> at java.lang.Class.getDeclaredConstructor(Class.java:2058)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
> ... 8 more
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running
> in uber mode : false
> 15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed
> with state FAILED due to: NA
> 15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
>
> The job, mapper and reducer class is packaged in the jar before
> deployment. Can somebody here explain.
>
> Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
>
>
>
>
Re: Beginner Hadoop Code
Posted by Chris Mawata <ch...@gmail.com>.
Great! Good luck with your exploration.
Chris
On Apr 28, 2015 9:30 AM, "Anand Murali" <an...@yahoo.com> wrote:
> Many thanks Chris. It works.
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
> On Tuesday, April 28, 2015 4:53 PM, Chris Mawata <ch...@gmail.com>
> wrote:
>
>
> Looks like the framework is having difficulty instantiating your Mapper.
> The problem is probably because you made it an instance inner class. Make
> it a static nested class
> public static class MaxTemperatureMapper ...
> and the same for your reducer
>
> On Tue, Apr 28, 2015 at 4:27 AM, Anand Murali <an...@yahoo.com>
> wrote:
>
> Rudra:
>
> Request you to be more specific. Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
> On Tuesday, April 28, 2015 1:14 PM, Rudra Tripathy <ru...@gmail.com>
> wrote:
>
>
> Please check max temperature format
> On Apr 28, 2015 12:14 PM, "Anand Murali" <an...@yahoo.com> wrote:
>
> Dear All:
>
> I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit
> 2.6. When I run though I get runtime exception.
>
> anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar
> MaxTemperature /user/anand_vihar/max/input output
> 15/04/28 11:46:57 INFO Configuration.deprecation: session.id is
> deprecated. Instead, use dfs.metrics.session-id
> 15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> processName=JobTracker, sessionId=
> 15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option
> parsing not performed. Implement the Tool interface and execute your
> application with ToolRunner to remedy this.
> 15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process
> : 1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_local117348325_0001
> 15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job:
> http://localhost:8080/
> 15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in
> config null
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task:
> attempt_local117348325_0001_m_000000_0
> 15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree :
> [ ]
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
> 15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
> java.lang.Exception: java.lang.RuntimeException:
> java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
> Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at java.lang.Class.getConstructor0(Class.java:2892)
> at java.lang.Class.getDeclaredConstructor(Class.java:2058)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
> ... 8 more
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running
> in uber mode : false
> 15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed
> with state FAILED due to: NA
> 15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
>
> The job, mapper and reducer class is packaged in the jar before
> deployment. Can somebody here explain.
>
> Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
>
>
>
>
Re: Beginner Hadoop Code
Posted by Anand Murali <an...@yahoo.com>.
Many thanks Chris. It works.
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
On Tuesday, April 28, 2015 4:53 PM, Chris Mawata <ch...@gmail.com> wrote:
Looks like the framework is having difficulty instantiating your Mapper. The problem is probably because you made it an instance inner class. Make it a static nested classpublic static class MaxTemperatureMapper ...and the same for your reducer
On Tue, Apr 28, 2015 at 4:27 AM, Anand Murali <an...@yahoo.com> wrote:
Rudra:
Request you to be more specific. Thanks
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
On Tuesday, April 28, 2015 1:14 PM, Rudra Tripathy <ru...@gmail.com> wrote:
Please check max temperature format
On Apr 28, 2015 12:14 PM, "Anand Murali" <an...@yahoo.com> wrote:
Dear All:
I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit 2.6. When I run though I get runtime exception.
anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar MaxTemperature /user/anand_vihar/max/input output
15/04/28 11:46:57 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process : 1
15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local117348325_0001
15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job: http://localhost:8080/
15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in config null
15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task: attempt_local117348325_0001_m_000000_0
15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
java.lang.Exception: java.lang.RuntimeException: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at java.lang.Class.getConstructor0(Class.java:2892)
at java.lang.Class.getDeclaredConstructor(Class.java:2058)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
... 8 more
15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running in uber mode : false
15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed with state FAILED due to: NA
15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
The job, mapper and reducer class is packaged in the jar before deployment. Can somebody here explain.
Thanks
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
Re: Beginner Hadoop Code
Posted by Anand Murali <an...@yahoo.com>.
Many thanks Chris. It works.
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
On Tuesday, April 28, 2015 4:53 PM, Chris Mawata <ch...@gmail.com> wrote:
Looks like the framework is having difficulty instantiating your Mapper. The problem is probably because you made it an instance inner class. Make it a static nested classpublic static class MaxTemperatureMapper ...and the same for your reducer
On Tue, Apr 28, 2015 at 4:27 AM, Anand Murali <an...@yahoo.com> wrote:
Rudra:
Request you to be more specific. Thanks
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
On Tuesday, April 28, 2015 1:14 PM, Rudra Tripathy <ru...@gmail.com> wrote:
Please check max temperature format
On Apr 28, 2015 12:14 PM, "Anand Murali" <an...@yahoo.com> wrote:
Dear All:
I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit 2.6. When I run though I get runtime exception.
anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar MaxTemperature /user/anand_vihar/max/input output
15/04/28 11:46:57 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process : 1
15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local117348325_0001
15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job: http://localhost:8080/
15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in config null
15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task: attempt_local117348325_0001_m_000000_0
15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
java.lang.Exception: java.lang.RuntimeException: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at java.lang.Class.getConstructor0(Class.java:2892)
at java.lang.Class.getDeclaredConstructor(Class.java:2058)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
... 8 more
15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running in uber mode : false
15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed with state FAILED due to: NA
15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
The job, mapper and reducer class is packaged in the jar before deployment. Can somebody here explain.
Thanks
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
Re: Beginner Hadoop Code
Posted by Anand Murali <an...@yahoo.com>.
Many thanks Chris. It works.
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
On Tuesday, April 28, 2015 4:53 PM, Chris Mawata <ch...@gmail.com> wrote:
Looks like the framework is having difficulty instantiating your Mapper. The problem is probably because you made it an instance inner class. Make it a static nested classpublic static class MaxTemperatureMapper ...and the same for your reducer
On Tue, Apr 28, 2015 at 4:27 AM, Anand Murali <an...@yahoo.com> wrote:
Rudra:
Request you to be more specific. Thanks
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
On Tuesday, April 28, 2015 1:14 PM, Rudra Tripathy <ru...@gmail.com> wrote:
Please check max temperature format
On Apr 28, 2015 12:14 PM, "Anand Murali" <an...@yahoo.com> wrote:
Dear All:
I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit 2.6. When I run though I get runtime exception.
anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar MaxTemperature /user/anand_vihar/max/input output
15/04/28 11:46:57 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process : 1
15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local117348325_0001
15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job: http://localhost:8080/
15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in config null
15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task: attempt_local117348325_0001_m_000000_0
15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
java.lang.Exception: java.lang.RuntimeException: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at java.lang.Class.getConstructor0(Class.java:2892)
at java.lang.Class.getDeclaredConstructor(Class.java:2058)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
... 8 more
15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running in uber mode : false
15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed with state FAILED due to: NA
15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
The job, mapper and reducer class is packaged in the jar before deployment. Can somebody here explain.
Thanks
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
Re: Beginner Hadoop Code
Posted by Anand Murali <an...@yahoo.com>.
Many thanks Chris. It works.
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
On Tuesday, April 28, 2015 4:53 PM, Chris Mawata <ch...@gmail.com> wrote:
Looks like the framework is having difficulty instantiating your Mapper. The problem is probably because you made it an instance inner class. Make it a static nested classpublic static class MaxTemperatureMapper ...and the same for your reducer
On Tue, Apr 28, 2015 at 4:27 AM, Anand Murali <an...@yahoo.com> wrote:
Rudra:
Request you to be more specific. Thanks
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
On Tuesday, April 28, 2015 1:14 PM, Rudra Tripathy <ru...@gmail.com> wrote:
Please check max temperature format
On Apr 28, 2015 12:14 PM, "Anand Murali" <an...@yahoo.com> wrote:
Dear All:
I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit 2.6. When I run though I get runtime exception.
anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar MaxTemperature /user/anand_vihar/max/input output
15/04/28 11:46:57 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process : 1
15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local117348325_0001
15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job: http://localhost:8080/
15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in config null
15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task: attempt_local117348325_0001_m_000000_0
15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
java.lang.Exception: java.lang.RuntimeException: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at java.lang.Class.getConstructor0(Class.java:2892)
at java.lang.Class.getDeclaredConstructor(Class.java:2058)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
... 8 more
15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running in uber mode : false
15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed with state FAILED due to: NA
15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
The job, mapper and reducer class is packaged in the jar before deployment. Can somebody here explain.
Thanks
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
Re: Beginner Hadoop Code
Posted by Chris Mawata <ch...@gmail.com>.
Looks like the framework is having difficulty instantiating your Mapper.
The problem is probably because you made it an instance inner class. Make
it a static nested class
public static class MaxTemperatureMapper ...
and the same for your reducer
On Tue, Apr 28, 2015 at 4:27 AM, Anand Murali <an...@yahoo.com> wrote:
> Rudra:
>
> Request you to be more specific. Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
> On Tuesday, April 28, 2015 1:14 PM, Rudra Tripathy <ru...@gmail.com>
> wrote:
>
>
> Please check max temperature format
> On Apr 28, 2015 12:14 PM, "Anand Murali" <an...@yahoo.com> wrote:
>
> Dear All:
>
> I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit
> 2.6. When I run though I get runtime exception.
>
> anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar
> MaxTemperature /user/anand_vihar/max/input output
> 15/04/28 11:46:57 INFO Configuration.deprecation: session.id is
> deprecated. Instead, use dfs.metrics.session-id
> 15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> processName=JobTracker, sessionId=
> 15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option
> parsing not performed. Implement the Tool interface and execute your
> application with ToolRunner to remedy this.
> 15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process
> : 1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_local117348325_0001
> 15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job:
> http://localhost:8080/
> 15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in
> config null
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task:
> attempt_local117348325_0001_m_000000_0
> 15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree :
> [ ]
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
> 15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
> java.lang.Exception: java.lang.RuntimeException:
> java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
> Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at java.lang.Class.getConstructor0(Class.java:2892)
> at java.lang.Class.getDeclaredConstructor(Class.java:2058)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
> ... 8 more
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running
> in uber mode : false
> 15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed
> with state FAILED due to: NA
> 15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
>
> The job, mapper and reducer class is packaged in the jar before
> deployment. Can somebody here explain.
>
> Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
>
Re: Beginner Hadoop Code
Posted by Chris Mawata <ch...@gmail.com>.
Looks like the framework is having difficulty instantiating your Mapper.
The problem is probably because you made it an instance inner class. Make
it a static nested class
public static class MaxTemperatureMapper ...
and the same for your reducer
On Tue, Apr 28, 2015 at 4:27 AM, Anand Murali <an...@yahoo.com> wrote:
> Rudra:
>
> Request you to be more specific. Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
> On Tuesday, April 28, 2015 1:14 PM, Rudra Tripathy <ru...@gmail.com>
> wrote:
>
>
> Please check max temperature format
> On Apr 28, 2015 12:14 PM, "Anand Murali" <an...@yahoo.com> wrote:
>
> Dear All:
>
> I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit
> 2.6. When I run though I get runtime exception.
>
> anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar
> MaxTemperature /user/anand_vihar/max/input output
> 15/04/28 11:46:57 INFO Configuration.deprecation: session.id is
> deprecated. Instead, use dfs.metrics.session-id
> 15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> processName=JobTracker, sessionId=
> 15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option
> parsing not performed. Implement the Tool interface and execute your
> application with ToolRunner to remedy this.
> 15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process
> : 1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_local117348325_0001
> 15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job:
> http://localhost:8080/
> 15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in
> config null
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task:
> attempt_local117348325_0001_m_000000_0
> 15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree :
> [ ]
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
> 15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
> java.lang.Exception: java.lang.RuntimeException:
> java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
> Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at java.lang.Class.getConstructor0(Class.java:2892)
> at java.lang.Class.getDeclaredConstructor(Class.java:2058)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
> ... 8 more
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running
> in uber mode : false
> 15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed
> with state FAILED due to: NA
> 15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
>
> The job, mapper and reducer class is packaged in the jar before
> deployment. Can somebody here explain.
>
> Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
>
Re: Beginner Hadoop Code
Posted by Chris Mawata <ch...@gmail.com>.
Looks like the framework is having difficulty instantiating your Mapper.
The problem is probably because you made it an instance inner class. Make
it a static nested class
public static class MaxTemperatureMapper ...
and the same for your reducer
On Tue, Apr 28, 2015 at 4:27 AM, Anand Murali <an...@yahoo.com> wrote:
> Rudra:
>
> Request you to be more specific. Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
> On Tuesday, April 28, 2015 1:14 PM, Rudra Tripathy <ru...@gmail.com>
> wrote:
>
>
> Please check max temperature format
> On Apr 28, 2015 12:14 PM, "Anand Murali" <an...@yahoo.com> wrote:
>
> Dear All:
>
> I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit
> 2.6. When I run though I get runtime exception.
>
> anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar
> MaxTemperature /user/anand_vihar/max/input output
> 15/04/28 11:46:57 INFO Configuration.deprecation: session.id is
> deprecated. Instead, use dfs.metrics.session-id
> 15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> processName=JobTracker, sessionId=
> 15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option
> parsing not performed. Implement the Tool interface and execute your
> application with ToolRunner to remedy this.
> 15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process
> : 1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_local117348325_0001
> 15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job:
> http://localhost:8080/
> 15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in
> config null
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task:
> attempt_local117348325_0001_m_000000_0
> 15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree :
> [ ]
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
> 15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
> java.lang.Exception: java.lang.RuntimeException:
> java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
> Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at java.lang.Class.getConstructor0(Class.java:2892)
> at java.lang.Class.getDeclaredConstructor(Class.java:2058)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
> ... 8 more
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running
> in uber mode : false
> 15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed
> with state FAILED due to: NA
> 15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
>
> The job, mapper and reducer class is packaged in the jar before
> deployment. Can somebody here explain.
>
> Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
>
Re: Beginner Hadoop Code
Posted by Chris Mawata <ch...@gmail.com>.
Looks like the framework is having difficulty instantiating your Mapper.
The problem is probably because you made it an instance inner class. Make
it a static nested class
public static class MaxTemperatureMapper ...
and the same for your reducer
On Tue, Apr 28, 2015 at 4:27 AM, Anand Murali <an...@yahoo.com> wrote:
> Rudra:
>
> Request you to be more specific. Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
> On Tuesday, April 28, 2015 1:14 PM, Rudra Tripathy <ru...@gmail.com>
> wrote:
>
>
> Please check max temperature format
> On Apr 28, 2015 12:14 PM, "Anand Murali" <an...@yahoo.com> wrote:
>
> Dear All:
>
> I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit
> 2.6. When I run though I get runtime exception.
>
> anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar
> MaxTemperature /user/anand_vihar/max/input output
> 15/04/28 11:46:57 INFO Configuration.deprecation: session.id is
> deprecated. Instead, use dfs.metrics.session-id
> 15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> processName=JobTracker, sessionId=
> 15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option
> parsing not performed. Implement the Tool interface and execute your
> application with ToolRunner to remedy this.
> 15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process
> : 1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_local117348325_0001
> 15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job:
> http://localhost:8080/
> 15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in
> config null
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task:
> attempt_local117348325_0001_m_000000_0
> 15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree :
> [ ]
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
> 15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
> java.lang.Exception: java.lang.RuntimeException:
> java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
> Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at java.lang.Class.getConstructor0(Class.java:2892)
> at java.lang.Class.getDeclaredConstructor(Class.java:2058)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
> ... 8 more
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running
> in uber mode : false
> 15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed
> with state FAILED due to: NA
> 15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
>
> The job, mapper and reducer class is packaged in the jar before
> deployment. Can somebody here explain.
>
> Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
>
Re: Beginner Hadoop Code
Posted by Anand Murali <an...@yahoo.com>.
Rudra:
Request you to be more specific. Thanks
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
On Tuesday, April 28, 2015 1:14 PM, Rudra Tripathy <ru...@gmail.com> wrote:
Please check max temperature format
On Apr 28, 2015 12:14 PM, "Anand Murali" <an...@yahoo.com> wrote:
Dear All:
I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit 2.6. When I run though I get runtime exception.
anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar MaxTemperature /user/anand_vihar/max/input output
15/04/28 11:46:57 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process : 1
15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local117348325_0001
15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job: http://localhost:8080/
15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in config null
15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task: attempt_local117348325_0001_m_000000_0
15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
java.lang.Exception: java.lang.RuntimeException: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at java.lang.Class.getConstructor0(Class.java:2892)
at java.lang.Class.getDeclaredConstructor(Class.java:2058)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
... 8 more
15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running in uber mode : false
15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed with state FAILED due to: NA
15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
The job, mapper and reducer class is packaged in the jar before deployment. Can somebody here explain.
Thanks
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
Re: Beginner Hadoop Code
Posted by Anand Murali <an...@yahoo.com>.
Rudra:
Request you to be more specific. Thanks
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
On Tuesday, April 28, 2015 1:14 PM, Rudra Tripathy <ru...@gmail.com> wrote:
Please check max temperature format
On Apr 28, 2015 12:14 PM, "Anand Murali" <an...@yahoo.com> wrote:
Dear All:
I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit 2.6. When I run though I get runtime exception.
anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar MaxTemperature /user/anand_vihar/max/input output
15/04/28 11:46:57 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process : 1
15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local117348325_0001
15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job: http://localhost:8080/
15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in config null
15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task: attempt_local117348325_0001_m_000000_0
15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
java.lang.Exception: java.lang.RuntimeException: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at java.lang.Class.getConstructor0(Class.java:2892)
at java.lang.Class.getDeclaredConstructor(Class.java:2058)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
... 8 more
15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running in uber mode : false
15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed with state FAILED due to: NA
15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
The job, mapper and reducer class is packaged in the jar before deployment. Can somebody here explain.
Thanks
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
Re: Beginner Hadoop Code
Posted by Anand Murali <an...@yahoo.com>.
Rudra:
Request you to be more specific. Thanks
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
On Tuesday, April 28, 2015 1:14 PM, Rudra Tripathy <ru...@gmail.com> wrote:
Please check max temperature format
On Apr 28, 2015 12:14 PM, "Anand Murali" <an...@yahoo.com> wrote:
Dear All:
I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit 2.6. When I run though I get runtime exception.
anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar MaxTemperature /user/anand_vihar/max/input output
15/04/28 11:46:57 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process : 1
15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local117348325_0001
15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job: http://localhost:8080/
15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in config null
15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task: attempt_local117348325_0001_m_000000_0
15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
java.lang.Exception: java.lang.RuntimeException: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at java.lang.Class.getConstructor0(Class.java:2892)
at java.lang.Class.getDeclaredConstructor(Class.java:2058)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
... 8 more
15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running in uber mode : false
15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed with state FAILED due to: NA
15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
The job, mapper and reducer class is packaged in the jar before deployment. Can somebody here explain.
Thanks
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
Re: Beginner Hadoop Code
Posted by Anand Murali <an...@yahoo.com>.
Rudra:
Request you to be more specific. Thanks
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
On Tuesday, April 28, 2015 1:14 PM, Rudra Tripathy <ru...@gmail.com> wrote:
Please check max temperature format
On Apr 28, 2015 12:14 PM, "Anand Murali" <an...@yahoo.com> wrote:
Dear All:
I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit 2.6. When I run though I get runtime exception.
anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar MaxTemperature /user/anand_vihar/max/input output
15/04/28 11:46:57 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process : 1
15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local117348325_0001
15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job: http://localhost:8080/
15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in config null
15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task: attempt_local117348325_0001_m_000000_0
15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
java.lang.Exception: java.lang.RuntimeException: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.<init>()
at java.lang.Class.getConstructor0(Class.java:2892)
at java.lang.Class.getDeclaredConstructor(Class.java:2058)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
... 8 more
15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running in uber mode : false
15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed with state FAILED due to: NA
15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
The job, mapper and reducer class is packaged in the jar before deployment. Can somebody here explain.
Thanks
Anand Murali 11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)
Re: Beginner Hadoop Code
Posted by Rudra Tripathy <ru...@gmail.com>.
Please check max temperature format
On Apr 28, 2015 12:14 PM, "Anand Murali" <an...@yahoo.com> wrote:
> Dear All:
>
> I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit
> 2.6. When I run though I get runtime exception.
>
> anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar
> MaxTemperature /user/anand_vihar/max/input output
> 15/04/28 11:46:57 INFO Configuration.deprecation: session.id is
> deprecated. Instead, use dfs.metrics.session-id
> 15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> processName=JobTracker, sessionId=
> 15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option
> parsing not performed. Implement the Tool interface and execute your
> application with ToolRunner to remedy this.
> 15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process
> : 1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_local117348325_0001
> 15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job:
> http://localhost:8080/
> 15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in
> config null
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task:
> attempt_local117348325_0001_m_000000_0
> 15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree :
> [ ]
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
> 15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
> java.lang.Exception: java.lang.RuntimeException:
> java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
> Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at java.lang.Class.getConstructor0(Class.java:2892)
> at java.lang.Class.getDeclaredConstructor(Class.java:2058)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
> ... 8 more
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running
> in uber mode : false
> 15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed
> with state FAILED due to: NA
> 15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
>
> The job, mapper and reducer class is packaged in the jar before
> deployment. Can somebody here explain.
>
> Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
Re: Beginner Hadoop Code
Posted by Rudra Tripathy <ru...@gmail.com>.
Please check max temperature format
On Apr 28, 2015 12:14 PM, "Anand Murali" <an...@yahoo.com> wrote:
> Dear All:
>
> I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit
> 2.6. When I run though I get runtime exception.
>
> anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar
> MaxTemperature /user/anand_vihar/max/input output
> 15/04/28 11:46:57 INFO Configuration.deprecation: session.id is
> deprecated. Instead, use dfs.metrics.session-id
> 15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> processName=JobTracker, sessionId=
> 15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option
> parsing not performed. Implement the Tool interface and execute your
> application with ToolRunner to remedy this.
> 15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process
> : 1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_local117348325_0001
> 15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job:
> http://localhost:8080/
> 15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in
> config null
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task:
> attempt_local117348325_0001_m_000000_0
> 15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree :
> [ ]
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
> 15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
> java.lang.Exception: java.lang.RuntimeException:
> java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
> Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at java.lang.Class.getConstructor0(Class.java:2892)
> at java.lang.Class.getDeclaredConstructor(Class.java:2058)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
> ... 8 more
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running
> in uber mode : false
> 15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed
> with state FAILED due to: NA
> 15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
>
> The job, mapper and reducer class is packaged in the jar before
> deployment. Can somebody here explain.
>
> Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
Re: Beginner Hadoop Code
Posted by Rudra Tripathy <ru...@gmail.com>.
Please check max temperature format
On Apr 28, 2015 12:14 PM, "Anand Murali" <an...@yahoo.com> wrote:
> Dear All:
>
> I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit
> 2.6. When I run though I get runtime exception.
>
> anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar
> MaxTemperature /user/anand_vihar/max/input output
> 15/04/28 11:46:57 INFO Configuration.deprecation: session.id is
> deprecated. Instead, use dfs.metrics.session-id
> 15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> processName=JobTracker, sessionId=
> 15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option
> parsing not performed. Implement the Tool interface and execute your
> application with ToolRunner to remedy this.
> 15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process
> : 1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_local117348325_0001
> 15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job:
> http://localhost:8080/
> 15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in
> config null
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task:
> attempt_local117348325_0001_m_000000_0
> 15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree :
> [ ]
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
> 15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
> java.lang.Exception: java.lang.RuntimeException:
> java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
> Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at java.lang.Class.getConstructor0(Class.java:2892)
> at java.lang.Class.getDeclaredConstructor(Class.java:2058)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
> ... 8 more
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running
> in uber mode : false
> 15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed
> with state FAILED due to: NA
> 15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
>
> The job, mapper and reducer class is packaged in the jar before
> deployment. Can somebody here explain.
>
> Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
Re: Beginner Hadoop Code
Posted by Rudra Tripathy <ru...@gmail.com>.
Please check max temperature format
On Apr 28, 2015 12:14 PM, "Anand Murali" <an...@yahoo.com> wrote:
> Dear All:
>
> I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit
> 2.6. When I run though I get runtime exception.
>
> anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar
> MaxTemperature /user/anand_vihar/max/input output
> 15/04/28 11:46:57 INFO Configuration.deprecation: session.id is
> deprecated. Instead, use dfs.metrics.session-id
> 15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> processName=JobTracker, sessionId=
> 15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option
> parsing not performed. Implement the Tool interface and execute your
> application with ToolRunner to remedy this.
> 15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process
> : 1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_local117348325_0001
> 15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job:
> http://localhost:8080/
> 15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in
> config null
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task:
> attempt_local117348325_0001_m_000000_0
> 15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree :
> [ ]
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
> 15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
> java.lang.Exception: java.lang.RuntimeException:
> java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
> Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
> at java.lang.Class.getConstructor0(Class.java:2892)
> at java.lang.Class.getDeclaredConstructor(Class.java:2058)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
> ... 8 more
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running
> in uber mode : false
> 15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0%
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed
> with state FAILED due to: NA
> 15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
>
> The job, mapper and reducer class is packaged in the jar before
> deployment. Can somebody here explain.
>
> Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>