You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Eldar Abdrazakov (Created) (JIRA)" <ji...@apache.org> on 2011/11/13 19:19:51 UTC
[jira] [Created] (HADOOP-7819) java.lang.ClassCastException:
org.apache.hadoop.mapreduce.ReduceContext$ValueIterable cannot be cast to
java.util.Iterator
java.lang.ClassCastException: org.apache.hadoop.mapreduce.ReduceContext$ValueIterable cannot be cast to java.util.Iterator
--------------------------------------------------------------------------------------------------------------------------
Key: HADOOP-7819
URL: https://issues.apache.org/jira/browse/HADOOP-7819
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 0.20.2
Environment: Linux calculate 2.6.39-pf4 #15 SMP PREEMPT Sat Nov 5 18:14:51 GST 2011 x86_64 Intel(R) Core(TM) i3 CPU M 330 @ 2.13GHz GenuineIntel GNU/Linux
java version "1.6.0_26"
Java(TM) SE Runtime Environment (build 1.6.0_26-b03)
Java HotSpot(TM) 64-Bit Server VM (build 20.1-b02, mixed mode)
Reporter: Eldar Abdrazakov
11/11/13 22:07:26 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
WARNING: partition-by already refers to: #'clojure.core/partition-by in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/partition-by
WARNING: frequencies already refers to: #'clojure.core/frequencies in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/frequencies
WARNING: shuffle already refers to: #'clojure.core/shuffle in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/shuffle
WARNING: reductions already refers to: #'clojure.core/reductions in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/reductions
WARNING: partition-all already refers to: #'clojure.core/partition-all in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/partition-all
WARNING: group-by already refers to: #'clojure.core/group-by in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/group-by
WARNING: flatten already refers to: #'clojure.core/flatten in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/flatten
11/11/13 22:07:26 INFO input.FileInputFormat: Total input paths to process : 1
11/11/13 22:07:26 INFO mapred.JobClient: Running job: job_local_0001
11/11/13 22:07:26 INFO input.FileInputFormat: Total input paths to process : 1
11/11/13 22:07:26 INFO mapred.MapTask: io.sort.mb = 100
11/11/13 22:07:27 INFO mapred.MapTask: data buffer = 79691776/99614720
11/11/13 22:07:27 INFO mapred.MapTask: record buffer = 262144/327680
11/11/13 22:07:27 INFO mapred.JobClient: map 0% reduce 0%
11/11/13 22:07:30 INFO mapred.MapTask: Spilling map output: record full = true
11/11/13 22:07:30 INFO mapred.MapTask: bufstart = 0; bufend = 2097400; bufvoid = 99614720
11/11/13 22:07:30 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680
11/11/13 22:07:31 INFO mapred.MapTask: Finished spill 0
11/11/13 22:07:32 INFO mapred.LocalJobRunner:
11/11/13 22:07:33 INFO mapred.MapTask: Spilling map output: record full = true
11/11/13 22:07:33 INFO mapred.MapTask: bufstart = 2097400; bufend = 4194707; bufvoid = 99614720
11/11/13 22:07:33 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680
11/11/13 22:07:33 INFO mapred.JobClient: map 75% reduce 0%
11/11/13 22:07:34 INFO mapred.MapTask: Finished spill 1
11/11/13 22:07:34 INFO mapred.MapTask: Starting flush of map output
11/11/13 22:07:34 INFO mapred.MapTask: Finished spill 2
11/11/13 22:07:34 INFO mapred.Merger: Merging 3 sorted segments
11/11/13 22:07:34 INFO mapred.Merger: Down to the last merge-pass, with 3 segments left of total size: 6276350 bytes
11/11/13 22:07:35 INFO mapred.TaskRunner: Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
11/11/13 22:07:35 INFO mapred.LocalJobRunner:
11/11/13 22:07:35 INFO mapred.TaskRunner: Task 'attempt_local_0001_m_000000_0' done.
11/11/13 22:07:35 INFO mapred.LocalJobRunner:
11/11/13 22:07:35 INFO mapred.Merger: Merging 1 sorted segments
11/11/13 22:07:35 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 6276346 bytes
11/11/13 22:07:35 INFO mapred.LocalJobRunner:
11/11/13 22:07:35 WARN mapred.LocalJobRunner: job_local_0001
java.lang.ClassCastException: org.apache.hadoop.mapreduce.ReduceContext$ValueIterable cannot be cast to java.util.Iterator
at clojure.core$iterator_seq.invoke(core.clj:4561)
at hadoop1$string_long_reduce_reader$fn__214.invoke(hadoop1.clj:40)
at hadoop1$my_reduce.invoke(hadoop1.clj:31)
at clojure.lang.AFn.applyToHelper(AFn.java:165)
at clojure.lang.AFn.applyTo(AFn.java:151)
at clojure.core$apply.invoke(core.clj:540)
at clojure_hadoop.wrap$wrap_reduce$fn__178.invoke(wrap.clj:92)
at clojure_hadoop.job_reducer.reduce(Unknown Source)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at clojure_hadoop.job_reducer.run(Unknown Source)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:566)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216)
11/11/13 22:07:35 INFO mapred.JobClient: map 100% reduce 0%
11/11/13 22:07:35 INFO mapred.JobClient: Job complete: job_local_0001
11/11/13 22:07:35 INFO mapred.JobClient: Counters: 12
11/11/13 22:07:35 INFO mapred.JobClient: FileSystemCounters
11/11/13 22:07:35 INFO mapred.JobClient: FILE_BYTES_READ=22930784
11/11/13 22:07:35 INFO mapred.JobClient: FILE_BYTES_WRITTEN=28672002
11/11/13 22:07:35 INFO mapred.JobClient: Map-Reduce Framework
11/11/13 22:07:35 INFO mapred.JobClient: Reduce input groups=0
11/11/13 22:07:35 INFO mapred.JobClient: Combine output records=0
11/11/13 22:07:35 INFO mapred.JobClient: Map input records=12760
11/11/13 22:07:35 INFO mapred.JobClient: Reduce shuffle bytes=0
11/11/13 22:07:35 INFO mapred.JobClient: Reduce output records=0
11/11/13 22:07:35 INFO mapred.JobClient: Spilled Records=1255180
11/11/13 22:07:35 INFO mapred.JobClient: Map output bytes=5021164
11/11/13 22:07:35 INFO mapred.JobClient: Combine input records=0
11/11/13 22:07:35 INFO mapred.JobClient: Map output records=627590
11/11/13 22:07:35 INFO mapred.JobClient: Reduce input records=0
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HADOOP-7819) java.lang.ClassCastException:
org.apache.hadoop.mapreduce.ReduceContext$ValueIterable cannot be cast to
java.util.Iterator
Posted by "Aaron T. Myers (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers resolved HADOOP-7819.
------------------------------------
Resolution: Not A Problem
> java.lang.ClassCastException: org.apache.hadoop.mapreduce.ReduceContext$ValueIterable cannot be cast to java.util.Iterator
> --------------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-7819
> URL: https://issues.apache.org/jira/browse/HADOOP-7819
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.2
> Environment: Linux calculate 2.6.39-pf4 #15 SMP PREEMPT Sat Nov 5 18:14:51 GST 2011 x86_64 Intel(R) Core(TM) i3 CPU M 330 @ 2.13GHz GenuineIntel GNU/Linux
> java version "1.6.0_26"
> Java(TM) SE Runtime Environment (build 1.6.0_26-b03)
> Java HotSpot(TM) 64-Bit Server VM (build 20.1-b02, mixed mode)
> Reporter: Eldar Abdrazakov
>
> 11/11/13 22:07:26 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> WARNING: partition-by already refers to: #'clojure.core/partition-by in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/partition-by
> WARNING: frequencies already refers to: #'clojure.core/frequencies in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/frequencies
> WARNING: shuffle already refers to: #'clojure.core/shuffle in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/shuffle
> WARNING: reductions already refers to: #'clojure.core/reductions in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/reductions
> WARNING: partition-all already refers to: #'clojure.core/partition-all in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/partition-all
> WARNING: group-by already refers to: #'clojure.core/group-by in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/group-by
> WARNING: flatten already refers to: #'clojure.core/flatten in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/flatten
> 11/11/13 22:07:26 INFO input.FileInputFormat: Total input paths to process : 1
> 11/11/13 22:07:26 INFO mapred.JobClient: Running job: job_local_0001
> 11/11/13 22:07:26 INFO input.FileInputFormat: Total input paths to process : 1
> 11/11/13 22:07:26 INFO mapred.MapTask: io.sort.mb = 100
> 11/11/13 22:07:27 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/11/13 22:07:27 INFO mapred.MapTask: record buffer = 262144/327680
> 11/11/13 22:07:27 INFO mapred.JobClient: map 0% reduce 0%
> 11/11/13 22:07:30 INFO mapred.MapTask: Spilling map output: record full = true
> 11/11/13 22:07:30 INFO mapred.MapTask: bufstart = 0; bufend = 2097400; bufvoid = 99614720
> 11/11/13 22:07:30 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680
> 11/11/13 22:07:31 INFO mapred.MapTask: Finished spill 0
> 11/11/13 22:07:32 INFO mapred.LocalJobRunner:
> 11/11/13 22:07:33 INFO mapred.MapTask: Spilling map output: record full = true
> 11/11/13 22:07:33 INFO mapred.MapTask: bufstart = 2097400; bufend = 4194707; bufvoid = 99614720
> 11/11/13 22:07:33 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680
> 11/11/13 22:07:33 INFO mapred.JobClient: map 75% reduce 0%
> 11/11/13 22:07:34 INFO mapred.MapTask: Finished spill 1
> 11/11/13 22:07:34 INFO mapred.MapTask: Starting flush of map output
> 11/11/13 22:07:34 INFO mapred.MapTask: Finished spill 2
> 11/11/13 22:07:34 INFO mapred.Merger: Merging 3 sorted segments
> 11/11/13 22:07:34 INFO mapred.Merger: Down to the last merge-pass, with 3 segments left of total size: 6276350 bytes
> 11/11/13 22:07:35 INFO mapred.TaskRunner: Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
> 11/11/13 22:07:35 INFO mapred.LocalJobRunner:
> 11/11/13 22:07:35 INFO mapred.TaskRunner: Task 'attempt_local_0001_m_000000_0' done.
> 11/11/13 22:07:35 INFO mapred.LocalJobRunner:
> 11/11/13 22:07:35 INFO mapred.Merger: Merging 1 sorted segments
> 11/11/13 22:07:35 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 6276346 bytes
> 11/11/13 22:07:35 INFO mapred.LocalJobRunner:
> 11/11/13 22:07:35 WARN mapred.LocalJobRunner: job_local_0001
> java.lang.ClassCastException: org.apache.hadoop.mapreduce.ReduceContext$ValueIterable cannot be cast to java.util.Iterator
> at clojure.core$iterator_seq.invoke(core.clj:4561)
> at hadoop1$string_long_reduce_reader$fn__214.invoke(hadoop1.clj:40)
> at hadoop1$my_reduce.invoke(hadoop1.clj:31)
> at clojure.lang.AFn.applyToHelper(AFn.java:165)
> at clojure.lang.AFn.applyTo(AFn.java:151)
> at clojure.core$apply.invoke(core.clj:540)
> at clojure_hadoop.wrap$wrap_reduce$fn__178.invoke(wrap.clj:92)
> at clojure_hadoop.job_reducer.reduce(Unknown Source)
> at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
> at clojure_hadoop.job_reducer.run(Unknown Source)
> at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:566)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
> at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216)
> 11/11/13 22:07:35 INFO mapred.JobClient: map 100% reduce 0%
> 11/11/13 22:07:35 INFO mapred.JobClient: Job complete: job_local_0001
> 11/11/13 22:07:35 INFO mapred.JobClient: Counters: 12
> 11/11/13 22:07:35 INFO mapred.JobClient: FileSystemCounters
> 11/11/13 22:07:35 INFO mapred.JobClient: FILE_BYTES_READ=22930784
> 11/11/13 22:07:35 INFO mapred.JobClient: FILE_BYTES_WRITTEN=28672002
> 11/11/13 22:07:35 INFO mapred.JobClient: Map-Reduce Framework
> 11/11/13 22:07:35 INFO mapred.JobClient: Reduce input groups=0
> 11/11/13 22:07:35 INFO mapred.JobClient: Combine output records=0
> 11/11/13 22:07:35 INFO mapred.JobClient: Map input records=12760
> 11/11/13 22:07:35 INFO mapred.JobClient: Reduce shuffle bytes=0
> 11/11/13 22:07:35 INFO mapred.JobClient: Reduce output records=0
> 11/11/13 22:07:35 INFO mapred.JobClient: Spilled Records=1255180
> 11/11/13 22:07:35 INFO mapred.JobClient: Map output bytes=5021164
> 11/11/13 22:07:35 INFO mapred.JobClient: Combine input records=0
> 11/11/13 22:07:35 INFO mapred.JobClient: Map output records=627590
> 11/11/13 22:07:35 INFO mapred.JobClient: Reduce input records=0
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira