You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Nigel Daley (JIRA)" <ji...@apache.org> on 2007/03/02 07:27:50 UTC
[jira] Created: (HADOOP-1058) ClassCastException in
TextInputFormat.getRecordReader
ClassCastException in TextInputFormat.getRecordReader
-----------------------------------------------------
Key: HADOOP-1058
URL: https://issues.apache.org/jira/browse/HADOOP-1058
Project: Hadoop
Issue Type: Bug
Components: mapred
Affects Versions: 0.11.2
Reporter: Nigel Daley
Running TestMiniMRLocalFS on Linux, I saw this exception during the 3rd job that it runs:
[junit] 2007-02-28 21:10:14,739 INFO mapred.TaskRunner (MapTaskRunner.java:close(46)) - task_0003_m_000001_0 done; removing files.
[junit] 2007-02-28 21:10:14,746 INFO mapred.TaskInProgress (TaskInProgress.java:updateStatus(328)) - Error from task_0003_m_000001_0: java.lang.ClassCastException: org.apache.hadoop.mapred.TestMiniMRLocalFS$MyInputFormat$MySplit
[junit] at org.apache.hadoop.mapred.TextInputFormat.getRecordReader(TextInputFormat.java:46)
[junit] at org.apache.hadoop.mapred.MapTask.run(MapTask.java:145)
[junit] at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1444)
[junit] 2007-02-28 21:10:14,747 INFO mapred.TaskInProgress (TaskInProgress.java:failedSubTask(380)) - Task 'task_0003_m_000001_0' has been lost.
[junit] 2007-02-28 21:10:14,748 INFO mapred.JobTracker (JobTracker.java:removeMarkedTasks(802)) - Removed completed task 'task_0003_m_000001_0' from 'tracker_foo.com:60042'
[junit] 2007-02-28 21:10:15,145 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(1056)) - task_0003_r_000000_0 0.11111112% reduce > copy (1 of 3 at 0.00 MB/s) >
[junit] 2007-02-28 21:10:15,373 INFO mapred.JobClient (JobClient.java:runJob(584)) - Task Id : task_0003_m_000001_0, Status : FAILED
[junit] task_0003_m_000001_0: 2007-02-28 21:10:11,670 WARN mapred.TaskTracker (TaskTracker.java:main(1449)) - Error running child
[junit] task_0003_m_000001_0: java.lang.ClassCastException: org.apache.hadoop.mapred.TestMiniMRLocalFS$MyInputFormat$MySplit
[junit] task_0003_m_000001_0: at org.apache.hadoop.mapred.TextInputFormat.getRecordReader(TextInputFormat.java:46)
[junit] task_0003_m_000001_0: at org.apache.hadoop.mapred.MapTask.run(MapTask.java:145)
[junit] task_0003_m_000001_0: at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1444)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HADOOP-1058) ClassCastException in
TextInputFormat.getRecordReader
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley resolved HADOOP-1058.
-----------------------------------
Resolution: Duplicate
This was fixed by removing the port rolling in mini-mr cluster in HADOOP-1085.
> ClassCastException in TextInputFormat.getRecordReader
> -----------------------------------------------------
>
> Key: HADOOP-1058
> URL: https://issues.apache.org/jira/browse/HADOOP-1058
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.11.2
> Reporter: Nigel Daley
>
> Running TestMiniMRLocalFS on Linux, I saw this exception during the 3rd job that it runs:
> [junit] 2007-02-28 21:10:14,739 INFO mapred.TaskRunner (MapTaskRunner.java:close(46)) - task_0003_m_000001_0 done; removing files.
> [junit] 2007-02-28 21:10:14,746 INFO mapred.TaskInProgress (TaskInProgress.java:updateStatus(328)) - Error from task_0003_m_000001_0: java.lang.ClassCastException: org.apache.hadoop.mapred.TestMiniMRLocalFS$MyInputFormat$MySplit
> [junit] at org.apache.hadoop.mapred.TextInputFormat.getRecordReader(TextInputFormat.java:46)
> [junit] at org.apache.hadoop.mapred.MapTask.run(MapTask.java:145)
> [junit] at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1444)
> [junit] 2007-02-28 21:10:14,747 INFO mapred.TaskInProgress (TaskInProgress.java:failedSubTask(380)) - Task 'task_0003_m_000001_0' has been lost.
> [junit] 2007-02-28 21:10:14,748 INFO mapred.JobTracker (JobTracker.java:removeMarkedTasks(802)) - Removed completed task 'task_0003_m_000001_0' from 'tracker_foo.com:60042'
> [junit] 2007-02-28 21:10:15,145 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(1056)) - task_0003_r_000000_0 0.11111112% reduce > copy (1 of 3 at 0.00 MB/s) >
> [junit] 2007-02-28 21:10:15,373 INFO mapred.JobClient (JobClient.java:runJob(584)) - Task Id : task_0003_m_000001_0, Status : FAILED
> [junit] task_0003_m_000001_0: 2007-02-28 21:10:11,670 WARN mapred.TaskTracker (TaskTracker.java:main(1449)) - Error running child
> [junit] task_0003_m_000001_0: java.lang.ClassCastException: org.apache.hadoop.mapred.TestMiniMRLocalFS$MyInputFormat$MySplit
> [junit] task_0003_m_000001_0: at org.apache.hadoop.mapred.TextInputFormat.getRecordReader(TextInputFormat.java:46)
> [junit] task_0003_m_000001_0: at org.apache.hadoop.mapred.MapTask.run(MapTask.java:145)
> [junit] task_0003_m_000001_0: at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1444)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1058) ClassCastException in
TextInputFormat.getRecordReader
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12483352 ]
Owen O'Malley commented on HADOOP-1058:
---------------------------------------
I believe this to be an artifact of HADOOP-1085. In particular, the confusion of task trackers trying to use the same local directories.
> ClassCastException in TextInputFormat.getRecordReader
> -----------------------------------------------------
>
> Key: HADOOP-1058
> URL: https://issues.apache.org/jira/browse/HADOOP-1058
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.11.2
> Reporter: Nigel Daley
>
> Running TestMiniMRLocalFS on Linux, I saw this exception during the 3rd job that it runs:
> [junit] 2007-02-28 21:10:14,739 INFO mapred.TaskRunner (MapTaskRunner.java:close(46)) - task_0003_m_000001_0 done; removing files.
> [junit] 2007-02-28 21:10:14,746 INFO mapred.TaskInProgress (TaskInProgress.java:updateStatus(328)) - Error from task_0003_m_000001_0: java.lang.ClassCastException: org.apache.hadoop.mapred.TestMiniMRLocalFS$MyInputFormat$MySplit
> [junit] at org.apache.hadoop.mapred.TextInputFormat.getRecordReader(TextInputFormat.java:46)
> [junit] at org.apache.hadoop.mapred.MapTask.run(MapTask.java:145)
> [junit] at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1444)
> [junit] 2007-02-28 21:10:14,747 INFO mapred.TaskInProgress (TaskInProgress.java:failedSubTask(380)) - Task 'task_0003_m_000001_0' has been lost.
> [junit] 2007-02-28 21:10:14,748 INFO mapred.JobTracker (JobTracker.java:removeMarkedTasks(802)) - Removed completed task 'task_0003_m_000001_0' from 'tracker_foo.com:60042'
> [junit] 2007-02-28 21:10:15,145 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(1056)) - task_0003_r_000000_0 0.11111112% reduce > copy (1 of 3 at 0.00 MB/s) >
> [junit] 2007-02-28 21:10:15,373 INFO mapred.JobClient (JobClient.java:runJob(584)) - Task Id : task_0003_m_000001_0, Status : FAILED
> [junit] task_0003_m_000001_0: 2007-02-28 21:10:11,670 WARN mapred.TaskTracker (TaskTracker.java:main(1449)) - Error running child
> [junit] task_0003_m_000001_0: java.lang.ClassCastException: org.apache.hadoop.mapred.TestMiniMRLocalFS$MyInputFormat$MySplit
> [junit] task_0003_m_000001_0: at org.apache.hadoop.mapred.TextInputFormat.getRecordReader(TextInputFormat.java:46)
> [junit] task_0003_m_000001_0: at org.apache.hadoop.mapred.MapTask.run(MapTask.java:145)
> [junit] task_0003_m_000001_0: at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1444)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.