You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Doug Cutting (JIRA)" <ji...@apache.org> on 2007/07/12 00:40:04 UTC
[jira] Created: (HADOOP-1596) TestSymLink is failing
TestSymLink is failing
----------------------
Key: HADOOP-1596
URL: https://issues.apache.org/jira/browse/HADOOP-1596
Project: Hadoop
Issue Type: Bug
Components: contrib/streaming
Reporter: Doug Cutting
Priority: Blocker
Fix For: 0.14.0
TestSymLink started failing sometime today.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1596) TestSymLink is failing
Posted by "Konstantin Shvachko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12511928 ]
Konstantin Shvachko commented on HADOOP-1596:
---------------------------------------------
This is the result of changing job id HADOOP-1473
The initial exception in TestSymLink is hard to find but it actually is this:
java.lang.NumberFormatException: For input string: "m"
at java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
at java.lang.Integer.parseInt(Integer.java:447)
at java.lang.Integer.parseInt(Integer.java:497)
at org.apache.hadoop.streaming.StreamUtil.getTaskInfo(StreamUtil.java:451)
at org.apache.hadoop.streaming.PipeMapRed.setStreamJobDetails(PipeMapRed.java:190)
at org.apache.hadoop.streaming.PipeMapRed.configure(PipeMapRed.java:132)
at org.apache.hadoop.streaming.PipeMapper.configure(PipeMapper.java:61)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:58)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:82)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:32)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:58)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:82)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:185)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1763)
After that the task remains not configured. And we see other exceptions NPE or "File does not exist".
So the problem is that streaming was not changed to correctly parse new task ids.
A more general problem with streaming is that it just dumps exceptions into stderr and proceeds like nothing happened.
> TestSymLink is failing
> ----------------------
>
> Key: HADOOP-1596
> URL: https://issues.apache.org/jira/browse/HADOOP-1596
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Doug Cutting
> Priority: Blocker
> Fix For: 0.14.0
>
>
> TestSymLink started failing sometime today.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1596) TestSymLink is failing
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12511899 ]
Doug Cutting commented on HADOOP-1596:
--------------------------------------
Hudson builds will fail due to this, so folks should refrain from marking thinngs "Patch Available" until this is resolved.
> TestSymLink is failing
> ----------------------
>
> Key: HADOOP-1596
> URL: https://issues.apache.org/jira/browse/HADOOP-1596
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Doug Cutting
> Priority: Blocker
> Fix For: 0.14.0
>
>
> TestSymLink started failing sometime today.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1596) TestSymLink is failing
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-1596:
----------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this.
> TestSymLink is failing
> ----------------------
>
> Key: HADOOP-1596
> URL: https://issues.apache.org/jira/browse/HADOOP-1596
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.14.0
> Reporter: Doug Cutting
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.14.0
>
> Attachments: parse-jobid.patch
>
>
> TestSymLink started failing sometime today.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-1596) TestSymLink is failing
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley reassigned HADOOP-1596:
-------------------------------------
Assignee: Owen O'Malley
> TestSymLink is failing
> ----------------------
>
> Key: HADOOP-1596
> URL: https://issues.apache.org/jira/browse/HADOOP-1596
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Doug Cutting
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.14.0
>
>
> TestSymLink started failing sometime today.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1596) TestSymLink is failing
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12512080 ]
Devaraj Das commented on HADOOP-1596:
-------------------------------------
+1
> TestSymLink is failing
> ----------------------
>
> Key: HADOOP-1596
> URL: https://issues.apache.org/jira/browse/HADOOP-1596
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.14.0
> Reporter: Doug Cutting
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.14.0
>
> Attachments: parse-jobid.patch
>
>
> TestSymLink started failing sometime today.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1596) TestSymLink is failing
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12512184 ]
Hudson commented on HADOOP-1596:
--------------------------------
Integrated in Hadoop-Nightly #153 (See [http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/153/])
> TestSymLink is failing
> ----------------------
>
> Key: HADOOP-1596
> URL: https://issues.apache.org/jira/browse/HADOOP-1596
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.14.0
> Reporter: Doug Cutting
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.14.0
>
> Attachments: parse-jobid.patch
>
>
> TestSymLink started failing sometime today.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1596) TestSymLink is failing
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-1596:
----------------------------------
Affects Version/s: 0.14.0
Status: Patch Available (was: Open)
> TestSymLink is failing
> ----------------------
>
> Key: HADOOP-1596
> URL: https://issues.apache.org/jira/browse/HADOOP-1596
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.14.0
> Reporter: Doug Cutting
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.14.0
>
> Attachments: parse-jobid.patch
>
>
> TestSymLink started failing sometime today.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1596) TestSymLink is failing
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-1596:
----------------------------------
Attachment: parse-jobid.patch
Argh. I didn't see that Konstatin had found it until I had and went to upload the patch. Anyways, here is the patch. I not only fixed parsing the jobids, I also made it throw out of configure if anything went wrong.
> TestSymLink is failing
> ----------------------
>
> Key: HADOOP-1596
> URL: https://issues.apache.org/jira/browse/HADOOP-1596
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Doug Cutting
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.14.0
>
> Attachments: parse-jobid.patch
>
>
> TestSymLink started failing sometime today.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1596) TestSymLink is failing
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12511904 ]
Nigel Daley commented on HADOOP-1596:
-------------------------------------
Perhaps this is related to HADOOP-1587
> TestSymLink is failing
> ----------------------
>
> Key: HADOOP-1596
> URL: https://issues.apache.org/jira/browse/HADOOP-1596
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Doug Cutting
> Priority: Blocker
> Fix For: 0.14.0
>
>
> TestSymLink started failing sometime today.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.