You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org> on 2008/07/08 08:16:31 UTC
[jira] Updated: (HADOOP-3711) Streaming input is not parsed
properly to find the separator
[ https://issues.apache.org/jira/browse/HADOOP-3711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated HADOOP-3711:
--------------------------------------------
Attachment: patch-3711.txt
Here is patch fixing the bug.
I updated the testcase to parse such input.
> Streaming input is not parsed properly to find the separator
> ------------------------------------------------------------
>
> Key: HADOOP-3711
> URL: https://issues.apache.org/jira/browse/HADOOP-3711
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Amareshwari Sriramadasu
> Assignee: Amareshwari Sriramadasu
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: patch-3711.txt
>
>
> Sometimes, finding field separator position in the input line for streaming fails with following exception:
> org.apache.hadoop.streaming.PipeMapRed: java.lang.IllegalArgumentException: splitPos must be in the range [0, 17]: 74
> at org.apache.hadoop.streaming.UTF8ByteArrayUtils.splitKeyVal(UTF8ByteArrayUtils.java:152)
> at org.apache.hadoop.streaming.PipeMapRed.splitKeyVal(PipeMapRed.java:337)
> at org.apache.hadoop.streaming.PipeMapRed$MROutputThread.run(PipeMapRed.java:363)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.