You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org> on 2008/07/08 07:57:12 UTC
[jira] Commented: (HADOOP-3711) Streaming input is not parsed
properly to find the separator
[ https://issues.apache.org/jira/browse/HADOOP-3711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12611464#action_12611464 ]
Amareshwari Sriramadasu commented on HADOOP-3711:
-------------------------------------------------
In org.apache.hadoop.streaming.PipeMapRed.splitKeyVal(), the length passed in the parameter should be passed down to the UTF8ByteArrayUtils.findBytes() routine instead of byte[].length
> Streaming input is not parsed properly to find the separator
> ------------------------------------------------------------
>
> Key: HADOOP-3711
> URL: https://issues.apache.org/jira/browse/HADOOP-3711
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Amareshwari Sriramadasu
> Assignee: Amareshwari Sriramadasu
> Priority: Blocker
> Fix For: 0.18.0
>
>
> Sometimes, finding field separator position in the input line for streaming fails with following exception:
> org.apache.hadoop.streaming.PipeMapRed: java.lang.IllegalArgumentException: splitPos must be in the range [0, 17]: 74
> at org.apache.hadoop.streaming.UTF8ByteArrayUtils.splitKeyVal(UTF8ByteArrayUtils.java:152)
> at org.apache.hadoop.streaming.PipeMapRed.splitKeyVal(PipeMapRed.java:337)
> at org.apache.hadoop.streaming.PipeMapRed$MROutputThread.run(PipeMapRed.java:363)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.