You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Benjamin Reed (JIRA)" <ji...@apache.org> on 2009/07/09 05:42:15 UTC
[jira] Assigned: (PIG-836) Allow setting of end-of-record delimiter
in PigStorage
[ https://issues.apache.org/jira/browse/PIG-836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benjamin Reed reassigned PIG-836:
---------------------------------
Assignee: Benjamin Reed
> Allow setting of end-of-record delimiter in PigStorage
> ------------------------------------------------------
>
> Key: PIG-836
> URL: https://issues.apache.org/jira/browse/PIG-836
> Project: Pig
> Issue Type: Improvement
> Components: impl
> Reporter: George Mavromatis
> Assignee: Benjamin Reed
> Fix For: 0.2.0
>
>
> PigStorage allows overriding the default field delimiter ('\t'), but does not allow overriding the record delimiter ('\n').
> It is a valid use case that fields contain new lines, e.g. because they are contents of a document/web page. It is possible for the user to create a custom load/store UDF to achieve that, but that is extra work on the user, many users will have to do it , and that udf would be the exact code duplicate of the PigStorage except for the delimiter.
> Thus, PigStorage() should allow to configure both field and record separators.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.