[jira] [Commented] (PIG-836) Allow setting of end-of-record delimiter in PigStorage

["Daniel Tomes (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PIG-836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14528516#comment-14528516 ] 

Daniel Tomes commented on PIG-836:
----------------------------------

Daniel, if you actually want to use a backslash as a delimiter you mush escape that character first by using a second slash. For example, if your delimiter is \ then you would neet to use '\\' because backslash is a reserve character for much of regex.

> Allow setting of end-of-record delimiter in PigStorage
> ------------------------------------------------------
>
>                 Key: PIG-836
>                 URL: https://issues.apache.org/jira/browse/PIG-836
>             Project: Pig
>          Issue Type: Improvement
>          Components: impl
>            Reporter: George Mavromatis
>            Assignee: Benjamin Reed
>
> PigStorage allows overriding the default field delimiter ('\t'), but does not allow overriding the record delimiter ('\n').
> It is a valid use case that fields contain new lines, e.g. because they are contents of a document/web page. It is possible for the user to create a custom load/store UDF to achieve that, but that is extra work on the user, many users will have to do it , and that udf would be the exact code duplicate of the PigStorage except for the delimiter.
> Thus, PigStorage() should allow to configure both field and record separators.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)