[jira] [Commented] (PIG-4554) Compress pig.script before encoding

["Daniel Dai (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PIG-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949664#comment-14949664 ] 

Daniel Dai commented on PIG-4554:
---------------------------------

+1

> Compress pig.script before encoding
> -----------------------------------
>
>                 Key: PIG-4554
>                 URL: https://issues.apache.org/jira/browse/PIG-4554
>             Project: Pig
>          Issue Type: Improvement
>    Affects Versions: 0.14.0
>            Reporter: Rohini Palaniswamy
>            Assignee: Sandeep Samdaria
>              Labels: newbie
>             Fix For: 0.16.0
>
>         Attachments: PIG-4554-2.patch, PIG-4554-3.patch, PIG-4554-4.patch, PIG-4554.patch
>
>
>   Currently we truncate the pig script (maxScriptSize = 10240) and base64 encode it and store in config. We should remove the truncation and store the full script by compressing and then doing base64 encoding. We already do that for udfcontext, etc. It will save space as it will compress really well and will also give the full pig script while debugging.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)