You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Gunther Hagleitner (JIRA)" <ji...@apache.org> on 2014/10/28 18:26:33 UTC

[jira] [Commented] (HIVE-8631) Compressed transaction list cannot be parsed in job.xml

    [ https://issues.apache.org/jira/browse/HIVE-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187135#comment-14187135 ] 

Gunther Hagleitner commented on HIVE-8631:
------------------------------------------

we've added an option to send the compressed plan via conf to tez. The way we did it there was to base 64 the compressed string. That should work here too.

Anyways: +1 for the patch to back it out.

> Compressed transaction list cannot be parsed in job.xml
> -------------------------------------------------------
>
>                 Key: HIVE-8631
>                 URL: https://issues.apache.org/jira/browse/HIVE-8631
>             Project: Hive
>          Issue Type: Bug
>          Components: Transactions
>    Affects Versions: 0.14.0
>            Reporter: Alan Gates
>            Assignee: Alan Gates
>            Priority: Blocker
>             Fix For: 0.14.0
>
>         Attachments: HIVE-8631.patch
>
>
> HIVE-8341 added code to compress the transaction list in the JobConf when it reaches a certain size.  This breaks when the JobConf is converted to job.xml and sent to MR.  The special characters are not correctly escaped.  
> The proposed fix is to back out the compression (not the changes to ScriptOperator) for now and look later at compressing/encoding it in a way that works with job.xml.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)