You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Hive QA (JIRA)" <ji...@apache.org> on 2014/03/29 15:30:16 UTC
[jira] [Commented] (HIVE-6783) Incompatible schema for maps between
parquet-hive and parquet-pig
[ https://issues.apache.org/jira/browse/HIVE-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13954269#comment-13954269 ]
Hive QA commented on HIVE-6783:
-------------------------------
{color:green}Overall{color}: +1 all checks pass
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12637609/HIVE-6783.1.patch.txt
{color:green}SUCCESS:{color} +1 5503 tests passed
Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/2031/testReport
Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/2031/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12637609
> Incompatible schema for maps between parquet-hive and parquet-pig
> -----------------------------------------------------------------
>
> Key: HIVE-6783
> URL: https://issues.apache.org/jira/browse/HIVE-6783
> Project: Hive
> Issue Type: Bug
> Components: File Formats
> Affects Versions: 0.13.0
> Reporter: Tongjie Chen
> Fix For: 0.13.0
>
> Attachments: HIVE-6783.1.patch.txt
>
>
> see also in following parquet issue:
> https://github.com/Parquet/parquet-mr/issues/290
> The schema written for maps isn't compatible between hive and pig. This means any files written in one cannot be properly read in the other.
> More specifically, for the same map column c1, parquet-pig generates schema:
> message pig_schema {
> optional group c1 (MAP) {
> repeated group map (MAP_KEY_VALUE) {
> required binary key (UTF8);
> optional binary value;
> }
> }
> }
> while parquet-hive generates schema:
> message hive_schema {
> optional group c1 (MAP_KEY_VALUE) {
> repeated group map {
> required binary key;
> optional binary value;
> }
> }
> }
--
This message was sent by Atlassian JIRA
(v6.2#6252)