You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Julien Le Dem (JIRA)" <ji...@apache.org> on 2015/04/06 23:40:13 UTC

[jira] [Commented] (PARQUET-235) Fix compatibility of parquet.metadata with 1.5.0

    [ https://issues.apache.org/jira/browse/PARQUET-235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14482009#comment-14482009 ] 

Julien Le Dem commented on PARQUET-235:
---------------------------------------

I don't think those were meant to be public.
possibly we want parquet.hadoop.metadata to be blacklisted in the semver plugin.

> Fix compatibility of parquet.metadata with 1.5.0
> ------------------------------------------------
>
>                 Key: PARQUET-235
>                 URL: https://issues.apache.org/jira/browse/PARQUET-235
>             Project: Parquet
>          Issue Type: Bug
>          Components: parquet-mr
>    Affects Versions: 1.6.0
>            Reporter: Ryan Blue
>            Priority: Blocker
>             Fix For: 1.6.0
>
>
> There are quite a few incompatible changes to {{parquet.metadata}} (see below). It seems like it is part of the API because the metadata is exposed. Fixing it will be annoying because {{ColumnPath}} was removed entirely.
> If this is public, then we need to fix compatibility.
> {code:title=parquet.metadata changes}
> Class parquet.hadoop.metadata.Canonicalizer
>  Removed Class , access public super synchronized
> Class parquet.hadoop.metadata.ColumnChunkMetaData
>  Added Method getPath, desc ()Lparquet/common/schema/ColumnPath;, access public
>  Removed Method get, sig (Lparquet/hadoop/metadata/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set<Lparquet/column/Encoding;>;Lparquet/column/statistics/Statistics;JJJJJ)Lparquet/hadoop/metadata/ColumnChunkMetaData;, desc (Lparquet/hadoop/metadata/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set;Lparquet/column/statistics/Statistics;JJJJJ)Lparquet/hadoop/metadata/ColumnChunkMetaData;, access public static
>  Added Method get, sig (Lparquet/common/schema/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set<Lparquet/column/Encoding;>;JJJJJ)Lparquet/hadoop/metadata/ColumnChunkMetaData;, desc (Lparquet/common/schema/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set;JJJJJ)Lparquet/hadoop/metadata/ColumnChunkMetaData;, access public static
>  Added Method get, sig (Lparquet/common/schema/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set<Lparquet/column/Encoding;>;Lparquet/column/statistics/Statistics;JJJJJ)Lparquet/hadoop/metadata/ColumnChunkMetaData;, desc (Lparquet/common/schema/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set;Lparquet/column/statistics/Statistics;JJJJJ)Lparquet/hadoop/metadata/ColumnChunkMetaData;, access public static
>  Removed Method getPath, desc ()Lparquet/hadoop/metadata/ColumnPath;, access public
>  Removed Method get, sig (Lparquet/hadoop/metadata/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set<Lparquet/column/Encoding;>;JJJJJ)Lparquet/hadoop/metadata/ColumnChunkMetaData;, desc (Lparquet/hadoop/metadata/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set;JJJJJ)Lparquet/hadoop/metadata/ColumnChunkMetaData;, access public static
> Class parquet.hadoop.metadata.ColumnChunkProperties
>  Added Method getPath, desc ()Lparquet/common/schema/ColumnPath;, access public
>  Removed Method getPath, desc ()Lparquet/hadoop/metadata/ColumnPath;, access public
>  Removed Method get, sig (Lparquet/hadoop/metadata/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set<Lparquet/column/Encoding;>;)Lparquet/hadoop/metadata/ColumnChunkProperties;, desc (Lparquet/hadoop/metadata/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set;)Lparquet/hadoop/metadata/ColumnChunkProperties;, access public static
>  Added Method get, sig (Lparquet/common/schema/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set<Lparquet/column/Encoding;>;)Lparquet/hadoop/metadata/ColumnChunkProperties;, desc (Lparquet/common/schema/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set;)Lparquet/hadoop/metadata/ColumnChunkProperties;, access public static
> Class parquet.hadoop.metadata.ColumnPath
>  Removed Class , access final public super synchronized
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)