[parquet-mr] branch master updated: PARQUET-1390: Upgrade Arrow to 0.10.0

[uw...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

uwe pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/parquet-mr.git


The following commit(s) were added to refs/heads/master by this push:
     new d692ce3  PARQUET-1390: Upgrade Arrow to 0.10.0
d692ce3 is described below

commit d692ce3a4205a4274e97dce6add93c687e12a9c2
Author: Andy Grove <an...@rms.com>
AuthorDate: Sun Aug 19 11:12:36 2018 +0200

    PARQUET-1390: Upgrade Arrow to 0.10.0
    
    This upgrades arrow from 0.8.0 to 0.10.0.
    
    This required adding new SchemaConverter visitor methods for fixedSizeBinary data type and I pretty much guessed at how to implement those so would appreciate a review of that.
    
    Author: Andy Grove <an...@rms.com>
    
    Closes #516 from agrove-rms/arrow_upgrade and squashes the following commits:
    
    4a922876 [Andy Grove] Add new visitor methods
    9535a162 [Andy Grove] Upgrade Arrow from 0.8.0 to 0.10.0
---
 parquet-arrow/pom.xml                                          |  2 +-
 .../java/org/apache/parquet/arrow/schema/SchemaConverter.java  | 10 ++++++++++
 2 files changed, 11 insertions(+), 1 deletion(-)

diff --git a/parquet-arrow/pom.xml b/parquet-arrow/pom.xml
index 232167e..e0f305a 100644
--- a/parquet-arrow/pom.xml
+++ b/parquet-arrow/pom.xml
@@ -33,7 +33,7 @@
   <url>https://parquet.apache.org</url>
 
   <properties>
-    <arrow.version>0.8.0</arrow.version>
+    <arrow.version>0.10.0</arrow.version>
   </properties>
 
   <dependencies>
diff --git a/parquet-arrow/src/main/java/org/apache/parquet/arrow/schema/SchemaConverter.java b/parquet-arrow/src/main/java/org/apache/parquet/arrow/schema/SchemaConverter.java
index a7df48c..b0f122c 100644
--- a/parquet-arrow/src/main/java/org/apache/parquet/arrow/schema/SchemaConverter.java
+++ b/parquet-arrow/src/main/java/org/apache/parquet/arrow/schema/SchemaConverter.java
@@ -278,6 +278,11 @@ public class SchemaConverter {
         return primitiveFLBA(12, INTERVAL);
       }
 
+      @Override
+      public TypeMapping visit(ArrowType.FixedSizeBinary fixedSizeBinary) {
+        return primitive(BINARY);
+      }
+
       private TypeMapping mapping(PrimitiveType parquetType) {
         return new PrimitiveTypeMapping(field, parquetType);
       }
@@ -663,6 +668,11 @@ public class SchemaConverter {
         return primitive();
       }
 
+      @Override
+      public TypeMapping visit(ArrowType.FixedSizeBinary fixedSizeBinary) {
+        return primitive();
+      }
+
       private TypeMapping primitive() {
         if (!parquetField.isPrimitive()) {
           throw new IllegalArgumentException("Can not map schemas as one is primitive and the other is not: " + arrowField + " != " + parquetField);