You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Ashish (JIRA)" <ji...@apache.org> on 2018/05/31 07:13:00 UTC

[jira] [Created] (PARQUET-1316) Exception :"org.apache.parquet.schema.IncompatibleSchemaModificationException: cannot merge original type

Ashish created PARQUET-1316:
-------------------------------

             Summary: Exception :"org.apache.parquet.schema.IncompatibleSchemaModificationException: cannot merge original type
                 Key: PARQUET-1316
                 URL: https://issues.apache.org/jira/browse/PARQUET-1316
             Project: Parquet
          Issue Type: Bug
            Reporter: Ashish


I am merging large number(~5000) of tiny parq files into single bigger parq file using below command.

 

java -jar <path to parquet-tools-1.9.1-SNAPSHOT.jar> merge <path to tiny parq files> <output file name>.

*I am getting exception as "org.apache.parquet.schema.IncompatibleSchemaModificationException: cannot merge original type null into UTF8"*

 

while searching for this exception I found that it is being generated from class 'GroupType.java' which is located in "parquet-mr-master/parquet-column/src/main/java/org/apache/parquet/schema" directory.

I wanted to modify the code in this file and wanted to rebuild parq_tools using mvn clean package -Plocal command.

*But the issue is mvn clean package -Plocal command is always downloading latest version of "parquet-column-1.9.1-SNAPSHOT.jar" in dir "/home/ubuntu/.m2/repository/org/apache/parquet/parquet-column/1.9.1-SNAPSHOT".*

please suggest where shall I copy the compiled version of parquet-column-1.9.1-SNAPSHOT.jar , so that rebuliding of "parquet-tools-1.9.1-SNAPSHOT.jar" can take changes from my parquet-coumn-1.91.1-snapshot.jar file.

 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)