You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Ashish (JIRA)" <ji...@apache.org> on 2018/05/31 07:13:00 UTC
[jira] [Created] (PARQUET-1316) Exception
:"org.apache.parquet.schema.IncompatibleSchemaModificationException: cannot
merge original type
Ashish created PARQUET-1316:
-------------------------------
Summary: Exception :"org.apache.parquet.schema.IncompatibleSchemaModificationException: cannot merge original type
Key: PARQUET-1316
URL: https://issues.apache.org/jira/browse/PARQUET-1316
Project: Parquet
Issue Type: Bug
Reporter: Ashish
I am merging large number(~5000) of tiny parq files into single bigger parq file using below command.
java -jar <path to parquet-tools-1.9.1-SNAPSHOT.jar> merge <path to tiny parq files> <output file name>.
*I am getting exception as "org.apache.parquet.schema.IncompatibleSchemaModificationException: cannot merge original type null into UTF8"*
while searching for this exception I found that it is being generated from class 'GroupType.java' which is located in "parquet-mr-master/parquet-column/src/main/java/org/apache/parquet/schema" directory.
I wanted to modify the code in this file and wanted to rebuild parq_tools using mvn clean package -Plocal command.
*But the issue is mvn clean package -Plocal command is always downloading latest version of "parquet-column-1.9.1-SNAPSHOT.jar" in dir "/home/ubuntu/.m2/repository/org/apache/parquet/parquet-column/1.9.1-SNAPSHOT".*
please suggest where shall I copy the compiled version of parquet-column-1.9.1-SNAPSHOT.jar , so that rebuliding of "parquet-tools-1.9.1-SNAPSHOT.jar" can take changes from my parquet-coumn-1.91.1-snapshot.jar file.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)