You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "rajan-v (via GitHub)" <gi...@apache.org> on 2023/04/29 11:14:40 UTC
[GitHub] [iceberg] rajan-v opened a new issue, #7471: iceberg-orc-1.2.1.jar: OrcFileAppender.java have breaking dependencies on orc-core-1.5.6-nohive.jar and orc-core-1.8.2.jar
rajan-v opened a new issue, #7471:
URL: https://github.com/apache/iceberg/issues/7471
### Apache Iceberg version
1.2.1 (latest release)
### Query engine
Flink
### Please describe the bug ๐
iceberg-orc-1.2.1.jar has dependency on org.apache.orc ยป orc-core 1.8.2
https://mvnrepository.com/artifact/org.apache.iceberg/iceberg-orc/1.2.1
But OrcFileAppender.java under iceberg-orc-1.2.1.jar depends on org.apache.orc.storage.ql.exec.vector.VectorizedRowBatch which is only present in orc-core-1.5.6-nohive.jar
Problem
I am using flink-1.16.1 and related packages for my project. I am not using iceberg-flink-runtime-1.16 as its causing avro object serilization issue due to shaded avro jars.
Based on runtime picking of picked orc-core-1.8.2.jar/orc-core-1.5.6-nohive.jar version I am getting following errors
From these two classes OrcFileAppender & ORCSchemaUtil
java.lang.NoSuchMethodError: org.apache.orc.TypeDescription.setAttribute(Ljava/lang/String;Ljava/lang/String;)Lorg/apache/orc/TypeDescription;
java.lang.NoSuchMethodError: org.apache.orc.TypeDescription.createRowBatch(I)Lorg/apache/orc/storage/ql/exec/vector/VectorizedRowBatch;
OrcFileAppender imports org.apache.**orc.storage**.ql.exec.vector.VectorizedRowBatch in orc-core-1.8.2.jar
but imports org.apache.**hadoop.hive**.ql.exec.vector.VectorizedRowBatch in orc-core-1.8.2.jar
ORCSchemaUtil imports org.apache.orc.TypeDescription
calls setAttribute(..) method which is present in class TypeDescription under orc-core-1.8.2.jar but not in class TypeDescription under orc-core-1.5.6-nohive.jar
Any resolution for this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] rajan-v commented on issue #7471: iceberg-orc-1.2.1.jar: OrcFileAppender.java have breaking dependencies on orc-core-1.5.6-nohive.jar and orc-core-1.8.2.jar
Posted by "rajan-v (via GitHub)" <gi...@apache.org>.
rajan-v commented on issue #7471:
URL: https://github.com/apache/iceberg/issues/7471#issuecomment-1529671266
Resolved use orc-core-1.8.2-nohive.jar
https://repo.maven.apache.org/maven2/org/apache/orc/orc-core/1.8.2/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] rajan-v closed issue #7471: iceberg-orc-1.2.1.jar: OrcFileAppender.java have breaking dependencies on orc-core-1.5.6-nohive.jar and orc-core-1.8.2.jar
Posted by "rajan-v (via GitHub)" <gi...@apache.org>.
rajan-v closed issue #7471: iceberg-orc-1.2.1.jar: OrcFileAppender.java have breaking dependencies on orc-core-1.5.6-nohive.jar and orc-core-1.8.2.jar
URL: https://github.com/apache/iceberg/issues/7471
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org