You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Bowen Li (Jira)" <ji...@apache.org> on 2019/12/23 17:57:00 UTC
[jira] [Closed] (FLINK-15348) Fix orc optimization for version less
than 2.3 by introducing orc shim
[ https://issues.apache.org/jira/browse/FLINK-15348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bowen Li closed FLINK-15348.
----------------------------
Resolution: Fixed
master: 790a07787e3dd6f5795b4fb5cb84df953363d64a
1.10: 37fbbd4ba57d356b1877a9b7d600254550b21321
> Fix orc optimization for version less than 2.3 by introducing orc shim
> ----------------------------------------------------------------------
>
> Key: FLINK-15348
> URL: https://issues.apache.org/jira/browse/FLINK-15348
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Hive
> Affects Versions: 1.10.0, 1.11.0
> Reporter: Bowen Li
> Assignee: Jingsong Lee
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.10.0, 1.11.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Reading ORC table from Hive 2.0.1 fails with:
> {noformat}
> Caused by: java.lang.NoSuchMethodError: org.apache.orc.OrcFile.createReader(Lorg/apache/hadoop/fs/Path;Lorg/apache/orc/OrcFile$ReaderOptions;)Lorg/apache/orc/Reader;
> at org.apache.flink.orc.OrcSplitReader.<init>(OrcSplitReader.java:78)
> at org.apache.flink.orc.OrcColumnarRowSplitReader.<init>(OrcColumnarRowSplitReader.java:53)
> at org.apache.flink.orc.OrcSplitReaderUtil.genPartColumnarRowReader(OrcSplitReaderUtil.java:93)
> at org.apache.flink.connectors.hive.read.HiveVectorizedOrcSplitReader.<init>(HiveVectorizedOrcSplitReader.java:64)
> at org.apache.flink.connectors.hive.read.HiveTableInputFormat.open(HiveTableInputFormat.java:117)
> at org.apache.flink.connectors.hive.read.HiveTableInputFormat.open(HiveTableInputFormat.java:57)
> at org.apache.flink.streaming.api.functions.source.InputFormatSourceFunction.run(InputFormatSourceFunction.java:85)
> at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:100)
> at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:63)
> at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:196)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)