You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2020/08/10 03:40:00 UTC

[jira] [Assigned] (FLINK-18678) Hive connector fails to create vector orc reader if user specifies incorrect hive version

     [ https://issues.apache.org/jira/browse/FLINK-18678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jingsong Lee reassigned FLINK-18678:
------------------------------------

    Assignee: Rui Li

> Hive connector fails to create vector orc reader if user specifies incorrect hive version
> -----------------------------------------------------------------------------------------
>
>                 Key: FLINK-18678
>                 URL: https://issues.apache.org/jira/browse/FLINK-18678
>             Project: Flink
>          Issue Type: Improvement
>          Components: Connectors / Hive, Formats (JSON, Avro, Parquet, ORC, SequenceFile)
>    Affects Versions: 1.11.1
>            Reporter: Rui Li
>            Assignee: Rui Li
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.11.2
>
>
> Issue reported by user. User's Hive deployment is 2.1.1 and uses {{flink-sql-connector-hive-2.2.0_2.11-1.11.0.jar}} in Flink lib. If user specifies Hive version as 2.1.1, then creating vectorized orc reader fails with exception:
> {noformat}
> java.lang.ClassCastException: org.apache.hadoop.hive.ql.io.orc.ReaderImpl cannot be cast to org.apache.orc.Reader
>   at org.apache.flink.orc.shim.OrcShimV200.createReader(OrcShimV200.java:63) ~[flink-sql-connector-hive-2.2.0_2.11-1.11.0.jar:1.11.0]
>   at org.apache.flink.orc.shim.OrcShimV200.createRecordReader(OrcShimV200.java:98) ~[flink-sql-connector-hive-2.2.0_2.11-1.11.0.jar:1.11.0]
>   at org.apache.flink.orc.OrcSplitReader.<init>(OrcSplitReader.java:73) ~[flink-sql-connector-hive-2.2.0_2.11-1.11.0.jar:1.11.0]
>   at org.apache.flink.orc.OrcColumnarRowSplitReader.<init>(OrcColumnarRowSplitReader.java:54) ~[flink-sql-connector-hive-2.2.0_2.11-1.11.0.jar:1.11.0]
>   at org.apache.flink.orc.OrcSplitReaderUtil.genPartColumnarRowReader(OrcSplitReaderUtil.java:91) ~[flink-sql-connector-hive-2.2.0_2.11-1.11.0.jar:1.11.0]
> ......
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)