You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Marton Bod (Jira)" <ji...@apache.org> on 2021/03/26 13:21:00 UTC
[jira] [Updated] (HIVE-24947) Casting exception when reading
vectorized parquet file for insert into
[ https://issues.apache.org/jira/browse/HIVE-24947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Marton Bod updated HIVE-24947:
------------------------------
Attachment: show_create_table_source.csv
> Casting exception when reading vectorized parquet file for insert into
> ----------------------------------------------------------------------
>
> Key: HIVE-24947
> URL: https://issues.apache.org/jira/browse/HIVE-24947
> Project: Hive
> Issue Type: Bug
> Reporter: Marton Bod
> Priority: Major
> Attachments: show_create_table_source.csv, show_create_table_target.csv
>
>
> We have two parquet tables (target and source).
> Upon running the query:
> {code:java}
> set hive.vectorized.execution.enabled=true;
> insert into target2 partition(tlmtc_fl_gnrtd_yr_nb, tlmtc_fl_gnrtd_mnth_nb) select * from source;{code}
> The following exception is thrown:
> {code:java}
> Caused by: java.lang.ClassCastException: java.lang.Integer cannot be cast to [B
> at org.apache.hadoop.hive.ql.io.parquet.vector.VectorizedListColumnReader.fillColumnVector(VectorizedListColumnReader.java:308)
> at org.apache.hadoop.hive.ql.io.parquet.vector.VectorizedListColumnReader.convertValueListToListColumnVector(VectorizedListColumnReader.java:342)
> at org.apache.hadoop.hive.ql.io.parquet.vector.VectorizedListColumnReader.readBatch(VectorizedListColumnReader.java:91)
> at org.apache.hadoop.hive.ql.io.parquet.vector.VectorizedParquetRecordReader.nextBatch(VectorizedParquetRecordReader.java:433)
> at org.apache.hadoop.hive.ql.io.parquet.vector.VectorizedParquetRecordReader.next(VectorizedParquetRecordReader.java:376)
> at org.apache.hadoop.hive.ql.io.parquet.vector.VectorizedParquetRecordReader.next(VectorizedParquetRecordReader.java:99)
> at org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.doNext(HiveContextAwareRecordReader.java:365)
> ... 24 more
> {code}
> The same runs without problems when vectorization is turned off.
> Attaching the show create table statements and the sample parquet file so it can reproduced.
> cc [~nareshpr]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)