[jira] [Assigned] (HUDI-8880) Fix hive scan exception after new column is added

["Shuo Cheng (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HUDI-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shuo Cheng reassigned HUDI-8880:
--------------------------------

    Assignee: Shuo Cheng

> Fix hive scan exception after new column is added
> -------------------------------------------------
>
>                 Key: HUDI-8880
>                 URL: https://issues.apache.org/jira/browse/HUDI-8880
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: hive
>            Reporter: Shuo Cheng
>            Assignee: Shuo Cheng
>            Priority: Major
>             Fix For: 1.0.1
>
>
> When add a new column in hudi table，execute select * from hudiTable in hive，have some exception：Caused by: java.lang.RuntimeException: org.apache.hudi.exception.HoodieException:Field ext4 not found in log schema.
>  
> {code:java}
> Caused by: java.lang.RuntimeException: org.apache.hudi.exception.HoodieException:Field ext4 not found in log schema. Query cannot proceed! Derived Schema Fields: [ dzlbdm2, cjrxm, csyxzmbh, fqmz, qfjgmc, dz_cj2, dz_sz2, scsj, _hoodie_partition_path, xsecsrqsj, _hoodie_commit_seqno, fqsfzjlbdm, qfrq, _hoodie_commit_time, jgmc, scwdcs, jlsj, mqxm, lybs, dz_hm2, hzjcsyh, jsryxm, _hoodie_file_name, fqxm, dzqc2, lzryxm, mqgj, gxrxm, qfryxm, jgdm, gxsj, dz_xq2, qfjgdm, mqsfzjhm, csyz, qfrybh, xsexbdm, dz_xz2, mqnl, pch, mqzz, cstz, scwdbz, fqgj, mqmz, dz_sq2, sjzt, yzbm2, wdsyh, cssc, xsexm, mqsfzjlbdm, _hoodie_record_key, fqsfzjhm, fqnl, fqzz, jsrybh, plan_id]
> at org.apache.hudi.avro.HoodieAvroUtils.generateProjectionSchema(HoodieAvroUtils.java:582)
> at org.apache.hudi.hadoop.avro.HoodieAvroParquetReader.(HoodieAvroParquetReader.java:69)
> at org.apache.hudi.hadoop.avro.HoodieTimestampAwareParquetInputFormat.createRecordReader(HoodieTimestampAwareParquetInputFormat.java:42)
> at org.apache.hadoop.hive.ql.io.parquet.read.ParquetRecordReaderWrapper.(ParquetRecordReaderWrapper.java:94)
> at org.apache.hadoop.hive.ql.io.parquet.read.ParquetRecordReaderWrapper.(ParquetRecordReaderWrapper.java:60)
> at org.apache.hudi.hadoop.HoodieParquetInputFormat.getRecordReaderInternal(HoodieParquetInputFormat.java:129)
> at org.apache.hudi.hadoop.HoodieParquetInputFormat.getRecordReader(HoodieParquetInputFormat.java:121)
> at org.apache.hadoop.hive.ql.exec.FetchOperator$FetchInputFormatSplit.getRecordReader(FetchOperator.java:695)
> at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:333)
> at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:459) {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)