You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "JasonLee (Jira)" <ji...@apache.org> on 2022/10/12 10:55:00 UTC

[jira] [Created] (HUDI-5020) java.lang.NoSuchMethodError: org.apache.hudi.table.format.cow.vector.reader.ParquetColumnarRowSplitReader.nextRecord()Lorg/apache/flink/table/data/ColumnarRowData

JasonLee created HUDI-5020:
------------------------------

             Summary: java.lang.NoSuchMethodError: org.apache.hudi.table.format.cow.vector.reader.ParquetColumnarRowSplitReader.nextRecord()Lorg/apache/flink/table/data/ColumnarRowData
                 Key: HUDI-5020
                 URL: https://issues.apache.org/jira/browse/HUDI-5020
             Project: Apache Hudi
          Issue Type: Bug
          Components: connectors
         Environment: Flink 1.15.1
Hudi 0.12.0
            Reporter: JasonLee
             Fix For: 0.12.0


The flink task throws the following exception when I query the hudi table

 
{code:java}
java.lang.NoSuchMethodError: org.apache.hudi.table.format.cow.vector.reader.ParquetColumnarRowSplitReader.nextRecord()Lorg/apache/flink/table/data/ColumnarRowData;    at org.apache.hudi.table.format.cow.CopyOnWriteInputFormat.nextRecord(CopyOnWriteInputFormat.java:279)    at org.apache.hudi.table.format.cow.CopyOnWriteInputFormat.nextRecord(CopyOnWriteInputFormat.java:64)    at org.apache.flink.streaming.api.functions.source.InputFormatSourceFunction.run(InputFormatSourceFunction.java:90)    at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:110)    at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:67)    at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:332)
 {code}
It looks like a jar conflict, but I have checked the relevant code and found nothing wrong. Besides, I have put flink-table-common-1.15.1.jar under flink/lib.

The SQL statement is shown below:
{code:java}
CREATE TABLE hudi_test(
  name VARCHAR(20) PRIMARY KEY NOT ENFORCED,
  age INT,
  ts BIGINT,
  dt STRING
)
WITH (
  'connector' = 'hudi',
  'path' = 'hdfs://master:9000/flink/hudi/hudi_test/',
  'table.type' = 'COPY_ON_WRITE' -- this creates a MERGE_ON_READ table, by default is COPY_ON_WRITE
);
select * from hudi_test; {code}
 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)