You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 05:58:08 UTC

[I] java.lang.NoSuchMethodError: org.apache.hudi.table.format.cow.vector.reader.ParquetColumnarRowSplitReader.nextRecord()Lorg/apache/flink/table/data/ColumnarRowData [hudi]

hudi-bot opened a new issue, #15493:
URL: https://github.com/apache/hudi/issues/15493

   The flink task throws the following exception when I query the hudi table
   
    
   {code:java}
   java.lang.NoSuchMethodError: org.apache.hudi.table.format.cow.vector.reader.ParquetColumnarRowSplitReader.nextRecord()Lorg/apache/flink/table/data/ColumnarRowData;    at org.apache.hudi.table.format.cow.CopyOnWriteInputFormat.nextRecord(CopyOnWriteInputFormat.java:279)    at org.apache.hudi.table.format.cow.CopyOnWriteInputFormat.nextRecord(CopyOnWriteInputFormat.java:64)    at org.apache.flink.streaming.api.functions.source.InputFormatSourceFunction.run(InputFormatSourceFunction.java:90)    at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:110)    at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:67)    at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:332)
    {code}
   It looks like a jar conflict, but I have checked the relevant code and found nothing wrong. Besides, I have put flink-table-common-1.15.1.jar under flink/lib.
   
   The SQL statement is shown below:
   {code:java}
   CREATE TABLE hudi_test(
     name VARCHAR(20) PRIMARY KEY NOT ENFORCED,
     age INT,
     ts BIGINT,
     dt STRING
   )
   WITH (
     'connector' = 'hudi',
     'path' = 'hdfs://master:9000/flink/hudi/hudi_test/',
     'table.type' = 'COPY_ON_WRITE' -- this creates a MERGE_ON_READ table, by default is COPY_ON_WRITE
   );
   select * from hudi_test; {code}
    
   
   ## JIRA info
   
   - Link: https://issues.apache.org/jira/browse/HUDI-5020
   - Type: Bug


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] java.lang.NoSuchMethodError: org.apache.hudi.table.format.cow.vector.reader.ParquetColumnarRowSplitReader.nextRecord()Lorg/apache/flink/table/data/ColumnarRowData [hudi]

Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan closed issue #15493: java.lang.NoSuchMethodError: org.apache.hudi.table.format.cow.vector.reader.ParquetColumnarRowSplitReader.nextRecord()Lorg/apache/flink/table/data/ColumnarRowData
URL: https://github.com/apache/hudi/issues/15493


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] java.lang.NoSuchMethodError: org.apache.hudi.table.format.cow.vector.reader.ParquetColumnarRowSplitReader.nextRecord()Lorg/apache/flink/table/data/ColumnarRowData [hudi]

Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on issue #15493:
URL: https://github.com/apache/hudi/issues/15493#issuecomment-4795435114

   This appears to be already fixed on `master`. The `NoSuchMethodError` was caused by `ParquetColumnarRowSplitReader.nextRecord()` historically returning `ColumnarRowData`, which is sensitive to Flink version skew (the class moved packages between Flink 1.14 and 1.15). It was changed to return the framework-stable `RowData` in HUDI-5381 (commit 392420b7fd, PR #7651) and HUDI-5941 (commit 580acf7596, PR #8145). All currently supported Flink modules (1.17.x – 2.1.x) on `master` declare `public RowData nextRecord()`, so the failure mode in the original report is no longer reachable. The original report was likely against an old Hudi build, or a runtime classpath that still had a stale `hudi-flink-bundle` jar conflicting with newer Flink jars under `flink/lib`. If you can still reproduce on a current Hudi release (0.14.x+ / 1.x), please reopen with the Hudi version and the exact contents of `flink/lib`. Closing as fixed.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org