[jira] [Commented] (HUDI-2097) Fix unable to read commit metadata error

["Xinglong Wang (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HUDI-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693177#comment-17693177 ] 

Xinglong Wang commented on HUDI-2097:
-------------------------------------

Fix exception like below?

```

org.apache.hudi.exception.HoodieException: java.io.IOException: unable to read commit metadata
    at org.apache.hudi.sink.partitioner.profile.WriteProfiles.getCommitMetadata(WriteProfiles.java:275)
    at org.apache.hudi.source.StreamReadMonitoringFunction.lambda$monitorDirAndForwardSplits$103(StreamReadMonitoringFunction.java:297)
    at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
    at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384)
    at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
    at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
    at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
    at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
    at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
    at org.apache.hudi.source.StreamReadMonitoringFunction.monitorDirAndForwardSplits(StreamReadMonitoringFunction.java:297)
    at org.apache.hudi.source.StreamReadMonitoringFunction.run(StreamReadMonitoringFunction.java:216)
    at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:110)
    at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:66)
    at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:263)
Caused by: java.io.IOException: unable to read commit metadata
    at org.apache.hudi.common.model.HoodieCommitMetadata.fromBytes(HoodieCommitMetadata.java:405)
    at org.apache.hudi.sink.partitioner.profile.WriteProfiles.getCommitMetadata(WriteProfiles.java:271)
    ... 13 more
Caused by: com.fasterxml.jackson.core.JsonParseException: Unrecognized token 'Obj
avro': was expecting ('true', 'false' or 'null')
 at [Source: UNKNOWN; line: 1, column: 11]
    at com.fasterxml.jackson.core.JsonParser._constructError(JsonParser.java:1798)
    at com.fasterxml.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:673)
    at com.fasterxml.jackson.core.json.ReaderBasedJsonParser._reportInvalidToken(ReaderBasedJsonParser.java:2835)
    at com.fasterxml.jackson.core.json.ReaderBasedJsonParser._handleOddValue(ReaderBasedJsonParser.java:1889)
    at com.fasterxml.jackson.core.json.ReaderBasedJsonParser.nextToken(ReaderBasedJsonParser.java:747)
    at com.fasterxml.jackson.databind.ObjectMapper._initForReading(ObjectMapper.java:4129)
    at com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:3988)
    at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2992)
    at org.apache.hudi.common.model.HoodieCommitMetadata.fromJsonString(HoodieCommitMetadata.java:187)
    at org.apache.hudi.common.model.HoodieCommitMetadata.fromBytes(HoodieCommitMetadata.java:403)
    ... 14 more

```

> Fix unable to read commit metadata error
> ----------------------------------------
>
>                 Key: HUDI-2097
>                 URL: https://issues.apache.org/jira/browse/HUDI-2097
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: flink
>            Reporter: Zheng yunhong
>            Assignee: Zheng yunhong
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 0.9.0
>
>
> Fix unable to read commit metadata error while reading json style data.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)