You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Danny Chen (Jira)" <ji...@apache.org> on 2022/02/22 07:55:00 UTC
[jira] [Commented] (HUDI-3461) The archived timeline for flink streaming reader should not be reused
[ https://issues.apache.org/jira/browse/HUDI-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17495935#comment-17495935 ]
Danny Chen commented on HUDI-3461:
----------------------------------
Fixed via master branch: 4affdd0c8f02ccca4705515dcb6492c199e2cede
> The archived timeline for flink streaming reader should not be reused
> ---------------------------------------------------------------------
>
> Key: HUDI-3461
> URL: https://issues.apache.org/jira/browse/HUDI-3461
> Project: Apache Hudi
> Issue Type: Bug
> Components: flink
> Reporter: Danny Chen
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.11.0
>
>
> see the error stack trace:
> {code:xml}
> 2022-02-21 14:21:30
> java.util.NoSuchElementException: No value present in Option
> at org.apache.hudi.common.util.Option.get(Option.java:88)
> at org.apache.hudi.hadoop.utils.HoodieInputFormatUtils.getCommitMetadata(HoodieInputFormatUtils.java:572)
> at org.apache.hudi.sink.partitioner.profile.WriteProfiles.getCommitMetadata(WriteProfiles.java:192)
> at org.apache.hudi.source.IncrementalInputSplits.lambda$getArchivedMetadata$5(IncrementalInputSplits.java:270)
> at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
> at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)
> at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384)
> at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
> at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
> at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
> at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
> at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)
> at org.apache.hudi.source.IncrementalInputSplits.getArchivedMetadata(IncrementalInputSplits.java:270)
> at org.apache.hudi.source.IncrementalInputSplits.inputSplits(IncrementalInputSplits.java:184)
> at org.apache.hudi.source.StreamReadMonitoringFunction.monitorDirAndForwardSplits(StreamReadMonitoringFunction.java:195)
> at org.apache.hudi.source.StreamReadMonitoringFunction.run(StreamReadMonitoringFunction.java:168)
> at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:110)
> at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:66)
> at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:269)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)