[jira] [Created] (HUDI-3461) The archived timeline for flink streaming reader should not be reused

["Danny Chen (Jira)" <ji...@apache.org>]

Danny Chen created HUDI-3461:
--------------------------------

             Summary: The archived timeline for flink streaming reader should not be reused
                 Key: HUDI-3461
                 URL: https://issues.apache.org/jira/browse/HUDI-3461
             Project: Apache Hudi
          Issue Type: Bug
          Components: flink
            Reporter: Danny Chen
             Fix For: 0.11.0


see the error stack trace:


{code:xml}
2022-02-21 14:21:30
java.util.NoSuchElementException: No value present in Option
	at org.apache.hudi.common.util.Option.get(Option.java:88)
	at org.apache.hudi.hadoop.utils.HoodieInputFormatUtils.getCommitMetadata(HoodieInputFormatUtils.java:572)
	at org.apache.hudi.sink.partitioner.profile.WriteProfiles.getCommitMetadata(WriteProfiles.java:192)
	at org.apache.hudi.source.IncrementalInputSplits.lambda$getArchivedMetadata$5(IncrementalInputSplits.java:270)
	at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
	at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)
	at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384)
	at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
	at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
	at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
	at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
	at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)
	at org.apache.hudi.source.IncrementalInputSplits.getArchivedMetadata(IncrementalInputSplits.java:270)
	at org.apache.hudi.source.IncrementalInputSplits.inputSplits(IncrementalInputSplits.java:184)
	at org.apache.hudi.source.StreamReadMonitoringFunction.monitorDirAndForwardSplits(StreamReadMonitoringFunction.java:195)
	at org.apache.hudi.source.StreamReadMonitoringFunction.run(StreamReadMonitoringFunction.java:168)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:110)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:66)
	at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:269)
{code}




--
This message was sent by Atlassian Jira
(v8.20.1#820001)