You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Lihe Ma (Jira)" <ji...@apache.org> on 2022/08/08 11:42:00 UTC
[jira] [Created] (FLINK-28872) UnalignedCheckpointStressITCase fails with NoSuchFileException
Lihe Ma created FLINK-28872:
-------------------------------
Summary: UnalignedCheckpointStressITCase fails with NoSuchFileException
Key: FLINK-28872
URL: https://issues.apache.org/jira/browse/FLINK-28872
Project: Flink
Issue Type: Bug
Components: Test Infrastructure
Affects Versions: 1.16.0
Reporter: Lihe Ma
Attachments: mvn-3-1.log
UnalignedCheckpointStressITCase fails occasionally.
From the logs from one failed attempt, random configuration was set to :
* false for taskmanager.network.memory.buffer-debloat.enabled
* false for execution.checkpointing.unaligned
* PT0.1S for execution.checkpointing.alignment-timeout
* false for state.backend.changelog.enabled
It failed when tried to fetch latest retained checkpoint.
{code:java}
Caused by: java.nio.file.NoSuchFileException: /tmp/junit933601030800674266/ea67eac6fd3f8192f43aae35952a64e7/chk-6/6e234f61-ba86-4fc6-9739-980ae3edb682 {code}
It tried to read chk-6, but chk-7 completed before job finished, but this test case did not realize that chk-7 was the latest retained checkpoint.
{code:java}
04:59:34,077 [ Checkpoint Timer] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1659848374076 for job ea67eac6fd3f8192f43aae35952a64e7.04:59:35,284 [jobmanager-io-thread-11] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 6 for job ea67eac6fd3f8192f43aae35952a64e7 (15635521 bytes, checkpointDuration=1208 ms, finalizationTime=0 ms).04:59:35,285 [ Checkpoint Timer] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1659848375285 for job ea67eac6fd3f8192f43aae35952a64e7.04:59:35,950 [jobmanager-io-thread-10] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 7 for job ea67eac6fd3f8192f43aae35952a64e7 (15775934 bytes, checkpointDuration=665 ms, finalizationTime=0 ms).04:59:35,951 [ Checkpoint Timer] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1659848375951 for job ea67eac6fd3f8192f43aae35952a64e7.04:59:35,952 [Channel state writer Map -> Map (1/1)#0] INFO org.apache.flink.runtime.checkpoint.channel.ChannelStateWriteRequestExecutorImpl [] - Map -> Map (1/1)#0 discarding 0 drained requests04:59:35,953 [ Map -> Map (1/1)#0] WARN org.apache.flink.runtime.taskmanager.Task [] - Map -> Map (1/1)#0 (8e004c2ca00f22588638cc354972c8be_624c2fac4e5e1bf52e83f8a978720139_0_0) switched from RUNNING to FAILED with failure cause: org.apache.flink.runtime.operators.testutils.ExpectedTestException: Record(sourceId=7, payload.length=4096, value=741) {code}
this is a failed pipeline (not master branch),but we reproduce this bug on master code locally.
[https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=39472&view=logs&j=5c8e7682-d68f-54d1-16a2-a09310218a49&t=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)