You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@flink.apache.org by pn...@apache.org on 2021/09/06 07:36:43 UTC

[flink] branch master updated: [FLINK-24090][docs] Added Troubleshooting section with ignoring in-flight data explanation into unaligned checkpoints page

This is an automated email from the ASF dual-hosted git repository.

pnowojski pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git


The following commit(s) were added to refs/heads/master by this push:
     new 5b47a81  [FLINK-24090][docs] Added Troubleshooting section with ignoring in-flight data explanation into unaligned checkpoints page
5b47a81 is described below

commit 5b47a815832cda1fa2fb210ae4247201a8baf01f
Author: Anton Kalashnikov <ka...@yandex.ru>
AuthorDate: Thu Sep 2 16:23:36 2021 +0200

    [FLINK-24090][docs] Added Troubleshooting section with ignoring in-flight data explanation into unaligned checkpoints page
---
 docs/content/docs/ops/state/unaligned_checkpoints.md | 12 ++++++++++++
 1 file changed, 12 insertions(+)

diff --git a/docs/content/docs/ops/state/unaligned_checkpoints.md b/docs/content/docs/ops/state/unaligned_checkpoints.md
index b47e43e..591c838 100644
--- a/docs/content/docs/ops/state/unaligned_checkpoints.md
+++ b/docs/content/docs/ops/state/unaligned_checkpoints.md
@@ -118,3 +118,15 @@ operators. Flink implements the broadcast state by checkpointing only a single c
 from subtask 0 of the stateful operator. Upon restore, we send that copy to all of the
 operators. Therefore it might happen that an operator will get the state with changes applied for a
 record that it will soon consume from its checkpointed channels.
+
+## Troubleshooting
+
+### Corrupted in-flight data
+{{< hint warning >}}
+Actions described below are a last resort as they will lead to data loss.
+{{< /hint >}}
+In case of the in-flight data corrupted or by another reason when the job should be restored without the in-flight data, 
+it is possible to use  [recover-without-channel-state.checkpoint-id]({{< ref "docs/deployment/config" >}}#execution-checkpointing-recover-without-channel-state-checkpoint) property.
+This property requires to specify a checkpoint id for which in-flight data will be ignored.
+Do not set this property, unless a corruption inside the persisted in-flight data has lead to an otherwise unrecoverable situation.
+The property can be applied only after the job will be redeployed which means this operation makes sense only if [externalized checkpoint]({{< ref "docs/dev/datastream/fault-tolerance/checkpointing" >}}#enabling-and-configuring-checkpointing) is enabled.