You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Ufuk Celebi (JIRA)" <ji...@apache.org> on 2017/01/27 09:16:24 UTC
[jira] [Closed] (FLINK-5665) Lingering files after failed
checkpoint
[ https://issues.apache.org/jira/browse/FLINK-5665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ufuk Celebi closed FLINK-5665.
------------------------------
Resolution: Duplicate
The checkpoints were in pending state w/o an ack (pending is the initial checkpoint state before the acks happen as well), so I think this is a duplicate.
> Lingering files after failed checkpoint
> ---------------------------------------
>
> Key: FLINK-5665
> URL: https://issues.apache.org/jira/browse/FLINK-5665
> Project: Flink
> Issue Type: Bug
> Components: State Backends, Checkpointing
> Reporter: Ufuk Celebi
>
> When I discovered FLINK-5663, the first two checkpoints did not go through because of the exception at the task manager and I got a bunch of zero byte files:
> {code}
> total 0
> drwxr-xr-x 29 uce staff 986B Jan 26 17:29 .
> drwxr-xr-x 6 uce staff 204B Jan 26 17:45 ..
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 03b9af6c-cff4-44f5-b235-20a1acae57c2
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 091cf308-a15b-42b0-9987-25932b3a7dc9
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 1f4850e2-bd46-4ec4-9540-6f22631b7b60
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 24195811-87cc-4cf9-b67a-c842aa469590
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 2d03efcd-2cbb-4f1f-88c7-2977215890ca
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 2d9ede49-fd37-479e-9973-6af3030464ef
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 39f5ef6e-e2c6-4bad-aeb4-0579b6d06d51
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 487eb08f-60d1-44a3-92eb-ad00552047b0
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 50702820-2006-43d4-9528-c5d37652c782
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 515b5222-f996-4c1f-9f1f-1086040531dc
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 647826ae-64e8-4407-94d8-c7f8cc629e78
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 6a211145-74a0-4711-bcba-d55e3ce2516d
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 6c99c24a-90ed-45ad-928a-c78cb677646c
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 752045e3-1db3-4b4e-8149-15f619c6ecc2
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 774a364b-43a3-4f29-a127-ea54f8ccb093
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 7d93ecbe-5138-432c-bdcc-dd9b8bfdd92e
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 7f664b11-afb0-45ca-9371-0c28c59d6e15
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 8fb1f4d6-3e32-46ff-af40-5d9c2193bc96
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 94d41bdc-73b4-45ca-b37c-9d8c46114530
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 af8ba3b6-036c-4c19-a78a-922c6b9dde35
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 b0c5ba31-677c-4bf7-a82b-b2b3df2f8d43
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 ba748b35-d6b6-4734-b28d-f82917aab54c
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 be3ea3c6-7ebb-4a07-a48d-5c5d3e2fc1ea
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 e0cb285c-ec38-4390-ae98-bec95c520743
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 ea14095a-3527-4762-888a-74308010a702
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 eac774d5-1564-41c1-9015-4c64701ff4bf
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 ebf3e9c7-cd96-4f32-a4c0-2ec3d8f44e60
> {code}
> {code}
> total 0
> drwxr-xr-x 29 uce staff 986B Jan 26 17:29 .
> drwxr-xr-x 6 uce staff 204B Jan 26 17:45 ..
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 00cb4c5b-b2d2-4934-9f90-e68606038bbc
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 01ca2c72-b861-4d64-bee9-3b72f10f91cc
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 0a27c89b-cb7f-433f-9980-fda6bf8265cc
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 0bff0fe5-9b46-42f6-94be-a0f3bfa4c77d
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 0c8c85fc-71fe-4feb-bb06-d4fb5004281b
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 2506b73f-790a-4a3c-b8b9-8296766760ef
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 260fc17d-1de3-4d71-ba99-ce9b4aa44f19
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 45399fab-c7df-4c21-9b2f-e1047a82aa74
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 4e67ff32-2aea-4c6f-a061-7152420684eb
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 4ffe9e50-e7c9-4e52-8725-8d63f5c50d17
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 57e30213-45af-4645-83e3-109ab7b52829
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 5ab0676d-5af6-4229-8af3-2206a4b4c263
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 6240e59a-d7b0-468f-b228-9f3c1318c98f
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 63c099bc-a30e-4780-a390-f007c468e50e
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 76d35d1a-1164-4455-80a8-7a07ffa6f26b
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 7889bed2-a1e3-457a-996a-30116ce16983
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 7c8caa1d-0cd9-4e0e-ac2d-31cc8df440f7
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 8eb2849e-5352-433f-ba3c-86f57d6db9a1
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 8f1884c5-f052-4099-abbe-f6895ffd01f0
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 a19973c4-6a74-44c8-b2f7-b72fe2b68f38
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 a7552360-feae-4b85-82de-0cfd6fe8e954
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 bb241a71-3fa8-476b-97cc-0bb85708c811
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 c9a7f073-f8ba-460d-b34b-9ead355e168a
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 da53e7d5-621d-44b4-838a-a13b3d023855
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 e1556763-e304-4bfb-b2c9-9f1abe29ecee
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 eb14d27b-333d-4198-a212-c7e6ffc9d4ea
> -rw-r--r-- 1 uce staff 0B Jan 26 17:29 edce201f-bdc5-48d4-b64d-dbaf6abdf0ba
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)