You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "li wei (Jira)" <ji...@apache.org> on 2021/08/23 10:23:00 UTC

[jira] [Created] (FLINK-23918) FileNotFoundException when open auto-compact in filesystem

li wei created FLINK-23918:
------------------------------

             Summary: FileNotFoundException when open auto-compact in filesystem
                 Key: FLINK-23918
                 URL: https://issues.apache.org/jira/browse/FLINK-23918
             Project: Flink
          Issue Type: Bug
          Components: Connectors / FileSystem, FileSystems
    Affects Versions: 1.12.2
         Environment: Flink 1.12.2

HDFS 3.2.1
            Reporter: li wei
         Attachments: image-2021-08-23-18-09-17-674.png, image-2021-08-23-18-14-20-389.png, image-2021-08-23-18-14-35-275.png

After I config auto-compaction=true in filesystem connector, sometimes it will restart and show me exception like this "Caused by: java.io.FileNotFoundException: File does not exist: hdfs://xxxxxx/tmp/xxxxx/dt=20210823/.uncompacted-part-ef59d89c-36fb-49c5-9b74-dd6a7882ea9f-0-241".

And when I use this filename as keyword to search, I found that it first show me an exception, then I got 2 compact success logs.

I think it's not right here, First, flink should not throw this exception; Second, this file should not be merged into 2 files.

!image-2021-08-23-18-14-20-389.png!

!image-2021-08-23-18-14-35-275.png!

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)