[jira] [Created] (FLUME-3348) TailDirSource will write an empty position when

["wangjianda (Jira)" <ji...@apache.org>]

wangjianda created FLUME-3348:
---------------------------------

             Summary: TailDirSource will write an empty position when
                 Key: FLUME-3348
                 URL: https://issues.apache.org/jira/browse/FLUME-3348
             Project: Flume
          Issue Type: Bug
          Components: Sinks+Sources
    Affects Versions: 1.9.0
         Environment: jdk 1.8

flume 1.9.0 

centos 7 

Number of files generated during reading that are larger than the system limit

 
            Reporter: wangjianda
         Attachments: flume-conf.properties, image-2019-12-26-17-43-24-933.png, image-2019-12-26-17-45-07-945.png, image-2019-12-26-17-45-13-704.png

When the number of files exceeds the maximum number of files allowed by the system.

taildirSource throw Exception:

java.io.FileNotFoundException: position/taildir_position.json (Too many open files)

!image-2019-12-26-17-45-13-704.png!

the reason:

If an exception occurs while FileWriter writing to the file, whereafter call FileWriter close method ,the file will be cleared. This is FileWriter characteristic.

!image-2019-12-26-17-45-07-945.png!

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@flume.apache.org
For additional commands, e-mail: issues-help@flume.apache.org