[jira] [Created] (FLUME-3365) flume high rss memeory occupied

["yuqibin (Jira)" <ji...@apache.org>]

yuqibin created FLUME-3365:
------------------------------

             Summary: flume high rss memeory occupied
                 Key: FLUME-3365
                 URL: https://issues.apache.org/jira/browse/FLUME-3365
             Project: Flume
          Issue Type: Bug
          Components: Sinks+Sources
    Affects Versions: 1.6.0
         Environment: UbuntuDescription: Ubuntu 16.04.6 LTSRelease: 16.04Codename: xenial

java_env:1.8.0_171

 

jvm options:

/usr/bin/java -Xms200m -Xmx200m -Dflume.root.logger=info,console -Dflume.monitoring.type=http -Dflume.monitoring.port=1235 -XX:NativeMemoryTracking=detail
            Reporter: yuqibin
         Attachments: 5220pmap.txt, summary.diff

We use flume-client (taildir-source and avro-sink) to collect machine's application logs to another flume B (all collection),

Flume B send events to kafka.

With a long runtime . we found  flume-client occupied rss memory large than memory by used -Xmx 

we think its may cause System OOMKiller to kill another application (which had occupied the largest memory)

 

 Why flume can occupied high rss memory with a long runtime?

We use pmap and NativeMemoryTracking. but the amount of them not equal. emmm

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@flume.apache.org
For additional commands, e-mail: issues-help@flume.apache.org