[jira] [Commented] (AMBARI-22395) Log Feeder: cleanup checkpoint files periodically

["Hudson (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AMBARI-22395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16251840#comment-16251840 ] 

Hudson commented on AMBARI-22395:
---------------------------------

FAILURE: Integrated in Jenkins build Ambari-branch-2.6 #451 (See [https://builds.apache.org/job/Ambari-branch-2.6/451/])
AMBARI-22395. Log Feeder: cleanup checkpoint files periodically (oleewere: [http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=a22f66f719fd11efd5ecfec09dc5a8112f9ada1b])
* (edit) ambari-logsearch/ambari-logsearch-logfeeder/src/test/java/org/apache/ambari/logfeeder/metrics/MetrcisManagerTest.java
* (add) ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/input/monitor/CheckpointCleanupMonitor.java
* (add) ambari-logsearch/docker/test-logs/storm/worker-logs/streamline-1-TestAgg-2-3/6701/worker.log
* (edit) ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/metrics/LogFeederAMSClient.java
* (edit) ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/metrics/MetricsManager.java
* (add) ambari-logsearch/docker/test-config/logfeeder/shipper-conf/input.config-storm.json
* (edit) ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/input/monitor/LogFileDetachMonitor.java
* (edit) ambari-logsearch/docker/test-config/logfeeder/logfeeder.properties
* (edit) ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/util/FileUtil.java
* (edit) ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/input/monitor/AbstractLogFileMonitor.java
* (edit) ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/input/InputManager.java
* (edit) ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/input/AbstractInputFile.java
* (edit) ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/input/monitor/LogFilePathUpdateMonitor.java
* (edit) ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/input/Input.java


> Log Feeder: cleanup checkpoint files periodically
> -------------------------------------------------
>
>                 Key: AMBARI-22395
>                 URL: https://issues.apache.org/jira/browse/AMBARI-22395
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-logsearch
>    Affects Versions: 2.6.0
>            Reporter: Olivér Szabó
>            Assignee: Olivér Szabó
>             Fix For: 2.6.1
>
>
> - added new config: "max_age_min" (similar as detach_time_min) to input block. that stored in checkpoint files, during cleanup, based on that the checkpoint file can be deleted.
> - based on "max_age_min" value, during bootstrap, its possible logfeeder wont even monitor a file in the future.
> - created a new thread which periodically run the checkpoint cleanup (now in every 2000 minutes ... its ok to run that rearly)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)