You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Till Rohrmann (Jira)" <ji...@apache.org> on 2020/10/14 10:14:00 UTC

[jira] [Commented] (FLINK-19532) FlinkZooKeeperQuorumPeer ignores purge settings

    [ https://issues.apache.org/jira/browse/FLINK-19532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213796#comment-17213796 ] 

Till Rohrmann commented on FLINK-19532:
---------------------------------------

Hi [~mlevar], thanks for reporting this issue. I think the answer to your question is that {{FlinkZooKeeperQuorumPeer}} is not really meant for production use cases and more of a utility to quickly setup a ZooKeeper cluster.

Nevertheless, I think that exposing this configuration option for the {{FlinkZooKeeperQuorumPeer}} would still improve the situation and make it more usable for long time usage of ZK started via Flink's scripts.

Do you want to work on this new feature?

> FlinkZooKeeperQuorumPeer ignores purge settings
> -----------------------------------------------
>
>                 Key: FLINK-19532
>                 URL: https://issues.apache.org/jira/browse/FLINK-19532
>             Project: Flink
>          Issue Type: Improvement
>          Components: Runtime / Coordination
>            Reporter: M L
>            Priority: Minor
>
> After noticing the snapshot/log buildup in our ZooKeeper {{dataDir}}, we tried enabling the purge settings ({{autopurge.snapRetainCount}} and autopurge.purgeInterval).
> Flink's {{FlinkZooKeeperQuorumPeer}} ignores the portion of {{QuorumPeerMain}} which uses those settings and starts up the {{DatadirCleanupManager}}, using only the {{runFromConfig}} method.
> Is this intentional and is the recommended way to handle snapshot buildup with the built in ZooKeeper to use the {{PurgeTxnLog}} utility?
> It would make sense to enable to support the {{DatadirCleanupManager}} as well.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)