You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Till Rohrmann (Jira)" <ji...@apache.org> on 2020/10/14 10:14:00 UTC
[jira] [Commented] (FLINK-19532) FlinkZooKeeperQuorumPeer ignores
purge settings
[ https://issues.apache.org/jira/browse/FLINK-19532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213796#comment-17213796 ]
Till Rohrmann commented on FLINK-19532:
---------------------------------------
Hi [~mlevar], thanks for reporting this issue. I think the answer to your question is that {{FlinkZooKeeperQuorumPeer}} is not really meant for production use cases and more of a utility to quickly setup a ZooKeeper cluster.
Nevertheless, I think that exposing this configuration option for the {{FlinkZooKeeperQuorumPeer}} would still improve the situation and make it more usable for long time usage of ZK started via Flink's scripts.
Do you want to work on this new feature?
> FlinkZooKeeperQuorumPeer ignores purge settings
> -----------------------------------------------
>
> Key: FLINK-19532
> URL: https://issues.apache.org/jira/browse/FLINK-19532
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Coordination
> Reporter: M L
> Priority: Minor
>
> After noticing the snapshot/log buildup in our ZooKeeper {{dataDir}}, we tried enabling the purge settings ({{autopurge.snapRetainCount}} and autopurge.purgeInterval).
> Flink's {{FlinkZooKeeperQuorumPeer}} ignores the portion of {{QuorumPeerMain}} which uses those settings and starts up the {{DatadirCleanupManager}}, using only the {{runFromConfig}} method.
> Is this intentional and is the recommended way to handle snapshot buildup with the built in ZooKeeper to use the {{PurgeTxnLog}} utility?
> It would make sense to enable to support the {{DatadirCleanupManager}} as well.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)