You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@zookeeper.apache.org by Alex Baranau <al...@gmail.com> on 2012/12/17 16:55:49 UTC

Automatic cleanup of data directory

Hello,

According to:

http://zookeeper.apache.org/doc/r3.1.2/zookeeperAdmin.html#sc_maintenance

"A ZooKeeper server will not remove old snapshots and log files, this is
the responsibility of the operator."

I know this is done for a reason. But should we also have ability to
configure automatic cleanups (say leave not more than 3 backups, do cleanup
every 24 hours) in zk? Having extra cron, etc. scripts makes it more
complex to operate, one could even say that if you leave alone ZK server,
it will fail sooner or later because it will eat up all disk space...

Is there probably a JIRA issue which addresses this? If not, do you think
we should create one?

Thank you,

Alex Baranau
------
Sematext :: http://blog.sematext.com/ :: Hadoop - HBase - ElasticSearch -
Solr

Re: Automatic cleanup of data directory

Posted by Alex Baranau <al...@gmail.com>.
Hi Patrick,

My fault, was looking at old version. Thank you!

Alex Baranau
------
Sematext :: http://blog.sematext.com/ :: Hadoop - HBase - ElasticSearch -
Solr

On Tue, Dec 18, 2012 at 1:38 AM, Patrick Hunt <ph...@apache.org> wrote:

> Alex that's a pretty old version of the docs, we now have autopurge
> feature (since 3.4 iirc), see here:
>
> http://zookeeper.apache.org/doc/r3.4.5/zookeeperAdmin.html#sc_maintenance
>
> Regards,
>
> Patrick
>
> On Mon, Dec 17, 2012 at 7:55 AM, Alex Baranau <al...@gmail.com>
> wrote:
> > Hello,
> >
> > According to:
> >
> >
> http://zookeeper.apache.org/doc/r3.1.2/zookeeperAdmin.html#sc_maintenance
> >
> > "A ZooKeeper server will not remove old snapshots and log files, this is
> > the responsibility of the operator."
> >
> > I know this is done for a reason. But should we also have ability to
> > configure automatic cleanups (say leave not more than 3 backups, do
> cleanup
> > every 24 hours) in zk? Having extra cron, etc. scripts makes it more
> > complex to operate, one could even say that if you leave alone ZK server,
> > it will fail sooner or later because it will eat up all disk space...
> >
> > Is there probably a JIRA issue which addresses this? If not, do you think
> > we should create one?
> >
> > Thank you,
> >
> > Alex Baranau
> > ------
> > Sematext :: http://blog.sematext.com/ :: Hadoop - HBase - ElasticSearch
> -
> > Solr
>

Re: Automatic cleanup of data directory

Posted by Patrick Hunt <ph...@apache.org>.
Alex that's a pretty old version of the docs, we now have autopurge
feature (since 3.4 iirc), see here:

http://zookeeper.apache.org/doc/r3.4.5/zookeeperAdmin.html#sc_maintenance

Regards,

Patrick

On Mon, Dec 17, 2012 at 7:55 AM, Alex Baranau <al...@gmail.com> wrote:
> Hello,
>
> According to:
>
> http://zookeeper.apache.org/doc/r3.1.2/zookeeperAdmin.html#sc_maintenance
>
> "A ZooKeeper server will not remove old snapshots and log files, this is
> the responsibility of the operator."
>
> I know this is done for a reason. But should we also have ability to
> configure automatic cleanups (say leave not more than 3 backups, do cleanup
> every 24 hours) in zk? Having extra cron, etc. scripts makes it more
> complex to operate, one could even say that if you leave alone ZK server,
> it will fail sooner or later because it will eat up all disk space...
>
> Is there probably a JIRA issue which addresses this? If not, do you think
> we should create one?
>
> Thank you,
>
> Alex Baranau
> ------
> Sematext :: http://blog.sematext.com/ :: Hadoop - HBase - ElasticSearch -
> Solr