Cleaning _bsp/_defaultZkManagerDir/job_XXXX after the job finishes

[Gianmarco De Francisci Morales <gd...@apache.org>]

Hi,
is there a way to tell Giraph to remove the temporary files
in _bsp/_defaultZkManagerDir/job_XXXX after the job ends?

Thanks,
--
Gianmarco

Re: Cleaning _bsp/_defaultZkManagerDir/job_XXXX after the job finishes

[Gianmarco De Francisci Morales <gd...@apache.org>]

Hi Eugene,
Thanks for answering.
I am not sure it is working.
I see my _bsp directory on HDFS getting filled with each job I launch.
Does you patch apply only to local mode?

Cheers,
--
Gianmarco




On Tue, Jul 31, 2012 at 9:23 PM, Eugene Koontz <ek...@hiro-tan.org> wrote:

> On 7/31/12 12:01 PM, Gianmarco De Francisci Morales wrote:
> > Hi,
> > is there a way to tell Giraph to remove the temporary files
> > in _bsp/_defaultZkManagerDir/job_XXXX after the job ends?
> >
> > Thanks,
> > --
> > Gianmarco
> >
> >
> Hi Gianmarco,
>         It should be deleted in ZooKeeperManager::onlineZooKeeperServers()
> :
> you should see a log line like "onlineZooKeeperServers: Trying to delete
> old directory:" followed by the directory like you mentioned above. I
> fixed a bug related to this a few weeks ago here:
>
>
> https://issues.apache.org/jira/browse/GIRAPH-208
>
> -Eugene
>
>

Re: Cleaning _bsp/_defaultZkManagerDir/job_XXXX after the job finishes

[Eugene Koontz <ek...@hiro-tan.org>]

On 7/31/12 12:01 PM, Gianmarco De Francisci Morales wrote:
> Hi,
> is there a way to tell Giraph to remove the temporary files
> in _bsp/_defaultZkManagerDir/job_XXXX after the job ends?
> 
> Thanks,
> --
> Gianmarco
> 
> 
Hi Gianmarco,
	It should be deleted in ZooKeeperManager::onlineZooKeeperServers() :
you should see a log line like "onlineZooKeeperServers: Trying to delete
old directory:" followed by the directory like you mentioned above. I
fixed a bug related to this a few weeks ago here:


https://issues.apache.org/jira/browse/GIRAPH-208

-Eugene