You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by Andy Davidson <An...@SantaCruzIntegration.com> on 2016/08/01 17:03:27 UTC

newbie does python del, gc.collect() release all resources?

I am new to python.

I find my self working with several data frames at the same time. I have run
into some driver memory problems and want to make sure I release all
resource as soon as possible.

1. should I be calling del and gc.collect() ?
2. If a dataframe was cached do I need to explicitly call unpersist() or
will del,gc.collect() do this for me?

Thanks

Andy

Re: newbie does python del, gc.collect() release all resources?

Posted by Dana Powers <da...@gmail.com>.

Are you asking about a Kafka python driver? Or are referring to pyspark?
On Aug 1, 2016 10:03, "Andy Davidson" <An...@santacruzintegration.com> wrote:

> I am new to python.
>
> I find my self working with several data frames at the same time. I have
> run
> into some driver memory problems and want to make sure I release all
> resource as soon as possible.
>
> 1. should I be calling del and gc.collect() ?
> 2. If a dataframe was cached do I need to explicitly call unpersist() or
> will del,gc.collect() do this for me?
>
> Thanks
>
> Andy
>
>
>
>
>