You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tinkerpop.apache.org by "Marko A. Rodriguez (JIRA)" <ji...@apache.org> on 2016/10/31 17:25:59 UTC
[jira] [Closed] (TINKERPOP-1525) Plug VertexProgram iteration leak
on empty Spark RDD partitions
[ https://issues.apache.org/jira/browse/TINKERPOP-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Marko A. Rodriguez closed TINKERPOP-1525.
-----------------------------------------
Resolution: Fixed
Fix Version/s: 3.2.4
3.3.0
> Plug VertexProgram iteration leak on empty Spark RDD partitions
> ---------------------------------------------------------------
>
> Key: TINKERPOP-1525
> URL: https://issues.apache.org/jira/browse/TINKERPOP-1525
> Project: TinkerPop
> Issue Type: Bug
> Components: hadoop
> Affects Versions: 3.2.3
> Reporter: Dan LaRocque
> Fix For: 3.3.0, 3.2.4
>
>
> If SparkExecutor gets an RDD with empty partitions, it can invoke {{VertexProgram.workerIterationStart}} without ever invoking {{VertexProgram.workerIterationEnd}}.
> For vertex programs that allocate and release meaningful resources in the start/end methods, this can lead to resource leaks.
> I already tested a fix that I made against the 3.2 series. I will submit PRs momentarily.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)