You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@tinkerpop.apache.org by "Dan LaRocque (JIRA)" <ji...@apache.org> on 2016/10/25 00:17:58 UTC

[jira] [Created] (TINKERPOP-1525) Plug VertexProgram iteration leak on empty Spark RDD partitions

Dan LaRocque created TINKERPOP-1525:
---------------------------------------

             Summary: Plug VertexProgram iteration leak on empty Spark RDD partitions
                 Key: TINKERPOP-1525
                 URL: https://issues.apache.org/jira/browse/TINKERPOP-1525
             Project: TinkerPop
          Issue Type: Bug
    Affects Versions: 3.2.3, 3.3.0
            Reporter: Dan LaRocque


If SparkExecutor gets an RDD with empty partitions, it can invoke {{VertexProgram.workerIterationStart}} without ever invoking {{VertexProgram.workerIterationEnd}}.

For vertex programs that allocate and release meaningful resources in the start/end methods, this can lead to resource leaks.

I already tested a fix that I made against the 3.2 series.  I will submit PRs momentarily.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)