You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@systemml.apache.org by "Matthias Boehm (Jira)" <ji...@apache.org> on 2020/05/19 19:41:00 UTC

[jira] [Closed] (SYSTEMML-2175) Parfor spark fair scheduler pool leak

     [ https://issues.apache.org/jira/browse/SYSTEMML-2175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matthias Boehm closed SYSTEMML-2175.
------------------------------------
    Fix Version/s: SystemML 1.2
       Resolution: Fixed

> Parfor spark fair scheduler pool leak
> -------------------------------------
>
>                 Key: SYSTEMML-2175
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-2175
>             Project: SystemML
>          Issue Type: Bug
>            Reporter: Matthias Boehm
>            Assignee: Matthias Boehm
>            Priority: Major
>             Fix For: SystemML 1.2
>
>
> In an algorithm with an overall convergence loop and a parfor loop over large data in each outer iteration, we encountered a leak of parfor fair scheduler pools. Specifically, this issue seems to arise whenever the parfor loop has fewer iterations and thus workers than locally available threads.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)