You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@systemml.apache.org by "Matthias Boehm (JIRA)" <ji...@apache.org> on 2018/06/16 01:43:00 UTC
[jira] [Updated] (SYSTEMML-2400) Dynamic recompilation loses max
thread constraints of hops
[ https://issues.apache.org/jira/browse/SYSTEMML-2400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matthias Boehm updated SYSTEMML-2400:
-------------------------------------
Description: Dynamic recompilation deep copies the hop DAG and applies - among other things - various rewrites. In case these rewrites create new hops (no inplace modification) these rewrites lose the max thread constraints set by parfor and paramserv. On nodes with large degree of parallelism this constitutes a serious issue because it leads to large over-provisioning and thus reduced performance and potential OOMs.
> Dynamic recompilation loses max thread constraints of hops
> ----------------------------------------------------------
>
> Key: SYSTEMML-2400
> URL: https://issues.apache.org/jira/browse/SYSTEMML-2400
> Project: SystemML
> Issue Type: Bug
> Reporter: Matthias Boehm
> Priority: Major
>
> Dynamic recompilation deep copies the hop DAG and applies - among other things - various rewrites. In case these rewrites create new hops (no inplace modification) these rewrites lose the max thread constraints set by parfor and paramserv. On nodes with large degree of parallelism this constitutes a serious issue because it leads to large over-provisioning and thus reduced performance and potential OOMs.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)