[GitHub] [incubator-mxnet] ptrendx edited a comment on pull request #19269: Faster pointwise fusion graph pass

[GitBox <gi...@apache.org>]

ptrendx edited a comment on pull request #19269:
URL: https://github.com/apache/incubator-mxnet/pull/19269#issuecomment-706450846


   I fixed the problem with the cycle - every time when I add a new node to a subset, I check whether it's exclusion set is fully included in the future fusion node exclusion set. If so, I update all descendants of the fusion node (with the assumption that typically fusion subsets are not very big and their nodes are quite close together in the indexed graph, so the cost of that is not very high). Still, the check is quite expensive compared to the rest of the algorithm and now the cost of the graph pass for XLNet is ~10-11 ms (still a huge improvement compared to the previous algorithm).


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org