You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@reef.apache.org by Sergiy Matusevych <se...@gmail.com> on 2017/04/19 05:35:59 UTC
REEF-on-REEF is here - need help to debug a few issues
Hi fellow REEF developers,
I am happy to announce that REEF-on-REEF example is now in master and [kind
of] works :)
I still need your help to debug a few issues, though. It looks like in our
recent efforts towards REEF-as-a-library we are a bit overzealous in
cleaning up resources at the end of the REEF application. In REEF-on-REEF
context that means that the inner (Unmanaged AM) job closes some threads
that actually belong to the host application's driver. As a result, the
outer (host) application terminates prematurely with the FAILED status.
I've opened a JIRA that gives more details about the issue:
https://issues.apache.org/jira/browse/REEF-1782
I am debugging the issue now, but it would be great if someone could help
me with it. That work will go a long way and get us much closer to the
anticipated Spark+REEF integration.
Cheers,
Sergiy.
Re: REEF-on-REEF is here - need help to debug a few issues
Posted by Byung-Gon Chun <bg...@gmail.com>.
Awesome!
-Gon