Re: Does PIO support [ --master yarn --deploy-mode cluster ]?

[Pat Ferrel <pa...@occamsmachete.com>]

yarn-cluster mode is supported but extra config needs to be set so the driver can be run on a remote machine.

I have seen instructions for this on the PIO mailing list.



On Nov 12, 2017, at 7:30 PM, wei li <li...@gmail.com> wrote:

Hi Pat
Thanks a lot for your advice.

We are using [yarn-client] mode now, UR trains well and we can monitor the output log at pio application console.

I tried to find a way to use [yarn-cluster] mode, to submit a train job and shutdown the pio application (in docker) immediately.
(monitor the job process at hadoop culster website instead of pio application console).
But then I met errors like this: file path [file://xxx.jar] can not be found.

Maybe,  [yarn-cluster] mode is not supported now. I will keep looking for the explanation.


在 2017年11月11日星期六 UTC+8上午12:41:33，pat写道：
Yes PIO support Yarn but you may have more luck getting an explanation on the PredictionIO mailing list.
Subscribe here: http://predictionio.incubator.apache.org/support/ <http://predictionio.incubator.apache.org/support/>

On Nov 9, 2017, at 11:33 PM, wei li <liwei....@gmail.com <javascript:>> wrote:

Hi, all

Any one have any idea about this?

-- 
You received this message because you are subscribed to the Google Groups "actionml-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to actionml-use...@googlegroups.com <javascript:>.
To post to this group, send email to action...@googlegroups.com <javascript:>.
To view this discussion on the web visit https://groups.google.com/d/msgid/actionml-user/af5c6748-ae7f-4c05-bbc5-6dcf6c1a480a%40googlegroups.com <https://groups.google.com/d/msgid/actionml-user/af5c6748-ae7f-4c05-bbc5-6dcf6c1a480a%40googlegroups.com?utm_medium=email&utm_source=footer>.
For more options, visit https://groups.google.com/d/optout <https://groups.google.com/d/optout>.


-- 
You received this message because you are subscribed to the Google Groups "actionml-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to actionml-user+unsubscribe@googlegroups.com <ma...@googlegroups.com>.
To post to this group, send email to actionml-user@googlegroups.com <ma...@googlegroups.com>.
To view this discussion on the web visit https://groups.google.com/d/msgid/actionml-user/8668b1a1-09b9-4de8-aedb-5b786a9cf7e4%40googlegroups.com <https://groups.google.com/d/msgid/actionml-user/8668b1a1-09b9-4de8-aedb-5b786a9cf7e4%40googlegroups.com?utm_medium=email&utm_source=footer>.
For more options, visit https://groups.google.com/d/optout <https://groups.google.com/d/optout>.