[jira] [Commented] (REEF-1828) An Extension that Allows Users to Provide Start Scripts for an Evaluator

["Markus Weimer (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/REEF-1828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16093168#comment-16093168 ] 

Markus Weimer commented on REEF-1828:
-------------------------------------

All command lines REEF uses to launch Java or .NET Evaluators are built using implementations of {{org.apache.reef.runtime.common.launch.LaunchCommandBuilder}}. That should give us a hook where we can add the script generation.

One challenge with generating scripts will be cross-OS support. On UNIXoid OSs, we'd generate shell scripts, on Windows, we'd have to generate {{.bat}} files.

> An Extension that Allows Users to Provide Start Scripts for an Evaluator
> ------------------------------------------------------------------------
>
>                 Key: REEF-1828
>                 URL: https://issues.apache.org/jira/browse/REEF-1828
>             Project: REEF
>          Issue Type: Wish
>          Components: REEF Evaluator
>    Affects Versions: 0.15
>            Reporter: Shouheng Yi
>            Priority: Minor
>
> I've been working with REEF on a cluster for a recent project. One of the common themes I observed is that I have to configure the machines which REEF evaluators reside on, for example, opening ports, modifying firewall rules, etc.
> I couldn't easily find a place to do so in REEF. Therefore the only option I'm aware of is to modify REEF's source code and embed a custom process to run the scripts. This practice is neither safe nor proper.
> My argument for this extension is that users will have different needs and settings on their clusters - which is something that we couldn't predict. It will be nice if we offer users some freedom to plug in some customized scripts for them to set up the cluster according to their needs, of course, in a safe fashion managed by REEF.
> I'm wondering if we are open to this idea. Thanks.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)