You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@submarine.apache.org by "Wangda Tan (Jira)" <ji...@apache.org> on 2020/07/19 18:09:00 UTC
[jira] [Updated] (SUBMARINE-570) Support run experiment/notebook
with synced code
[ https://issues.apache.org/jira/browse/SUBMARINE-570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wangda Tan updated SUBMARINE-570:
---------------------------------
Target Version: 0.5.0
> Support run experiment/notebook with synced code
> ------------------------------------------------
>
> Key: SUBMARINE-570
> URL: https://issues.apache.org/jira/browse/SUBMARINE-570
> Project: Apache Submarine
> Issue Type: New Feature
> Components: code-sync
> Reporter: Wangda Tan
> Priority: Major
>
> In Submarine Experiment, there're needs to sync up code from Git/S3 to run experiment.
> For example, Experiment can be defined to:
> {code:java}
> experiment: #Or notebook, model-serving
> name: "abc",
> environment: "team-default-ml-env"
> // Other fields
> code:
> sync_mode: git
> url: "https://foo.com/training-job.git"{code}
> And once the experiment is launched, code from [https://foo.com/training-job.git] will be synced under /code directory of the launched container.
> Different sync_mode can be supported, it can be git, s3, hdfs, nfs, etc.
> Similarily, notebook can sync code when a notebook session is launched, this avoids user manual checkout code post notebook session launch.
> More design can be found at the following design docs:
> - [https://github.com/apache/submarine/blob/master/docs/design/storage-implementation.md#store-code-for-experimentnotebookmodel-serving]
> - [https://github.com/apache/submarine/blob/master/docs/design/experiment-implementation.md#api-of-experiment]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@submarine.apache.org
For additional commands, e-mail: dev-help@submarine.apache.org