You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@submarine.apache.org by Kevin Su <pi...@gmail.com> on 2020/10/15 05:24:32 UTC

[VOTE] Submarine-0.5.0-RC0 is ready for a vote!

Hi folks,


Thanks to everyone's help on this release. Special thanks to Wangda,

Zhankun, Xun, Wei-Chiu, Wanqiang, Ryan, and JohnTing!

I've created a release candidate (RC0) for submarine 0.5.0. The highlighted

features are as follows:

1. Submarine Experiments: Redefined the experiment spec, sync up code from
Git, it could be https and ssh

2. Predefined experiment template: Register A experiment template and
submit related parameter to run an experiment using Rest API

3. Environment profile: Users could easily manage their docker image and
conda environment

4. Jupyter Notebook: Spawn a jupyter notebook using Rest API, and execute
ML code on K8s, or submit an experiment to submarine server

5. Submarine Workbench UI: CRUD Experiment, Environment, Notebook through
the UI



The RC tag in git is here:
https://github.com/apache/submarine/releases/tag/release-0.5.0-RC0

The RC release artifacts are available at:
http://home.apache.org/~pingsutw/submarine-0.5.0-RC0

The mini-submarine image is here:
https://hub.docker.com/layers/apache/submarine/mini-0.5.0-RC0/images/sha256-f3af4f923d96fbbdbbaca7efad19803f3e753bcba4e9ce38e3f292e6b2678826?context=explore

The server image is here:
https://hub.docker.com/layers/apache/submarine/server-0.5.0/images/sha256-26dbf47acef3e992269a0f2736268553b254381bf5cdf4a2418bc4a125284186?context=explore

The database image is here:
https://hub.docker.com/layers/apache/submarine/database-0.5.0/images/sha256-6bd70d47db45cc95f45ff332ea37a3d2ed0bb415e88aa88d2c42533a1dad504e?context=explore

The Jupyter Notebook image is here:
https://hub.docker.com/layers/apache/submarine/jupyter-notebook-0.5.0/images/sha256-1e05cdd3c814063b3cac9de12bdecd70475d38d708c06794c2d3b55ef97de82a?context=explore

The Maven staging repository is here:
https://repository.apache.org/content/repositories/orgapachesubmarine-1014

My public key is here:
https://dist.apache.org/repos/dist/release/submarine/KEYS

*This vote will run for 7 days, ending on Oct 22, 2020, at 11:59 pm PST.*

For the testing, I have verified the

1. Build from source, Run the mnist on Hadoop

2. Example with mini-submarine(both local and remote mode)

3. Verified the experiment operations to K8s by Submarine Server REST and
PySubmarine.

4. Workbench UI (experiment, environment, notebook)

5. HTTP sync code in the experiment

6. Environment profile REST API

7. Notebook REST API


Please follow the document to test these features.
* https://github.com/apache/submarine/tree/master/dev-support/mini-submarine
* https://github.com/apache/submarine/blob/master/docs/user-guide-home.md

My +1 to start. Thanks!

BR,
Kevin Su

Re: [VOTE] Submarine-0.5.0-RC0 is ready for a vote!

Posted by Kevin Su <pi...@gmail.com>.
Thanks Wei-Chiu, Wanqiang, Zhankun for the review.
Due to the gpg key verify failure in the artifact, I'm going to start
another vote for RC1

Zhankun Tang <zt...@apache.org> 於 2020年10月21日 週三 下午12:13寫道:

> Thanks for the hard work! Kevin.
> One minor problem found is that it seems the public key used when signing
> the artifacts is different from the one pasted in the KEYS file. Did anyone
> else meet this problem?
>
> $ gpg --list-keys pingsutw@apache.org
> pub   rsa3072 2020-10-14 [SC] [expires: 2022-10-14]
>       5E43D21129F98BBCB6E4C1CE83ED13F3FA8A5F54
> uid           [ unknown] Kevin <pi...@apache.org>
> sub   rsa3072 2020-10-14 [E] [expires: 2022-10-14]
>
> (base)
> # ztang @ ztang-mbp15 in ~/projects/submarine/test [11:57:04]
> $ gpg --verify submarine-dist-0.5.0-src.tar.gz.asc
> gpg: assuming signed data in 'submarine-dist-0.5.0-src.tar.gz'
> gpg: Signature made Tue Oct 13 16:53:52 2020 CST
> gpg:                using RSA key 5902D52C1B9761FB109BB92F82410133BF8803AE
> gpg: Can't check signature: No public key
>
> $ gpg --verify submarine-dist-0.4.0-src.tar.gz.asc
> gpg: assuming signed data in 'submarine-dist-0.4.0-src.tar.gz'
> gpg: Signature made Fri Jun 26 20:50:29 2020 CST
> gpg:                using RSA key 446A10F72C51577FFBE9E6FB08FACFFFADA3301B
> gpg: Good signature from "Wanqiang Ji <ji...@apache.org>" [full]
> gpg:                 aka "Wanqiang Ji <wa...@gmail.com>" [full]
>
> BR,
> Zhankun
>
> On Tue, 20 Oct 2020 at 23:59, Wanqiang Ji <ji...@apache.org> wrote:
>
> > The tag named release-0.5.0-RC0 missed updating the docker image version
> in
> > the helm charts. So I think we should update it and post the RC1.
> >
> > Thanks!
> >
> > On Tue, Oct 20, 2020 at 2:58 AM Wei-Chiu Chuang <we...@apache.org>
> > wrote:
> >
> > > Reminder for this RC -- we're only three days before the proposed 7-day
> > > period lapse.
> > >
> > > I'll try to get a crack at it soon.
> > >
> > > Thanks
> > >
> > > On Wed, Oct 14, 2020 at 10:24 PM Kevin Su <pi...@gmail.com> wrote:
> > >
> > > > Hi folks,
> > > >
> > > >
> > > > Thanks to everyone's help on this release. Special thanks to Wangda,
> > > >
> > > > Zhankun, Xun, Wei-Chiu, Wanqiang, Ryan, and JohnTing!
> > > >
> > > > I've created a release candidate (RC0) for submarine 0.5.0. The
> > > highlighted
> > > >
> > > > features are as follows:
> > > >
> > > > 1. Submarine Experiments: Redefined the experiment spec, sync up code
> > > from
> > > > Git, it could be https and ssh
> > > >
> > > > 2. Predefined experiment template: Register A experiment template and
> > > > submit related parameter to run an experiment using Rest API
> > > >
> > > > 3. Environment profile: Users could easily manage their docker image
> > and
> > > > conda environment
> > > >
> > > > 4. Jupyter Notebook: Spawn a jupyter notebook using Rest API, and
> > execute
> > > > ML code on K8s, or submit an experiment to submarine server
> > > >
> > > > 5. Submarine Workbench UI: CRUD Experiment, Environment, Notebook
> > through
> > > > the UI
> > > >
> > > >
> > > >
> > > > The RC tag in git is here:
> > > > https://github.com/apache/submarine/releases/tag/release-0.5.0-RC0
> > > >
> > > > The RC release artifacts are available at:
> > > > http://home.apache.org/~pingsutw/submarine-0.5.0-RC0
> > > >
> > > > The mini-submarine image is here:
> > > >
> > > >
> > >
> >
> https://hub.docker.com/layers/apache/submarine/mini-0.5.0-RC0/images/sha256-f3af4f923d96fbbdbbaca7efad19803f3e753bcba4e9ce38e3f292e6b2678826?context=explore
> > > >
> > > > The server image is here:
> > > >
> > > >
> > >
> >
> https://hub.docker.com/layers/apache/submarine/server-0.5.0/images/sha256-26dbf47acef3e992269a0f2736268553b254381bf5cdf4a2418bc4a125284186?context=explore
> > > >
> > > > The database image is here:
> > > >
> > > >
> > >
> >
> https://hub.docker.com/layers/apache/submarine/database-0.5.0/images/sha256-6bd70d47db45cc95f45ff332ea37a3d2ed0bb415e88aa88d2c42533a1dad504e?context=explore
> > > >
> > > > The Jupyter Notebook image is here:
> > > >
> > > >
> > >
> >
> https://hub.docker.com/layers/apache/submarine/jupyter-notebook-0.5.0/images/sha256-1e05cdd3c814063b3cac9de12bdecd70475d38d708c06794c2d3b55ef97de82a?context=explore
> > > >
> > > > The Maven staging repository is here:
> > > >
> > >
> >
> https://repository.apache.org/content/repositories/orgapachesubmarine-1014
> > > >
> > > > My public key is here:
> > > > https://dist.apache.org/repos/dist/release/submarine/KEYS
> > > >
> > > > *This vote will run for 7 days, ending on Oct 22, 2020, at 11:59 pm
> > PST.*
> > > >
> > > > For the testing, I have verified the
> > > >
> > > > 1. Build from source, Run the mnist on Hadoop
> > > >
> > > > 2. Example with mini-submarine(both local and remote mode)
> > > >
> > > > 3. Verified the experiment operations to K8s by Submarine Server REST
> > and
> > > > PySubmarine.
> > > >
> > > > 4. Workbench UI (experiment, environment, notebook)
> > > >
> > > > 5. HTTP sync code in the experiment
> > > >
> > > > 6. Environment profile REST API
> > > >
> > > > 7. Notebook REST API
> > > >
> > > >
> > > > Please follow the document to test these features.
> > > > *
> > > >
> > >
> >
> https://github.com/apache/submarine/tree/master/dev-support/mini-submarine
> > > > *
> > >
> https://github.com/apache/submarine/blob/master/docs/user-guide-home.md
> > > >
> > > > My +1 to start. Thanks!
> > > >
> > > > BR,
> > > > Kevin Su
> > > >
> > >
> >
>

Re: [VOTE] Submarine-0.5.0-RC0 is ready for a vote!

Posted by Zhankun Tang <zt...@apache.org>.
Thanks for the hard work! Kevin.
One minor problem found is that it seems the public key used when signing
the artifacts is different from the one pasted in the KEYS file. Did anyone
else meet this problem?

$ gpg --list-keys pingsutw@apache.org
pub   rsa3072 2020-10-14 [SC] [expires: 2022-10-14]
      5E43D21129F98BBCB6E4C1CE83ED13F3FA8A5F54
uid           [ unknown] Kevin <pi...@apache.org>
sub   rsa3072 2020-10-14 [E] [expires: 2022-10-14]

(base)
# ztang @ ztang-mbp15 in ~/projects/submarine/test [11:57:04]
$ gpg --verify submarine-dist-0.5.0-src.tar.gz.asc
gpg: assuming signed data in 'submarine-dist-0.5.0-src.tar.gz'
gpg: Signature made Tue Oct 13 16:53:52 2020 CST
gpg:                using RSA key 5902D52C1B9761FB109BB92F82410133BF8803AE
gpg: Can't check signature: No public key

$ gpg --verify submarine-dist-0.4.0-src.tar.gz.asc
gpg: assuming signed data in 'submarine-dist-0.4.0-src.tar.gz'
gpg: Signature made Fri Jun 26 20:50:29 2020 CST
gpg:                using RSA key 446A10F72C51577FFBE9E6FB08FACFFFADA3301B
gpg: Good signature from "Wanqiang Ji <ji...@apache.org>" [full]
gpg:                 aka "Wanqiang Ji <wa...@gmail.com>" [full]

BR,
Zhankun

On Tue, 20 Oct 2020 at 23:59, Wanqiang Ji <ji...@apache.org> wrote:

> The tag named release-0.5.0-RC0 missed updating the docker image version in
> the helm charts. So I think we should update it and post the RC1.
>
> Thanks!
>
> On Tue, Oct 20, 2020 at 2:58 AM Wei-Chiu Chuang <we...@apache.org>
> wrote:
>
> > Reminder for this RC -- we're only three days before the proposed 7-day
> > period lapse.
> >
> > I'll try to get a crack at it soon.
> >
> > Thanks
> >
> > On Wed, Oct 14, 2020 at 10:24 PM Kevin Su <pi...@gmail.com> wrote:
> >
> > > Hi folks,
> > >
> > >
> > > Thanks to everyone's help on this release. Special thanks to Wangda,
> > >
> > > Zhankun, Xun, Wei-Chiu, Wanqiang, Ryan, and JohnTing!
> > >
> > > I've created a release candidate (RC0) for submarine 0.5.0. The
> > highlighted
> > >
> > > features are as follows:
> > >
> > > 1. Submarine Experiments: Redefined the experiment spec, sync up code
> > from
> > > Git, it could be https and ssh
> > >
> > > 2. Predefined experiment template: Register A experiment template and
> > > submit related parameter to run an experiment using Rest API
> > >
> > > 3. Environment profile: Users could easily manage their docker image
> and
> > > conda environment
> > >
> > > 4. Jupyter Notebook: Spawn a jupyter notebook using Rest API, and
> execute
> > > ML code on K8s, or submit an experiment to submarine server
> > >
> > > 5. Submarine Workbench UI: CRUD Experiment, Environment, Notebook
> through
> > > the UI
> > >
> > >
> > >
> > > The RC tag in git is here:
> > > https://github.com/apache/submarine/releases/tag/release-0.5.0-RC0
> > >
> > > The RC release artifacts are available at:
> > > http://home.apache.org/~pingsutw/submarine-0.5.0-RC0
> > >
> > > The mini-submarine image is here:
> > >
> > >
> >
> https://hub.docker.com/layers/apache/submarine/mini-0.5.0-RC0/images/sha256-f3af4f923d96fbbdbbaca7efad19803f3e753bcba4e9ce38e3f292e6b2678826?context=explore
> > >
> > > The server image is here:
> > >
> > >
> >
> https://hub.docker.com/layers/apache/submarine/server-0.5.0/images/sha256-26dbf47acef3e992269a0f2736268553b254381bf5cdf4a2418bc4a125284186?context=explore
> > >
> > > The database image is here:
> > >
> > >
> >
> https://hub.docker.com/layers/apache/submarine/database-0.5.0/images/sha256-6bd70d47db45cc95f45ff332ea37a3d2ed0bb415e88aa88d2c42533a1dad504e?context=explore
> > >
> > > The Jupyter Notebook image is here:
> > >
> > >
> >
> https://hub.docker.com/layers/apache/submarine/jupyter-notebook-0.5.0/images/sha256-1e05cdd3c814063b3cac9de12bdecd70475d38d708c06794c2d3b55ef97de82a?context=explore
> > >
> > > The Maven staging repository is here:
> > >
> >
> https://repository.apache.org/content/repositories/orgapachesubmarine-1014
> > >
> > > My public key is here:
> > > https://dist.apache.org/repos/dist/release/submarine/KEYS
> > >
> > > *This vote will run for 7 days, ending on Oct 22, 2020, at 11:59 pm
> PST.*
> > >
> > > For the testing, I have verified the
> > >
> > > 1. Build from source, Run the mnist on Hadoop
> > >
> > > 2. Example with mini-submarine(both local and remote mode)
> > >
> > > 3. Verified the experiment operations to K8s by Submarine Server REST
> and
> > > PySubmarine.
> > >
> > > 4. Workbench UI (experiment, environment, notebook)
> > >
> > > 5. HTTP sync code in the experiment
> > >
> > > 6. Environment profile REST API
> > >
> > > 7. Notebook REST API
> > >
> > >
> > > Please follow the document to test these features.
> > > *
> > >
> >
> https://github.com/apache/submarine/tree/master/dev-support/mini-submarine
> > > *
> > https://github.com/apache/submarine/blob/master/docs/user-guide-home.md
> > >
> > > My +1 to start. Thanks!
> > >
> > > BR,
> > > Kevin Su
> > >
> >
>

Re: [VOTE] Submarine-0.5.0-RC0 is ready for a vote!

Posted by Wanqiang Ji <ji...@apache.org>.
The tag named release-0.5.0-RC0 missed updating the docker image version in
the helm charts. So I think we should update it and post the RC1.

Thanks!

On Tue, Oct 20, 2020 at 2:58 AM Wei-Chiu Chuang <we...@apache.org> wrote:

> Reminder for this RC -- we're only three days before the proposed 7-day
> period lapse.
>
> I'll try to get a crack at it soon.
>
> Thanks
>
> On Wed, Oct 14, 2020 at 10:24 PM Kevin Su <pi...@gmail.com> wrote:
>
> > Hi folks,
> >
> >
> > Thanks to everyone's help on this release. Special thanks to Wangda,
> >
> > Zhankun, Xun, Wei-Chiu, Wanqiang, Ryan, and JohnTing!
> >
> > I've created a release candidate (RC0) for submarine 0.5.0. The
> highlighted
> >
> > features are as follows:
> >
> > 1. Submarine Experiments: Redefined the experiment spec, sync up code
> from
> > Git, it could be https and ssh
> >
> > 2. Predefined experiment template: Register A experiment template and
> > submit related parameter to run an experiment using Rest API
> >
> > 3. Environment profile: Users could easily manage their docker image and
> > conda environment
> >
> > 4. Jupyter Notebook: Spawn a jupyter notebook using Rest API, and execute
> > ML code on K8s, or submit an experiment to submarine server
> >
> > 5. Submarine Workbench UI: CRUD Experiment, Environment, Notebook through
> > the UI
> >
> >
> >
> > The RC tag in git is here:
> > https://github.com/apache/submarine/releases/tag/release-0.5.0-RC0
> >
> > The RC release artifacts are available at:
> > http://home.apache.org/~pingsutw/submarine-0.5.0-RC0
> >
> > The mini-submarine image is here:
> >
> >
> https://hub.docker.com/layers/apache/submarine/mini-0.5.0-RC0/images/sha256-f3af4f923d96fbbdbbaca7efad19803f3e753bcba4e9ce38e3f292e6b2678826?context=explore
> >
> > The server image is here:
> >
> >
> https://hub.docker.com/layers/apache/submarine/server-0.5.0/images/sha256-26dbf47acef3e992269a0f2736268553b254381bf5cdf4a2418bc4a125284186?context=explore
> >
> > The database image is here:
> >
> >
> https://hub.docker.com/layers/apache/submarine/database-0.5.0/images/sha256-6bd70d47db45cc95f45ff332ea37a3d2ed0bb415e88aa88d2c42533a1dad504e?context=explore
> >
> > The Jupyter Notebook image is here:
> >
> >
> https://hub.docker.com/layers/apache/submarine/jupyter-notebook-0.5.0/images/sha256-1e05cdd3c814063b3cac9de12bdecd70475d38d708c06794c2d3b55ef97de82a?context=explore
> >
> > The Maven staging repository is here:
> >
> https://repository.apache.org/content/repositories/orgapachesubmarine-1014
> >
> > My public key is here:
> > https://dist.apache.org/repos/dist/release/submarine/KEYS
> >
> > *This vote will run for 7 days, ending on Oct 22, 2020, at 11:59 pm PST.*
> >
> > For the testing, I have verified the
> >
> > 1. Build from source, Run the mnist on Hadoop
> >
> > 2. Example with mini-submarine(both local and remote mode)
> >
> > 3. Verified the experiment operations to K8s by Submarine Server REST and
> > PySubmarine.
> >
> > 4. Workbench UI (experiment, environment, notebook)
> >
> > 5. HTTP sync code in the experiment
> >
> > 6. Environment profile REST API
> >
> > 7. Notebook REST API
> >
> >
> > Please follow the document to test these features.
> > *
> >
> https://github.com/apache/submarine/tree/master/dev-support/mini-submarine
> > *
> https://github.com/apache/submarine/blob/master/docs/user-guide-home.md
> >
> > My +1 to start. Thanks!
> >
> > BR,
> > Kevin Su
> >
>

Re: [VOTE] Submarine-0.5.0-RC0 is ready for a vote!

Posted by Wei-Chiu Chuang <we...@apache.org>.
Reminder for this RC -- we're only three days before the proposed 7-day
period lapse.

I'll try to get a crack at it soon.

Thanks

On Wed, Oct 14, 2020 at 10:24 PM Kevin Su <pi...@gmail.com> wrote:

> Hi folks,
>
>
> Thanks to everyone's help on this release. Special thanks to Wangda,
>
> Zhankun, Xun, Wei-Chiu, Wanqiang, Ryan, and JohnTing!
>
> I've created a release candidate (RC0) for submarine 0.5.0. The highlighted
>
> features are as follows:
>
> 1. Submarine Experiments: Redefined the experiment spec, sync up code from
> Git, it could be https and ssh
>
> 2. Predefined experiment template: Register A experiment template and
> submit related parameter to run an experiment using Rest API
>
> 3. Environment profile: Users could easily manage their docker image and
> conda environment
>
> 4. Jupyter Notebook: Spawn a jupyter notebook using Rest API, and execute
> ML code on K8s, or submit an experiment to submarine server
>
> 5. Submarine Workbench UI: CRUD Experiment, Environment, Notebook through
> the UI
>
>
>
> The RC tag in git is here:
> https://github.com/apache/submarine/releases/tag/release-0.5.0-RC0
>
> The RC release artifacts are available at:
> http://home.apache.org/~pingsutw/submarine-0.5.0-RC0
>
> The mini-submarine image is here:
>
> https://hub.docker.com/layers/apache/submarine/mini-0.5.0-RC0/images/sha256-f3af4f923d96fbbdbbaca7efad19803f3e753bcba4e9ce38e3f292e6b2678826?context=explore
>
> The server image is here:
>
> https://hub.docker.com/layers/apache/submarine/server-0.5.0/images/sha256-26dbf47acef3e992269a0f2736268553b254381bf5cdf4a2418bc4a125284186?context=explore
>
> The database image is here:
>
> https://hub.docker.com/layers/apache/submarine/database-0.5.0/images/sha256-6bd70d47db45cc95f45ff332ea37a3d2ed0bb415e88aa88d2c42533a1dad504e?context=explore
>
> The Jupyter Notebook image is here:
>
> https://hub.docker.com/layers/apache/submarine/jupyter-notebook-0.5.0/images/sha256-1e05cdd3c814063b3cac9de12bdecd70475d38d708c06794c2d3b55ef97de82a?context=explore
>
> The Maven staging repository is here:
> https://repository.apache.org/content/repositories/orgapachesubmarine-1014
>
> My public key is here:
> https://dist.apache.org/repos/dist/release/submarine/KEYS
>
> *This vote will run for 7 days, ending on Oct 22, 2020, at 11:59 pm PST.*
>
> For the testing, I have verified the
>
> 1. Build from source, Run the mnist on Hadoop
>
> 2. Example with mini-submarine(both local and remote mode)
>
> 3. Verified the experiment operations to K8s by Submarine Server REST and
> PySubmarine.
>
> 4. Workbench UI (experiment, environment, notebook)
>
> 5. HTTP sync code in the experiment
>
> 6. Environment profile REST API
>
> 7. Notebook REST API
>
>
> Please follow the document to test these features.
> *
> https://github.com/apache/submarine/tree/master/dev-support/mini-submarine
> * https://github.com/apache/submarine/blob/master/docs/user-guide-home.md
>
> My +1 to start. Thanks!
>
> BR,
> Kevin Su
>