You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@systemds.apache.org by GitBox <gi...@apache.org> on 2021/05/10 01:15:49 UTC
[GitHub] [systemds] j143 opened a new pull request #1271: [WIP] Use SystemDS with Docker
j143 opened a new pull request #1271:
URL: https://github.com/apache/systemds/pull/1271
This is working document for usage of SystemDS with Docker images.
**Motivation:**
This helps in prototyping DML or python based scripts faster and run the notebooks with jupyter support.
```sh
docker run -it --rm apache/systemds \
/bin/bash -c "echo 'print("This is SystemDS!")' > hello.dml && systemds hello.dml"
```
**Present:**
With the existing [`docker/`](https://github.com/apache/systemds/tree/master/docker) files,
`dev` releases can be made.
**Future behavior:**
| Tag | Description |
| --- | --- |
| `latest` | The latest release of SystemDS CPU image. Default version. |
| `version` | Specify the exact version |
| `dev` | Builds for SystemDS `master` branch. Used by SystemDS developers |
With GPU:
| Tag Variants | Description |
| --- | --- |
| `tag-gpu` | The specified tag release with GPU support. |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [systemds] j143 commented on pull request #1271: [WIP][SYSTEMDS-2974][Design Doc] Use SystemDS with Docker
Posted by GitBox <gi...@apache.org>.
j143 commented on pull request #1271:
URL: https://github.com/apache/systemds/pull/1271#issuecomment-836441539
cc @Baunsgaard
Hi Sebastian,
> this documentation is not valid since it does not reflect the underlying implementation.
This is a design doc (this is mentioned in description of this PR!).
> If we want to have the system act like in these docs, we have to change some of the docker behavior.
Yes. In fact, we will need to extend a bit.
> I would suggest looking in our docker folder, I have added some docs there already for how to use the images.
Thanks. This design doc is an extension (or based) of these docs.
BTW, can you explicitly mention whether you `+1` or `-1` with the proposed design?
Thanks a lot,
Janardhan
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [systemds] Baunsgaard commented on pull request #1271: [WIP][SYSTEMDS-2974] Use SystemDS with Docker
Posted by GitBox <gi...@apache.org>.
Baunsgaard commented on pull request #1271:
URL: https://github.com/apache/systemds/pull/1271#issuecomment-836394013
i must question this,
this documentation is not valid since it does not reflect the underlying implementation. If we want to have the system act like in these docs, we have to change some of the docker behavior.
Also just to make it clear, there is no official Apache docker management, each project have their own just like us: https://hub.docker.com/orgs/systemds
I would suggest looking in our docker folder, i have added some docs there already for how to use the images.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [systemds] Baunsgaard commented on pull request #1271: [WIP][SYSTEMDS-2974][Design Doc] Use SystemDS with Docker
Posted by GitBox <gi...@apache.org>.
Baunsgaard commented on pull request #1271:
URL: https://github.com/apache/systemds/pull/1271#issuecomment-836484070
:-1: for now.
I like the idea of separating the docker images in accordance to what you propose because it fits well with other systems separation of images.
I mainly say :-1: because this is done in the wrong order, especially because the design docs are describing something we already have. I would prefer such a thing as this to be on the dev list, as a suggestion that could be discussed, if it is only documentation, and not an implementation modifying the system. if we want to change the implementation to fit to these docs we should do it in the same process as we update the docker images.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [systemds] j143 commented on pull request #1271: [WIP][SYSTEMDS-2974][Design Doc] Use SystemDS with Docker
Posted by GitBox <gi...@apache.org>.
j143 commented on pull request #1271:
URL: https://github.com/apache/systemds/pull/1271#issuecomment-836447503
> official Apache docker management, each project have their own just like us: https://hub.docker.com/orgs/systemds
Not convinced yet. I have asked around apache/airflow team. We will resolve this later. 😃
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [systemds] j143 edited a comment on pull request #1271: [WIP][SYSTEMDS-2974][Design Doc] Use SystemDS with Docker
Posted by GitBox <gi...@apache.org>.
j143 edited a comment on pull request #1271:
URL: https://github.com/apache/systemds/pull/1271#issuecomment-836441539
cc @Baunsgaard
Hi Sebastian,
> this documentation is not valid since it does not reflect the underlying implementation.
This is a design doc (this is mentioned in description of this PR!). tag updated.
> If we want to have the system act like in these docs, we have to change some of the docker behavior.
Yes. In fact, we will need to extend a bit.
> I would suggest looking in our docker folder, I have added some docs there already for how to use the images.
Thanks. This design doc is an extension (or based) of these docs.
BTW, can you explicitly mention whether you `+1` or `-1` with the proposed design?
Thanks a lot,
Janardhan
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [systemds] j143 closed pull request #1271: [WIP][SYSTEMDS-2974][Design Doc] Use SystemDS with Docker
Posted by GitBox <gi...@apache.org>.
j143 closed pull request #1271:
URL: https://github.com/apache/systemds/pull/1271
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org