You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@submarine.apache.org by li...@apache.org on 2019/12/10 12:05:52 UTC
[submarine] branch master updated: SUBMARINE-315. Fix
run_submarine_mnist_tony_rpc.sh run error
This is an automated email from the ASF dual-hosted git repository.
liuxun pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/submarine.git
The following commit(s) were added to refs/heads/master by this push:
new e1c70bd SUBMARINE-315. Fix run_submarine_mnist_tony_rpc.sh run error
e1c70bd is described below
commit e1c70bde8a9b0f378d19292f5b3dbe93d209e5c8
Author: pingsutw <pi...@gmail.com>
AuthorDate: Mon Dec 9 19:59:03 2019 +0800
SUBMARINE-315. Fix run_submarine_mnist_tony_rpc.sh run error
### What is this PR for?
Change classpath in run_submarine_mnist_tony_rpc.sh
### What type of PR is it?
[Bug Fix]
### Todos
* [ ] - Task
### What is the Jira issue?
https://issues.apache.org/jira/browse/SUBMARINE-315
### How should this be tested?
https://travis-ci.org/pingsutw/hadoop-submarine/builds/622624260
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: pingsutw <pi...@gmail.com>
Closes #125 from pingsutw/SUBMARINE-315 and squashes the following commits:
145a06f [pingsutw] SUBMARINE-315. Fix run_submarine_mnist_tony_rpc.sh run error
---
dev-support/mini-submarine/README.md | 3 ++-
dev-support/mini-submarine/submarine/run_submarine_mnist_tony_rpc.sh | 4 ++--
2 files changed, 4 insertions(+), 3 deletions(-)
diff --git a/dev-support/mini-submarine/README.md b/dev-support/mini-submarine/README.md
index 218e8fa..2d59ce8 100644
--- a/dev-support/mini-submarine/README.md
+++ b/dev-support/mini-submarine/README.md
@@ -31,6 +31,7 @@ docker pull hadoopsubmarine/mini-submarine:0.3.0-SNAPSHOT
#### Create image by yourself
> You may need a VPN if your network is limited
+
1.Clone the source code of Submarine
```
git clone https://github.com/apache/submarine.git
@@ -134,7 +135,7 @@ Set submarine.server.remote.execution.enabled to true in the file of
```
Run the following command to submit a job via submarine server
```
-./run_submarine_mnist_tony.sh
+./run_submarine_mnist_tony_rpc.sh
```
#### Try your own submarine program
diff --git a/dev-support/mini-submarine/submarine/run_submarine_mnist_tony_rpc.sh b/dev-support/mini-submarine/submarine/run_submarine_mnist_tony_rpc.sh
index 3f0c483..ed016ae 100644
--- a/dev-support/mini-submarine/submarine/run_submarine_mnist_tony_rpc.sh
+++ b/dev-support/mini-submarine/submarine/run_submarine_mnist_tony_rpc.sh
@@ -50,7 +50,7 @@ fi
SUBMARINE_VERSION=0.3.0-SNAPSHOT
HADOOP_VERSION=2.9
-${JAVA_CMD} -cp /opt/submarine/submarine-dist-${SUBMARINE_VERSION}-hadoop-${HADOOP_VERSION}/submarine-all-${SUBMARINE_VERSION}-hadoop-${HADOOP_VERSION}.jar:/usr/local/hadoop/etc/hadoop:/opt/submarine/submarine-dist-${SUBMARINE_VERSION}-hadoop-${HADOOP_VERSION}/conf \
+${JAVA_CMD} -cp /opt/submarine-dist-${SUBMARINE_VERSION}-hadoop-${HADOOP_VERSION}/submarine-all-${SUBMARINE_VERSION}-hadoop-${HADOOP_VERSION}.jar:/usr/local/hadoop/etc/hadoop:/opt/submarine-dist-${SUBMARINE_VERSION}-hadoop-${HADOOP_VERSION}/conf \
org.apache.submarine.client.cli.Cli job run --name tf-job-001 \
--framework tensorflow \
--verbose \
@@ -62,4 +62,4 @@ ${JAVA_CMD} -cp /opt/submarine/submarine-dist-${SUBMARINE_VERSION}-hadoop-${HADO
--worker_launch_cmd "${WORKER_CMD}" \
--ps_launch_cmd "myvenv.zip/venv/bin/python mnist_distributed.py --steps 2 --data_dir /tmp/data --working_dir /tmp/mode" \
--insecure \
- --conf tony.containers.resources=/home/yarn/submarine/myvenv.zip#archive,/home/yarn/submarine/mnist_distributed.py,/opt/submarine/submarine-dist-${SUBMARINE_VERSION}-hadoop-${HADOOP_VERSION}/submarine-all-${SUBMARINE_VERSION}-hadoop-${HADOOP_VERSION}.jar
+ --conf tony.containers.resources=/home/yarn/submarine/myvenv.zip#archive,/home/yarn/submarine/mnist_distributed.py,/opt/submarine-dist-${SUBMARINE_VERSION}-hadoop-${HADOOP_VERSION}/submarine-all-${SUBMARINE_VERSION}-hadoop-${HADOOP_VERSION}.jar
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@submarine.apache.org
For additional commands, e-mail: dev-help@submarine.apache.org