You are viewing a plain text version of this content. The canonical link for it is here.
Posted to submarine-dev@hadoop.apache.org by "Zhankun Tang (Jira)" <ji...@apache.org> on 2019/09/23 02:42:00 UTC
[jira] [Updated] (SUBMARINE-15) [Submarine] Job should not be
submitted if "--input_path" option is missing
[ https://issues.apache.org/jira/browse/SUBMARINE-15?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhankun Tang updated SUBMARINE-15:
----------------------------------
Fix Version/s: 0.2.0
> [Submarine] Job should not be submitted if "--input_path" option is missing
> ---------------------------------------------------------------------------
>
> Key: SUBMARINE-15
> URL: https://issues.apache.org/jira/browse/SUBMARINE-15
> Project: Hadoop Submarine
> Issue Type: New Feature
> Reporter: Zhankun Tang
> Assignee: Zhankun Tang
> Priority: Critical
> Fix For: 0.2.0
>
> Attachments: YARN-8798-trunk.001.patch, YARN-8798-trunk.002.patch
>
>
> If a user doesn't set "–input_path" option, the job will still be submitted. Here is my command to run the job:
> {code:java}
> yarn jar $HADOOP_BASE_DIR/home/share/hadoop/yarn/hadoop-yarn-submarine-3.2.0-SNAPSHOT.jar job run \
> -verbose \
> -wait_job_finish \
> --env DOCKER_JAVA_HOME=/usr/lib/jvm/java-8-oracle \
> --env DOCKER_HADOOP_HDFS_HOME=/hadoop-3.2.0-SNAPSHOT \
> --name tf-job-001 \
> --docker_image tangzhankun/tensorflow \
> --worker_resources memory=4G,vcores=2 \
> --worker_launch_cmd "cd /cifar10_estimator && python cifar10_main.py --data-dir=%input_path% --job-dir=%checkpoint_path% --num-gpus=0 --train-steps=5"{code}
> Due to lack of invalidity check, the job is still submitted. We should add a check on this.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)