You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@nemo.apache.org by je...@apache.org on 2018/06/15 11:50:43 UTC
[incubator-nemo] branch master updated: [NEMO-113] Update README
(#44)
This is an automated email from the ASF dual-hosted git repository.
jeongyoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-nemo.git
The following commit(s) were added to refs/heads/master by this push:
new 9b0b133 [NEMO-113] Update README (#44)
9b0b133 is described below
commit 9b0b13342f14eacffd312f62b9c6b5d418b1eaa0
Author: Gyewon Lee <st...@gmail.com>
AuthorDate: Fri Jun 15 20:50:35 2018 +0900
[NEMO-113] Update README (#44)
JIRA: NEMO-113: Update README
Major changes:
* Fix broken links in README.md
Minor changes to note:
n/a
Tests for the changes:
n/a
Other comments:
n/a
resolves NEMO-113
---
README.md | 10 +++++-----
1 file changed, 5 insertions(+), 5 deletions(-)
diff --git a/README.md b/README.md
index 2eb4a9a..79a4165 100644
--- a/README.md
+++ b/README.md
@@ -19,7 +19,7 @@ Please refer to the [Contribution guideline](.github/CONTRIBUTING.md) to contrib
* Java 8
* Maven
* YARN settings
- * Download Hadoop 2.7.4 at http://apache.tt.co.kr/hadoop/common/hadoop-2.7.4/
+ * Download Hadoop 2.7.4 at https://archive.apache.org/dist/hadoop/common/hadoop-2.7.4/
* Set the shell profile as following:
```bash
export HADOOP_HOME=/path/to/hadoop-2.7.4
@@ -92,7 +92,7 @@ Please refer to the [Contribution guideline](.github/CONTRIBUTING.md) to contrib
-executor_json `pwd`/examples/resources/sample_executor_resources.json \
-optimization_policy edu.snu.nemo.compiler.optimizer.policy.DefaultPolicy \
-user_main edu.snu.nemo.examples.beam.WordCount \
- -user_args "`pwd`/examples/resources/sample_input_mr `pwd`/examples/resources/sample_output_mr"
+ -user_args "`pwd`/examples/resources/sample_input_wordcount `pwd`/examples/resources/sample_output_wordcount"
## YARN cluster example
./bin/run_beam.sh \
@@ -101,7 +101,7 @@ Please refer to the [Contribution guideline](.github/CONTRIBUTING.md) to contrib
-executor_json `pwd`/examples/resources/sample_executor_resources.json \
-user_main edu.snu.nemo.examples.beam.WordCount \
-optimization_policy edu.snu.nemo.compiler.optimizer.policy.PadoPolicy \
- -user_args "hdfs://v-m:9000/sample_input_mr hdfs://v-m:9000/sample_output_mr"
+ -user_args "hdfs://v-m:9000/sample_input_wordcount hdfs://v-m:9000/sample_output_wordcount"
```
## Resource Configuration
`-executor_json` command line option can be used to provide a path to the JSON file that describes resource configuration for executors. Its default value is `config/default.json`, which initializes one of each `Transient`, `Reserved`, and `Compute` executor, each of which has one core and 1024MB memory.
@@ -139,13 +139,13 @@ This example configuration specifies
## Monitoring your job using web UI
Nemo Compiler and Engine can store JSON representation of intermediate DAGs.
* `-dag_dir` command line option is used to specify the directory where the JSON files are stored. The default directory is `./dag`.
- Using our [online visualizer](https://service.jangho.io/nemo-dag/), you can easily visualize a DAG. Just drop the JSON file of the DAG as an input to it.
+ Using our [online visualizer](http://cmscluster.snu.ac.kr:50080/nemo-dag/), you can easily visualize a DAG. Just drop the JSON file of the DAG as an input to it.
### Examples
```bash
./bin/run_beam.sh \
-job_id als \
- -executor_json `pwd`/examples/resources/sample_executor_resources.json \
+ -executor_json `pwd`/examples/resources/beam_sample_executor_resources.json \
-user_main edu.snu.nemo.examples.beam.AlternatingLeastSquare \
-optimization_policy edu.snu.nemo.compiler.optimizer.policy.PadoPolicy \
-dag_dir "./dag/als" \
--
To stop receiving notification emails like this one, please contact
jeongyoon@apache.org.