You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by ya...@apache.org on 2014/07/16 18:52:27 UTC
git commit: SAMZA-322: update YARN deploy tutorial
Repository: incubator-samza
Updated Branches:
refs/heads/master 610ee8492 -> 40bbe4da5
SAMZA-322: update YARN deploy tutorial
Project: http://git-wip-us.apache.org/repos/asf/incubator-samza/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-samza/commit/40bbe4da
Tree: http://git-wip-us.apache.org/repos/asf/incubator-samza/tree/40bbe4da
Diff: http://git-wip-us.apache.org/repos/asf/incubator-samza/diff/40bbe4da
Branch: refs/heads/master
Commit: 40bbe4da58e8990044ea2ecb65cdd79fb71bdcd2
Parents: 610ee84
Author: Yan Fang <ya...@gmail.com>
Authored: Wed Jul 16 09:51:49 2014 -0700
Committer: Yan Fang <ya...@gmail.com>
Committed: Wed Jul 16 09:51:49 2014 -0700
----------------------------------------------------------------------
.../0.7.0/deploy-samza-job-from-hdfs.md | 33 ++------------------
1 file changed, 2 insertions(+), 31 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-samza/blob/40bbe4da/docs/learn/tutorials/0.7.0/deploy-samza-job-from-hdfs.md
----------------------------------------------------------------------
diff --git a/docs/learn/tutorials/0.7.0/deploy-samza-job-from-hdfs.md b/docs/learn/tutorials/0.7.0/deploy-samza-job-from-hdfs.md
index 145d51c..ab33dd3 100644
--- a/docs/learn/tutorials/0.7.0/deploy-samza-job-from-hdfs.md
+++ b/docs/learn/tutorials/0.7.0/deploy-samza-job-from-hdfs.md
@@ -21,34 +21,6 @@ title: Deploying a Samza job from HDFS
This tutorial uses [hello-samza](../../../startup/hello-samza/0.7.0/) to illustrate how to run a Samza job if you want to publish the Samza job's .tar.gz package to HDFS.
-### Build a new Samza job package
-
-Build a new Samza job package to include the hadoop-hdfs-version.jar.
-
-* Add dependency statement in pom.xml of samza-job-package
-
-{% highlight xml %}
-<dependency>
- <groupId>org.apache.hadoop</groupId>
- <artifactId>hadoop-hdfs</artifactId>
- <version>2.2.0</version>
-</dependency>
-{% endhighlight %}
-
-* Add the following code to src/main/assembly/src.xml in samza-job-package.
-
-{% highlight xml %}
-<include>org.apache.hadoop:hadoop-hdfs</include>
-{% endhighlight %}
-
-* Create .tar.gz package
-
-{% highlight bash %}
-mvn clean pacakge
-{% endhighlight %}
-
-* Make sure hadoop-common-version.jar has the same version as your hadoop-hdfs-version.jar. Otherwise, you may still have errors.
-
### Upload the package
{% highlight bash %}
@@ -57,7 +29,7 @@ hadoop fs -put ./samza-job-package/target/samza-job-package-0.7.0-dist.tar.gz /p
### Add HDFS configuration
-Put the hdfs-site.xml file of your cluster into ~/.samza/conf directory. (The same place as the yarn-site.xml)
+Put the hdfs-site.xml file of your cluster into ~/.samza/conf directory (The same place as the yarn-site.xml). If you set HADOOP\_CONF\_DIR, put the hdfs-site.xml in your configuration directory if the hdfs-site.xml is not there.
### Change properties file
@@ -67,5 +39,4 @@ Change the yarn.package.path in the properties file to your HDFS location.
yarn.package.path=hdfs://<hdfs name node ip>:<hdfs name node port>/path/to/tgz
{% endhighlight %}
-Then you should be able to run the Samza job as described in [hello-samza](../../../startup/hello-samza/0.7.0/).
-
+Then you should be able to run the Samza job as described in [hello-samza](../../../startup/hello-samza/0.7.0/).
\ No newline at end of file