You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by cr...@apache.org on 2013/08/02 18:27:54 UTC
svn commit: r1509764 [19/21] - in /incubator/samza/site: ./ community/
contribute/ css/ img/ img/0.7.0/ img/0.7.0/learn/
img/0.7.0/learn/documentation/ img/0.7.0/learn/documentation/comparisons/
img/0.7.0/learn/documentation/container/ img/0.7.0/learn/...
Added: incubator/samza/site/learn/documentation/0.7.0/jobs/configuration.html
URL: http://svn.apache.org/viewvc/incubator/samza/site/learn/documentation/0.7.0/jobs/configuration.html?rev=1509764&view=auto
==============================================================================
--- incubator/samza/site/learn/documentation/0.7.0/jobs/configuration.html (added)
+++ incubator/samza/site/learn/documentation/0.7.0/jobs/configuration.html Fri Aug 2 16:27:50 2013
@@ -0,0 +1,123 @@
+<html>
+ <head>
+ <title>Samza - Configuration</title>
+ <link href="/css/main.css" rel="stylesheet"/>
+ <link href='http://fonts.googleapis.com/css?family=Ropa+Sans' rel='stylesheet' type='text/css'/>
+ <link href="http://netdna.bootstrapcdn.com/font-awesome/3.1.1/css/font-awesome.css" rel="stylesheet"/>
+ <link rel="icon" type="image/png" href="/img/samza-icon.png">
+ </head>
+ <body>
+ <div class="container">
+ <div class="container-inner">
+ <div class="header">
+ <div class="page">
+ <div class="logo">
+ <a href="/" class="logo">samza</a>
+ </div>
+ <div class="top-icons">
+ <a href="/startup/download"><i class="icon-download top-icon"></i></a>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank"><i class="icon-code top-icon" style="font-weight: bold;"></i></a>
+ <a href="https://twitter.com/samzastream" target="_blank"><i class="icon-twitter top-icon"></i></a>
+ </div>
+ </div>
+ </div>
+
+ <div class="page">
+ <!-- menu -->
+ <div class="menu">
+ <div class="menu-inner">
+ <div class="menu-title"><i class="icon-rocket"></i> Getting Started</div>
+ <div class="menu-category">
+ <a href="/startup/hello-samza/0.7.0">Hello Samza</a><br/>
+ <a href="/startup/download">Download</a><br/>
+ </div>
+ <div class="menu-title"><i class="icon-book"></i> Learn</div>
+ <div class="menu-category">
+ <a href="/learn/documentation/0.7.0">Documentation</a><br/>
+ <a href="/learn/tutorials/0.7.0">Tutorials</a><br/>
+ FAQ<br/>
+ <!-- TODO add links to apache when we get them -->
+ Wiki<br/>
+ Papers & Talks<br/>
+ </div>
+ <div class="menu-title"><i class="icon-comments"></i> Community</div>
+ <div class="menu-category">
+ <a href="/community/mailing-lists.html">Mailing Lists</a><br/>
+ <a href="/community/irc.html">IRC</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Bugs<br/>
+ Powered by<br/>
+ Ecosystem<br/>
+ <a href="/community/committers.html">Committers</a>
+ </div>
+ <div class="menu-title"><i class="icon-code"></i> Contribute</div>
+ <div class="menu-category">
+ <a href="/contribute/rules.html">Rules</a><br/>
+ <a href="/contribute/coding-guide.html">Coding Guide</a><br/>
+ <a href="/contribute/projects.html">Projects</a><br/>
+ <a href="/contribute/seps.html">SEPs</a><br/>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank">Code</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Unit Tests<br/>
+ <a href="/contribute/disclaimer.html">Disclaimer</a>
+ </div>
+ </div>
+ </div>
+ <!-- body -->
+ <div class="body">
+ <h2>Configuration</h2>
+
+<p>All Samza jobs have a configuration file that defines the job. A very basic configuration file looks like this:</p>
+<div class="highlight"><pre><code class="text language-text" data-lang="text"># Job
+job.factory.class=samza.job.local.LocalJobFactory
+job.name=hello-world
+
+# Task
+task.class=samza.task.example.MyJavaStreamerTask
+task.inputs=example-stream
+
+# Serializers
+serializers.registry.json.class=samza.serializers.JsonSerdeFactory
+serializers.default=json
+
+# Streams
+streams.example-stream.system=example-system
+streams.example-stream.stream=some-stream
+
+# Systems
+systems.example-system.samza.consumer.factory=samza.stream.example.ExampleConsumerFactory
+systems.example-system.samza.partition.manager=samza.stream.example.ExamplePartitionManager
+</code></pre></div>
+<p>There are five major sections to a configuration file. The job section defines things like the name of the job, and whether to use the YarnJobFactory or LocalJobFactory. The task section is where you specify the class name for your StreamTask. It's also where you define what the input streams are for your task. The system section defines systems that you can read from. Usually, you'll define a Kafka system, if you're reading from Kafka. After that you'll need to define the stream(s) that you want to read from, which systems they're coming from, and how to deserialize objects from the stream.</p>
+
+<h3>Required Configuration</h3>
+
+<p>Configuration keys that absolutely must be defined for a Samza job are:</p>
+
+<ul>
+<li>job.factory.class</li>
+<li>job.name</li>
+<li>task.class</li>
+<li>task.inputs</li>
+</ul>
+
+<h3>Configuration Keys</h3>
+
+<p>A complete list of configuration keys can be found on the <a href="configuration-table.html">Configuration Table</a> page.</p>
+
+<h2><a href="packaging.html">Packaging »</a></h2>
+
+
+ </div>
+ </div>
+ </div>
+ </div>
+ <div class="footer">
+ <div class="page footer-content">
+ <!-- nothing for now. -->
+ </div>
+ </div>
+ </body>
+</html>
\ No newline at end of file
Added: incubator/samza/site/learn/documentation/0.7.0/jobs/job-runner.html
URL: http://svn.apache.org/viewvc/incubator/samza/site/learn/documentation/0.7.0/jobs/job-runner.html?rev=1509764&view=auto
==============================================================================
--- incubator/samza/site/learn/documentation/0.7.0/jobs/job-runner.html (added)
+++ incubator/samza/site/learn/documentation/0.7.0/jobs/job-runner.html Fri Aug 2 16:27:50 2013
@@ -0,0 +1,116 @@
+<html>
+ <head>
+ <title>Samza - JobRunner</title>
+ <link href="/css/main.css" rel="stylesheet"/>
+ <link href='http://fonts.googleapis.com/css?family=Ropa+Sans' rel='stylesheet' type='text/css'/>
+ <link href="http://netdna.bootstrapcdn.com/font-awesome/3.1.1/css/font-awesome.css" rel="stylesheet"/>
+ <link rel="icon" type="image/png" href="/img/samza-icon.png">
+ </head>
+ <body>
+ <div class="container">
+ <div class="container-inner">
+ <div class="header">
+ <div class="page">
+ <div class="logo">
+ <a href="/" class="logo">samza</a>
+ </div>
+ <div class="top-icons">
+ <a href="/startup/download"><i class="icon-download top-icon"></i></a>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank"><i class="icon-code top-icon" style="font-weight: bold;"></i></a>
+ <a href="https://twitter.com/samzastream" target="_blank"><i class="icon-twitter top-icon"></i></a>
+ </div>
+ </div>
+ </div>
+
+ <div class="page">
+ <!-- menu -->
+ <div class="menu">
+ <div class="menu-inner">
+ <div class="menu-title"><i class="icon-rocket"></i> Getting Started</div>
+ <div class="menu-category">
+ <a href="/startup/hello-samza/0.7.0">Hello Samza</a><br/>
+ <a href="/startup/download">Download</a><br/>
+ </div>
+ <div class="menu-title"><i class="icon-book"></i> Learn</div>
+ <div class="menu-category">
+ <a href="/learn/documentation/0.7.0">Documentation</a><br/>
+ <a href="/learn/tutorials/0.7.0">Tutorials</a><br/>
+ FAQ<br/>
+ <!-- TODO add links to apache when we get them -->
+ Wiki<br/>
+ Papers & Talks<br/>
+ </div>
+ <div class="menu-title"><i class="icon-comments"></i> Community</div>
+ <div class="menu-category">
+ <a href="/community/mailing-lists.html">Mailing Lists</a><br/>
+ <a href="/community/irc.html">IRC</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Bugs<br/>
+ Powered by<br/>
+ Ecosystem<br/>
+ <a href="/community/committers.html">Committers</a>
+ </div>
+ <div class="menu-title"><i class="icon-code"></i> Contribute</div>
+ <div class="menu-category">
+ <a href="/contribute/rules.html">Rules</a><br/>
+ <a href="/contribute/coding-guide.html">Coding Guide</a><br/>
+ <a href="/contribute/projects.html">Projects</a><br/>
+ <a href="/contribute/seps.html">SEPs</a><br/>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank">Code</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Unit Tests<br/>
+ <a href="/contribute/disclaimer.html">Disclaimer</a>
+ </div>
+ </div>
+ </div>
+ <!-- body -->
+ <div class="body">
+ <h2>JobRunner</h2>
+
+<p>Samza jobs are started using a script called run-job.sh.</p>
+<div class="highlight"><pre><code class="text language-text" data-lang="text">samza-example/target/bin/run-job.sh \
+ --config-factory=samza.config.factories.PropertiesConfigFactory \
+ --config-path=file://$PWD/config/hello-world.properties
+</code></pre></div>
+<p>You provide two parameters to the run-job.sh script. One is the config location, and the other is a factory class that is used to read your configuration file. The run-job.sh script is actually executing a Samza class called JobRunner. The JobRunner uses your ConfigFactory to get a Config object from the config path.</p>
+<div class="highlight"><pre><code class="text language-text" data-lang="text">public interface ConfigFactory {
+ Config getConfig(URI configUri);
+}
+</code></pre></div>
+<p>The Config object is just a wrapper around Map<String, String>, with some nice helper methods. Out of the box, Samza ships with the PropertiesConfigFactory, but developers can implement any kind of ConfigFactory they wish.</p>
+
+<p>Once the JobRunner gets your configuration, it gives your configuration to the StreamJobFactory class defined by the "job.factory" property. Samza ships with two job factory implementations: LocalJobFactory and YarnJobFactory. The StreamJobFactory's responsibility is to give the JobRunner a job that it can run.</p>
+<div class="highlight"><pre><code class="text language-text" data-lang="text">public interface StreamJob {
+ StreamJob submit();
+
+ StreamJob kill();
+
+ ApplicationStatus waitForFinish(long timeoutMs);
+
+ ApplicationStatus waitForStatus(ApplicationStatus status, long timeoutMs);
+
+ ApplicationStatus getStatus();
+}
+</code></pre></div>
+<p>Once the JobRunner gets a job, it calls submit() on the job. This method is what tells the StreamJob implementation to start the TaskRunner. In the case of LocalJobRunner, it uses a run-task.sh script to execute the TaskRunner in a separate process, which will start one TaskRunner locally on the machine that you ran run-job.sh on.</p>
+
+<p><img src="/img/0.7.0/learn/documentation/container/job-flow.png" alt="diagram"></p>
+
+<p>This flow differs slightly when you use YARN, but we'll get to that later.</p>
+
+<h2><a href="configuration.html">Configuration »</a></h2>
+
+
+ </div>
+ </div>
+ </div>
+ </div>
+ <div class="footer">
+ <div class="page footer-content">
+ <!-- nothing for now. -->
+ </div>
+ </div>
+ </body>
+</html>
\ No newline at end of file
Added: incubator/samza/site/learn/documentation/0.7.0/jobs/logging.html
URL: http://svn.apache.org/viewvc/incubator/samza/site/learn/documentation/0.7.0/jobs/logging.html?rev=1509764&view=auto
==============================================================================
--- incubator/samza/site/learn/documentation/0.7.0/jobs/logging.html (added)
+++ incubator/samza/site/learn/documentation/0.7.0/jobs/logging.html Fri Aug 2 16:27:50 2013
@@ -0,0 +1,129 @@
+<html>
+ <head>
+ <title>Samza - Logging</title>
+ <link href="/css/main.css" rel="stylesheet"/>
+ <link href='http://fonts.googleapis.com/css?family=Ropa+Sans' rel='stylesheet' type='text/css'/>
+ <link href="http://netdna.bootstrapcdn.com/font-awesome/3.1.1/css/font-awesome.css" rel="stylesheet"/>
+ <link rel="icon" type="image/png" href="/img/samza-icon.png">
+ </head>
+ <body>
+ <div class="container">
+ <div class="container-inner">
+ <div class="header">
+ <div class="page">
+ <div class="logo">
+ <a href="/" class="logo">samza</a>
+ </div>
+ <div class="top-icons">
+ <a href="/startup/download"><i class="icon-download top-icon"></i></a>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank"><i class="icon-code top-icon" style="font-weight: bold;"></i></a>
+ <a href="https://twitter.com/samzastream" target="_blank"><i class="icon-twitter top-icon"></i></a>
+ </div>
+ </div>
+ </div>
+
+ <div class="page">
+ <!-- menu -->
+ <div class="menu">
+ <div class="menu-inner">
+ <div class="menu-title"><i class="icon-rocket"></i> Getting Started</div>
+ <div class="menu-category">
+ <a href="/startup/hello-samza/0.7.0">Hello Samza</a><br/>
+ <a href="/startup/download">Download</a><br/>
+ </div>
+ <div class="menu-title"><i class="icon-book"></i> Learn</div>
+ <div class="menu-category">
+ <a href="/learn/documentation/0.7.0">Documentation</a><br/>
+ <a href="/learn/tutorials/0.7.0">Tutorials</a><br/>
+ FAQ<br/>
+ <!-- TODO add links to apache when we get them -->
+ Wiki<br/>
+ Papers & Talks<br/>
+ </div>
+ <div class="menu-title"><i class="icon-comments"></i> Community</div>
+ <div class="menu-category">
+ <a href="/community/mailing-lists.html">Mailing Lists</a><br/>
+ <a href="/community/irc.html">IRC</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Bugs<br/>
+ Powered by<br/>
+ Ecosystem<br/>
+ <a href="/community/committers.html">Committers</a>
+ </div>
+ <div class="menu-title"><i class="icon-code"></i> Contribute</div>
+ <div class="menu-category">
+ <a href="/contribute/rules.html">Rules</a><br/>
+ <a href="/contribute/coding-guide.html">Coding Guide</a><br/>
+ <a href="/contribute/projects.html">Projects</a><br/>
+ <a href="/contribute/seps.html">SEPs</a><br/>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank">Code</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Unit Tests<br/>
+ <a href="/contribute/disclaimer.html">Disclaimer</a>
+ </div>
+ </div>
+ </div>
+ <!-- body -->
+ <div class="body">
+ <h2>Logging</h2>
+
+<p>Samza uses <a href="http://www.slf4j.org/">SLF4J</a> for all of its logging. By default, only slf4j-api is used, so you must add an SLF4J runtime dependency to your Samza packages for whichever underlying logging platform you wish to use.</p>
+
+<h3>Log4j</h3>
+
+<p>The <a href="/startup/hello-samza/0.7.0">hello-samza</a> project shows how to use <a href="http://logging.apache.org/log4j/1.2/">log4j</a> with Samza. To turn on log4j logging, you just need to make sure slf4j-log4j12 is in your Samza TaskRunner's classpath. In Maven, this can be done by adding the following dependency to your Samza package project.</p>
+<div class="highlight"><pre><code class="text language-text" data-lang="text"><dependency>
+ <groupId>org.slf4j</groupId>
+ <artifactId>slf4j-log4j12</artifactId>
+ <scope>runtime</scope>
+ <version>1.6.2</version>
+</dependency>
+</code></pre></div>
+<p>If you're not using Maven, just make sure that slf4j-log4j12 ends up in your Samza package's lib directory.</p>
+
+<h4>log4j.xml</h4>
+
+<p>Samza's <a href="packaging.html">run-class.sh</a> script will automatically set the following setting if log4j.xml exists in your <a href="packaging.html">Samza package's</a> lib directory.</p>
+<div class="highlight"><pre><code class="text language-text" data-lang="text">-Dlog4j.configuration=file:$base_dir/lib/log4j.xml
+</code></pre></div>
+<!-- TODO add notes showing how to use task.opts for gc logging
+#### task.opts
+-->
+
+<h3>Log Directory</h3>
+
+<p>Samza will look for the <em>SAMZA</em>_<em>LOG</em>_<em>DIR</em> environment variable when it executes. If this variable is defined, all logs will be written to this directory. If the environment variable is empty, or not defined, then Samza will use /tmp. This environment variable can also be referenced inside log4j.xml files.</p>
+
+<h3>Garbage Collection Logging</h3>
+
+<p>Samza's will automatically set the following garbage collection logging setting, and will output it to <em>$SAMZA</em>_<em>LOG</em>_<em>DIR</em>/gc.log.</p>
+<div class="highlight"><pre><code class="text language-text" data-lang="text">-XX:+PrintGCDateStamps -Xloggc:$SAMZA_LOG_DIR/gc.log
+</code></pre></div>
+<h4>Rotation</h4>
+
+<p>In older versions of Java, it is impossible to have GC logs roll over based on time or size without the use of a secondary tool. This means that your GC logs will never be deleted until a Samza job ceases to run. As of <a href="http://www.oracle.com/technetwork/java/javase/2col/6u34-bugfixes-1733379.html">Java 6 Update 34</a>, and <a href="http://www.oracle.com/technetwork/java/javase/7u2-relnotes-1394228.html">Java 7 Update 2</a>, <a href="http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6941923">new GC command line switches</a> have been added to support this functionality. If you are using a version of Java that supports GC log rotation, it's highly recommended that you turn it on.</p>
+
+<h3>YARN</h3>
+
+<p>When a Samza job executes on a YARN grid, the <em>$SAMZA</em>_<em>LOG</em>_<em>DIR</em> environment variable will point to a directory that is secured such that only the user executing the Samza job can read and write to it, if YARN is <a href="http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/ClusterSetup.html">securely configured</a>.</p>
+
+<h4>STDOUT</h4>
+
+<p>YARN pipes all STDOUT and STDERR output to logs/stdout and logs/stderr, respectively. These files are never rotated.</p>
+
+<h2><a href="../yarn/application-master.html">Application Master »</a></h2>
+
+
+ </div>
+ </div>
+ </div>
+ </div>
+ <div class="footer">
+ <div class="page footer-content">
+ <!-- nothing for now. -->
+ </div>
+ </div>
+ </body>
+</html>
\ No newline at end of file
Added: incubator/samza/site/learn/documentation/0.7.0/jobs/packaging.html
URL: http://svn.apache.org/viewvc/incubator/samza/site/learn/documentation/0.7.0/jobs/packaging.html?rev=1509764&view=auto
==============================================================================
--- incubator/samza/site/learn/documentation/0.7.0/jobs/packaging.html (added)
+++ incubator/samza/site/learn/documentation/0.7.0/jobs/packaging.html Fri Aug 2 16:27:50 2013
@@ -0,0 +1,104 @@
+<html>
+ <head>
+ <title>Samza - Packaging</title>
+ <link href="/css/main.css" rel="stylesheet"/>
+ <link href='http://fonts.googleapis.com/css?family=Ropa+Sans' rel='stylesheet' type='text/css'/>
+ <link href="http://netdna.bootstrapcdn.com/font-awesome/3.1.1/css/font-awesome.css" rel="stylesheet"/>
+ <link rel="icon" type="image/png" href="/img/samza-icon.png">
+ </head>
+ <body>
+ <div class="container">
+ <div class="container-inner">
+ <div class="header">
+ <div class="page">
+ <div class="logo">
+ <a href="/" class="logo">samza</a>
+ </div>
+ <div class="top-icons">
+ <a href="/startup/download"><i class="icon-download top-icon"></i></a>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank"><i class="icon-code top-icon" style="font-weight: bold;"></i></a>
+ <a href="https://twitter.com/samzastream" target="_blank"><i class="icon-twitter top-icon"></i></a>
+ </div>
+ </div>
+ </div>
+
+ <div class="page">
+ <!-- menu -->
+ <div class="menu">
+ <div class="menu-inner">
+ <div class="menu-title"><i class="icon-rocket"></i> Getting Started</div>
+ <div class="menu-category">
+ <a href="/startup/hello-samza/0.7.0">Hello Samza</a><br/>
+ <a href="/startup/download">Download</a><br/>
+ </div>
+ <div class="menu-title"><i class="icon-book"></i> Learn</div>
+ <div class="menu-category">
+ <a href="/learn/documentation/0.7.0">Documentation</a><br/>
+ <a href="/learn/tutorials/0.7.0">Tutorials</a><br/>
+ FAQ<br/>
+ <!-- TODO add links to apache when we get them -->
+ Wiki<br/>
+ Papers & Talks<br/>
+ </div>
+ <div class="menu-title"><i class="icon-comments"></i> Community</div>
+ <div class="menu-category">
+ <a href="/community/mailing-lists.html">Mailing Lists</a><br/>
+ <a href="/community/irc.html">IRC</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Bugs<br/>
+ Powered by<br/>
+ Ecosystem<br/>
+ <a href="/community/committers.html">Committers</a>
+ </div>
+ <div class="menu-title"><i class="icon-code"></i> Contribute</div>
+ <div class="menu-category">
+ <a href="/contribute/rules.html">Rules</a><br/>
+ <a href="/contribute/coding-guide.html">Coding Guide</a><br/>
+ <a href="/contribute/projects.html">Projects</a><br/>
+ <a href="/contribute/seps.html">SEPs</a><br/>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank">Code</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Unit Tests<br/>
+ <a href="/contribute/disclaimer.html">Disclaimer</a>
+ </div>
+ </div>
+ </div>
+ <!-- body -->
+ <div class="body">
+ <h2>Packaging</h2>
+
+<p>The <a href="job-runner.html">JobRunner</a> page talks about run-job.sh, and how it's used to start a job either locally (LocalJobFactory) or with YARN (YarnJobFactory). In the diagram that shows the execution flow, it also shows a run-task.sh script. This script, along with a run-am.sh script, are what Samza actually calls to execute its code.</p>
+<div class="highlight"><pre><code class="text language-text" data-lang="text">bin/run-am.sh
+bin/run-task.sh
+</code></pre></div>
+<p>The run-task.sh script is responsible for starting the TaskRunner. The run-am.sh script is responsible for starting Samza's application master for YARN. Thus, the run-am.sh script is only used by the YarnJob, but both YarnJob and ProcessJob use run-task.sh.</p>
+
+<p>Typically, these two scripts are bundled into a tar.gz file that has a structure like this:</p>
+<div class="highlight"><pre><code class="text language-text" data-lang="text">bin/run-am.sh
+bin/run-class.sh
+bin/run-job.sh
+bin/run-task.sh
+lib/*.jar
+</code></pre></div>
+<p>To run a Samza job, you un-zip its tar.gz file, and execute the run-job.sh script, as defined in the JobRunner section. There are a number of interesting implications from this packaging scheme. First, you'll notice that there is no configuration in the package. Second, you'll notice that the lib directory contains all JARs that you'll need to run your Samza job.</p>
+
+<p>The reason that configuration is decoupled from your Samza job packaging is that it allows configuration to be updated without having to re-build the entire Samza package. This makes life easier for everyone when you just need to tweak one parameter, and don't want to have to worry about which branch your package was built from, or whether trunk is in a stable state. It also has the added benefit of forcing configuration to be fully resolved at runtime. This means that that the configuration for a job is resolved at the time run-job.sh is called (using --config-path and --config-provider parameters), and from that point on, the configuration is immutable, and passed where it needs to be by Samza (and YARN, if you're using it).</p>
+
+<p>The second statement, that your Samza package contains all JARs that it needs to run, means that a Samza package is entirely self contained. This allows Samza jobs to run on independent Samza versions without conflicting with each other. This is in contrast to Hadoop, where JARs are pulled in from the local machine that the job is running on (using environment variables). With Samza, you might run your job on version 0.7.0, and someone else might run their job on version 0.8.0. There is no problem with this.</p>
+
+<h2><a href="yarn-jobs.html">YARN Jobs »</a></h2>
+
+
+ </div>
+ </div>
+ </div>
+ </div>
+ <div class="footer">
+ <div class="page footer-content">
+ <!-- nothing for now. -->
+ </div>
+ </div>
+ </body>
+</html>
\ No newline at end of file
Added: incubator/samza/site/learn/documentation/0.7.0/jobs/yarn-jobs.html
URL: http://svn.apache.org/viewvc/incubator/samza/site/learn/documentation/0.7.0/jobs/yarn-jobs.html?rev=1509764&view=auto
==============================================================================
--- incubator/samza/site/learn/documentation/0.7.0/jobs/yarn-jobs.html (added)
+++ incubator/samza/site/learn/documentation/0.7.0/jobs/yarn-jobs.html Fri Aug 2 16:27:50 2013
@@ -0,0 +1,92 @@
+<html>
+ <head>
+ <title>Samza - YARN Jobs</title>
+ <link href="/css/main.css" rel="stylesheet"/>
+ <link href='http://fonts.googleapis.com/css?family=Ropa+Sans' rel='stylesheet' type='text/css'/>
+ <link href="http://netdna.bootstrapcdn.com/font-awesome/3.1.1/css/font-awesome.css" rel="stylesheet"/>
+ <link rel="icon" type="image/png" href="/img/samza-icon.png">
+ </head>
+ <body>
+ <div class="container">
+ <div class="container-inner">
+ <div class="header">
+ <div class="page">
+ <div class="logo">
+ <a href="/" class="logo">samza</a>
+ </div>
+ <div class="top-icons">
+ <a href="/startup/download"><i class="icon-download top-icon"></i></a>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank"><i class="icon-code top-icon" style="font-weight: bold;"></i></a>
+ <a href="https://twitter.com/samzastream" target="_blank"><i class="icon-twitter top-icon"></i></a>
+ </div>
+ </div>
+ </div>
+
+ <div class="page">
+ <!-- menu -->
+ <div class="menu">
+ <div class="menu-inner">
+ <div class="menu-title"><i class="icon-rocket"></i> Getting Started</div>
+ <div class="menu-category">
+ <a href="/startup/hello-samza/0.7.0">Hello Samza</a><br/>
+ <a href="/startup/download">Download</a><br/>
+ </div>
+ <div class="menu-title"><i class="icon-book"></i> Learn</div>
+ <div class="menu-category">
+ <a href="/learn/documentation/0.7.0">Documentation</a><br/>
+ <a href="/learn/tutorials/0.7.0">Tutorials</a><br/>
+ FAQ<br/>
+ <!-- TODO add links to apache when we get them -->
+ Wiki<br/>
+ Papers & Talks<br/>
+ </div>
+ <div class="menu-title"><i class="icon-comments"></i> Community</div>
+ <div class="menu-category">
+ <a href="/community/mailing-lists.html">Mailing Lists</a><br/>
+ <a href="/community/irc.html">IRC</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Bugs<br/>
+ Powered by<br/>
+ Ecosystem<br/>
+ <a href="/community/committers.html">Committers</a>
+ </div>
+ <div class="menu-title"><i class="icon-code"></i> Contribute</div>
+ <div class="menu-category">
+ <a href="/contribute/rules.html">Rules</a><br/>
+ <a href="/contribute/coding-guide.html">Coding Guide</a><br/>
+ <a href="/contribute/projects.html">Projects</a><br/>
+ <a href="/contribute/seps.html">SEPs</a><br/>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank">Code</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Unit Tests<br/>
+ <a href="/contribute/disclaimer.html">Disclaimer</a>
+ </div>
+ </div>
+ </div>
+ <!-- body -->
+ <div class="body">
+ <h2>YARN Jobs</h2>
+
+<p>When you define job.factory.class=samza.job.yarn.YarnJobFactory in your job's configuration, Samza will use YARN to execute your job. The YarnJobFactory will use the YARN_HOME environment variable on the machine that run-job.sh is executed on to get the appropriate YARN configuration, which will define where the YARN resource manager is. The YarnJob will work with the resource manager to get your job started on the YARN cluster.</p>
+
+<p>If you want to use YARN to run your Samza job, you'll also need to define the location of your Samza job's package. For example, you might say:</p>
+<div class="highlight"><pre><code class="text language-text" data-lang="text">yarn.package.path=http://my.http.server/jobs/ingraphs-package-0.0.55.tgz
+</code></pre></div>
+<p>This .tgz file follows the conventions outlined on the <a href="packaging.html">Packaging</a> page (it has bin/run-am.sh and bin/run-task.sh). YARN NodeManagers will take responsibility for downloading this .tgz file on the appropriate machines, and untar'ing them. From there, YARN will execute run-am.sh or run-task.sh for the Samza Application Master, and TaskRunner, respectively.</p>
+
+<h2><a href="logging.html">Logging »</a></h2>
+
+
+ </div>
+ </div>
+ </div>
+ </div>
+ <div class="footer">
+ <div class="page footer-content">
+ <!-- nothing for now. -->
+ </div>
+ </div>
+ </body>
+</html>
\ No newline at end of file
Added: incubator/samza/site/learn/documentation/0.7.0/operations/kafka.html
URL: http://svn.apache.org/viewvc/incubator/samza/site/learn/documentation/0.7.0/operations/kafka.html?rev=1509764&view=auto
==============================================================================
--- incubator/samza/site/learn/documentation/0.7.0/operations/kafka.html (added)
+++ incubator/samza/site/learn/documentation/0.7.0/operations/kafka.html Fri Aug 2 16:27:50 2013
@@ -0,0 +1,94 @@
+<html>
+ <head>
+ <title>Samza - Kafka</title>
+ <link href="/css/main.css" rel="stylesheet"/>
+ <link href='http://fonts.googleapis.com/css?family=Ropa+Sans' rel='stylesheet' type='text/css'/>
+ <link href="http://netdna.bootstrapcdn.com/font-awesome/3.1.1/css/font-awesome.css" rel="stylesheet"/>
+ <link rel="icon" type="image/png" href="/img/samza-icon.png">
+ </head>
+ <body>
+ <div class="container">
+ <div class="container-inner">
+ <div class="header">
+ <div class="page">
+ <div class="logo">
+ <a href="/" class="logo">samza</a>
+ </div>
+ <div class="top-icons">
+ <a href="/startup/download"><i class="icon-download top-icon"></i></a>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank"><i class="icon-code top-icon" style="font-weight: bold;"></i></a>
+ <a href="https://twitter.com/samzastream" target="_blank"><i class="icon-twitter top-icon"></i></a>
+ </div>
+ </div>
+ </div>
+
+ <div class="page">
+ <!-- menu -->
+ <div class="menu">
+ <div class="menu-inner">
+ <div class="menu-title"><i class="icon-rocket"></i> Getting Started</div>
+ <div class="menu-category">
+ <a href="/startup/hello-samza/0.7.0">Hello Samza</a><br/>
+ <a href="/startup/download">Download</a><br/>
+ </div>
+ <div class="menu-title"><i class="icon-book"></i> Learn</div>
+ <div class="menu-category">
+ <a href="/learn/documentation/0.7.0">Documentation</a><br/>
+ <a href="/learn/tutorials/0.7.0">Tutorials</a><br/>
+ FAQ<br/>
+ <!-- TODO add links to apache when we get them -->
+ Wiki<br/>
+ Papers & Talks<br/>
+ </div>
+ <div class="menu-title"><i class="icon-comments"></i> Community</div>
+ <div class="menu-category">
+ <a href="/community/mailing-lists.html">Mailing Lists</a><br/>
+ <a href="/community/irc.html">IRC</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Bugs<br/>
+ Powered by<br/>
+ Ecosystem<br/>
+ <a href="/community/committers.html">Committers</a>
+ </div>
+ <div class="menu-title"><i class="icon-code"></i> Contribute</div>
+ <div class="menu-category">
+ <a href="/contribute/rules.html">Rules</a><br/>
+ <a href="/contribute/coding-guide.html">Coding Guide</a><br/>
+ <a href="/contribute/projects.html">Projects</a><br/>
+ <a href="/contribute/seps.html">SEPs</a><br/>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank">Code</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Unit Tests<br/>
+ <a href="/contribute/disclaimer.html">Disclaimer</a>
+ </div>
+ </div>
+ </div>
+ <!-- body -->
+ <div class="body">
+ <h2>Kafka</h2>
+
+<!-- TODO kafka page should be fleshed out a bit -->
+
+<!-- TODO when 0.8.1 is released, update with state management config information -->
+
+<p>Kafka has a great <a href="http://kafka.apache.org/08/ops.html">operations wiki</a>, which provides some detail on how to operate Kafka at scale.</p>
+
+<h3>Auto-Create Topics</h3>
+
+<p>Kafka brokers should be configured to automatically create topics. Without this, it's going to be very cumbersome to run Samze jobs, since jobs will write to arbitrary (and sometimes new) topics.</p>
+<div class="highlight"><pre><code class="text language-text" data-lang="text">auto.create.topics.enable=true
+</code></pre></div>
+
+ </div>
+ </div>
+ </div>
+ </div>
+ <div class="footer">
+ <div class="page footer-content">
+ <!-- nothing for now. -->
+ </div>
+ </div>
+ </body>
+</html>
\ No newline at end of file
Added: incubator/samza/site/learn/documentation/0.7.0/operations/security.html
URL: http://svn.apache.org/viewvc/incubator/samza/site/learn/documentation/0.7.0/operations/security.html?rev=1509764&view=auto
==============================================================================
--- incubator/samza/site/learn/documentation/0.7.0/operations/security.html (added)
+++ incubator/samza/site/learn/documentation/0.7.0/operations/security.html Fri Aug 2 16:27:50 2013
@@ -0,0 +1,137 @@
+<html>
+ <head>
+ <title>Samza - Security</title>
+ <link href="/css/main.css" rel="stylesheet"/>
+ <link href='http://fonts.googleapis.com/css?family=Ropa+Sans' rel='stylesheet' type='text/css'/>
+ <link href="http://netdna.bootstrapcdn.com/font-awesome/3.1.1/css/font-awesome.css" rel="stylesheet"/>
+ <link rel="icon" type="image/png" href="/img/samza-icon.png">
+ </head>
+ <body>
+ <div class="container">
+ <div class="container-inner">
+ <div class="header">
+ <div class="page">
+ <div class="logo">
+ <a href="/" class="logo">samza</a>
+ </div>
+ <div class="top-icons">
+ <a href="/startup/download"><i class="icon-download top-icon"></i></a>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank"><i class="icon-code top-icon" style="font-weight: bold;"></i></a>
+ <a href="https://twitter.com/samzastream" target="_blank"><i class="icon-twitter top-icon"></i></a>
+ </div>
+ </div>
+ </div>
+
+ <div class="page">
+ <!-- menu -->
+ <div class="menu">
+ <div class="menu-inner">
+ <div class="menu-title"><i class="icon-rocket"></i> Getting Started</div>
+ <div class="menu-category">
+ <a href="/startup/hello-samza/0.7.0">Hello Samza</a><br/>
+ <a href="/startup/download">Download</a><br/>
+ </div>
+ <div class="menu-title"><i class="icon-book"></i> Learn</div>
+ <div class="menu-category">
+ <a href="/learn/documentation/0.7.0">Documentation</a><br/>
+ <a href="/learn/tutorials/0.7.0">Tutorials</a><br/>
+ FAQ<br/>
+ <!-- TODO add links to apache when we get them -->
+ Wiki<br/>
+ Papers & Talks<br/>
+ </div>
+ <div class="menu-title"><i class="icon-comments"></i> Community</div>
+ <div class="menu-category">
+ <a href="/community/mailing-lists.html">Mailing Lists</a><br/>
+ <a href="/community/irc.html">IRC</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Bugs<br/>
+ Powered by<br/>
+ Ecosystem<br/>
+ <a href="/community/committers.html">Committers</a>
+ </div>
+ <div class="menu-title"><i class="icon-code"></i> Contribute</div>
+ <div class="menu-category">
+ <a href="/contribute/rules.html">Rules</a><br/>
+ <a href="/contribute/coding-guide.html">Coding Guide</a><br/>
+ <a href="/contribute/projects.html">Projects</a><br/>
+ <a href="/contribute/seps.html">SEPs</a><br/>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank">Code</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Unit Tests<br/>
+ <a href="/contribute/disclaimer.html">Disclaimer</a>
+ </div>
+ </div>
+ </div>
+ <!-- body -->
+ <div class="body">
+ <h2>Security</h2>
+
+<p>Samza provides no security. All security is implemented in the stream system, or in the environment that Samza containers run.</p>
+
+<h3>Securing Streaming Systems</h3>
+
+<p>Samza does not provide any security at the stream system level. It is up to individual streaming systems to enforce their own security. If a stream system requires usernames and passwords in order to consume from specific streams, these values must be supplied via configuration, and used at the StreamConsumer/StreamConsumerFactory implementation. The same holds true if the streaming system uses SSL certificates or Kerberos. The environment in which Samza runs must provide the appropriate certificate or Kerberos ticket, and the StreamConsumer must be implemented to use these certificates or tickets.</p>
+
+<h4>Securing Kafka</h4>
+
+<p>Kafka provides no security for its topics, and therefore Samza doesn't provide any security when using Kafka topics.</p>
+
+<h3>Securing Samza's Environment</h3>
+
+<p>The most important thing to keep in mind when securing an environment that Samza containers run in is that <strong>Samza containers execute arbitrary user code</strong>. They must considered an adversarial application, and the environment must be locked down accordingly.</p>
+
+<h4>Configuration</h4>
+
+<p>Samza reads all configuration at the time a Samza job is started using the run-job.sh script. If configuration contains sensitive information, then care must be taken to provide the JobRunner with the configuration. This means implementing a ConfigFactory that understands the configuration security model, and resolves configuration to Samza's Config object in a secure way.</p>
+
+<p>During the duration of a Samza job's execution, the configuration is kept in memory. The only time configuration is visible is:</p>
+
+<ol>
+<li>When configuration is resolved using a ConfigFactory.</li>
+<li>The configuration is printed to STDOUT when run-job.sh is run.</li>
+<li>The configuration is written to the logs when a Samza container starts.</li>
+</ol>
+
+<p>If configuration contains sensitive data, then these three points must be secured.</p>
+
+<h4>Ports</h4>
+
+<p>The only port that a Samza container opens by default is an un-secured JMX port that is randomly selected at start time. If this is not desired, JMX can be disabled through configuration. See the <a href="configuration.html">Configuration</a> page for details.</p>
+
+<p>Users might open ports from inside a Samza container. If this is not desired, then the user that executes the Samza container must have the appropriate permissions revoked, usually using iptables.</p>
+
+<h4>Logs</h4>
+
+<p>Samza container logs contain configuration, and might contain arbitrary sensitive data logged by the user. A secure log directory must be provided to the Samza container.</p>
+
+<h4>Starting a Samza Job</h4>
+
+<p>If operators do not wish to allow Samza containers to be executed by arbitrary users, then the mechanism that Samza containers are deployed must secured. Usually, this means controlling execution of the run-job.sh script. The recommended pattern is to lock down the machines that Samza containers run on, and execute run-job.sh from either a blessed web service or special machine, and only allow access to the service or machine by specific users.</p>
+
+<h4>Shell Scripts</h4>
+
+<p>Please see the <a href="packaging.html">Packaging</a> section for details on the the shell scripts that Samza uses. Samza containers allow users to execute arbitrary shell commands, so user permissions must be locked down to prevent users from damaging the environment or reading sensitive data.</p>
+
+<h4>YARN</h4>
+
+<!-- TODO make the security page link to the actual YARN security document, when we write it. -->
+
+<p>Samza provides out-of-the-box YARN integration. Take a look at Samza's YARN Security page for details.</p>
+
+<h2><a href="kafka.html">Kafka »</a></h2>
+
+
+ </div>
+ </div>
+ </div>
+ </div>
+ <div class="footer">
+ <div class="page footer-content">
+ <!-- nothing for now. -->
+ </div>
+ </div>
+ </body>
+</html>
\ No newline at end of file
Added: incubator/samza/site/learn/documentation/0.7.0/yarn/application-master.html
URL: http://svn.apache.org/viewvc/incubator/samza/site/learn/documentation/0.7.0/yarn/application-master.html?rev=1509764&view=auto
==============================================================================
--- incubator/samza/site/learn/documentation/0.7.0/yarn/application-master.html (added)
+++ incubator/samza/site/learn/documentation/0.7.0/yarn/application-master.html Fri Aug 2 16:27:50 2013
@@ -0,0 +1,136 @@
+<html>
+ <head>
+ <title>Samza - Application Master</title>
+ <link href="/css/main.css" rel="stylesheet"/>
+ <link href='http://fonts.googleapis.com/css?family=Ropa+Sans' rel='stylesheet' type='text/css'/>
+ <link href="http://netdna.bootstrapcdn.com/font-awesome/3.1.1/css/font-awesome.css" rel="stylesheet"/>
+ <link rel="icon" type="image/png" href="/img/samza-icon.png">
+ </head>
+ <body>
+ <div class="container">
+ <div class="container-inner">
+ <div class="header">
+ <div class="page">
+ <div class="logo">
+ <a href="/" class="logo">samza</a>
+ </div>
+ <div class="top-icons">
+ <a href="/startup/download"><i class="icon-download top-icon"></i></a>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank"><i class="icon-code top-icon" style="font-weight: bold;"></i></a>
+ <a href="https://twitter.com/samzastream" target="_blank"><i class="icon-twitter top-icon"></i></a>
+ </div>
+ </div>
+ </div>
+
+ <div class="page">
+ <!-- menu -->
+ <div class="menu">
+ <div class="menu-inner">
+ <div class="menu-title"><i class="icon-rocket"></i> Getting Started</div>
+ <div class="menu-category">
+ <a href="/startup/hello-samza/0.7.0">Hello Samza</a><br/>
+ <a href="/startup/download">Download</a><br/>
+ </div>
+ <div class="menu-title"><i class="icon-book"></i> Learn</div>
+ <div class="menu-category">
+ <a href="/learn/documentation/0.7.0">Documentation</a><br/>
+ <a href="/learn/tutorials/0.7.0">Tutorials</a><br/>
+ FAQ<br/>
+ <!-- TODO add links to apache when we get them -->
+ Wiki<br/>
+ Papers & Talks<br/>
+ </div>
+ <div class="menu-title"><i class="icon-comments"></i> Community</div>
+ <div class="menu-category">
+ <a href="/community/mailing-lists.html">Mailing Lists</a><br/>
+ <a href="/community/irc.html">IRC</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Bugs<br/>
+ Powered by<br/>
+ Ecosystem<br/>
+ <a href="/community/committers.html">Committers</a>
+ </div>
+ <div class="menu-title"><i class="icon-code"></i> Contribute</div>
+ <div class="menu-category">
+ <a href="/contribute/rules.html">Rules</a><br/>
+ <a href="/contribute/coding-guide.html">Coding Guide</a><br/>
+ <a href="/contribute/projects.html">Projects</a><br/>
+ <a href="/contribute/seps.html">SEPs</a><br/>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank">Code</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Unit Tests<br/>
+ <a href="/contribute/disclaimer.html">Disclaimer</a>
+ </div>
+ </div>
+ </div>
+ <!-- body -->
+ <div class="body">
+ <h2>Application Master</h2>
+
+<p>YARN is Hadoop's next-generation cluster manager. It allows developers to deploy and execute arbitrary commands on a grid. If you're unfamiliar with YARN, or the concept of an ApplicationMaster (AM), please read Hadoop's <a href="http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/YARN.html">YARN</a> page.</p>
+
+<h3>Integration</h3>
+
+<p>Samza's main integration with YARN comes in the form of a Samza ApplicationMaster. This is the chunk of code responsible for managing a Samza job in a YARN grid. It decides what to do when a stream processor fails, which machines a Samza job's <a href="../container/task-runner.html">TaskRunner</a> should run on, and so on.</p>
+
+<p>When the Samza ApplicationMaster starts up, it does the following:</p>
+
+<ol>
+<li>Receives configuration from YARN via the STREAMING_CONFIG environment variable.</li>
+<li>Starts a JMX server on a random port.</li>
+<li>Instantiates a metrics registry and reporters to keep track of relevant metrics.</li>
+<li>Registers the AM with YARN's RM.</li>
+<li>Get the total number of partitions for the Samza job using each input stream's PartitionManager (see the <a href="../container/streams.html">Streams</a> page for details).</li>
+<li>Read the total number of containers requested from the Samza job's configuration.</li>
+<li>Assign each partition to a container (called a Task Group in Samza's AM dashboard).</li>
+<li>Make a <a href="http://hadoop.apache.org/docs/current/api/org/apache/hadoop/yarn/api/records/ResourceRequest.html">ResourceRequest</a> to YARN for each container.</li>
+<li>Poll the YARN RM every second to check for allocated and released containers.</li>
+</ol>
+
+<p>From this point on, the ApplicationMaster just reacts to events from the RM.</p>
+
+<h3>Fault Tolerance</h3>
+
+<p>Whenever a container is allocated, the AM will work with the YARN NM to start a TaskRunner (with appropriate partitions assigned to it) in the container. If a container fails with a non-zero return code, the AM will request a new container, and restart the TaskRunner. If a TaskRunner fails too many times, too quickly, the ApplicationMaster will fail the whole Samza job with a non-zero return code. See the yarn.countainer.retry.count and yarn.container.retry.window.ms <a href="../jobs/configuration.html">configuration</a> parameters for details.</p>
+
+<p>When the AM receives a reboot signal from YARN, it will throw a SamzaException. This will trigger a clean and successful shutdown of the AM (YARN won't think the AM failed).</p>
+
+<p>If the AM, itself, fails, YARN will handle restarting the AM. When the AM is restarted, all containers that were running will be killed, and the AM will start from scratch. The same list of operations, shown above, will be executed. The AM will request new containers for its TaskRunners, and proceed as though it has just started for the first time. YARN has a yarn.resourcemanager.am.max-retries configuration parameter that's defined in <a href="http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-common/yarn-default.xml">yarn-site.xml</a>. This configuration defaults to 1, which means that, by default, a single AM failure will cause your Samza job to stop running.</p>
+
+<h3>Dashboard</h3>
+
+<p>Samza's ApplicationMaster comes with a dashboard to show useful information such as:</p>
+
+<ol>
+<li>Where containers are located.</li>
+<li>Links to logs.</li>
+<li>The Samza job's configuration.</li>
+<li>Container failure count.</li>
+</ol>
+
+<p>You can find this dashboard by going to your YARN grid's ResourceManager page (usually something like <a href="http://localhost:8088/cluster">http://localhost:8088/cluster</a>), and clicking on the "ApplicationMaster" link of a running Samza job.</p>
+
+<p><img src="/img/0.7.0/learn/documentation/yarn/samza-am-dashboard.png" alt="diagram"></p>
+
+<h3>Security</h3>
+
+<p>The Samza dashboard's HTTP access is currently un-secured, even when using YARN in secure-mode. This means that users with access to a YARN grid could port-scan a Samza ApplicationMaster's HTTP server, and open the dashboard in a browser to view its contents. Sensitive configuration can be viewed by anyone, in this way, and care should be taken. There are plans to secure Samza's ApplicationMaster using <a href="http://docs.hortonworks.com/HDPDocuments/HDP1/HDP-1.3.0/bk_installing_manually_book/content/rpm-chap14-2-3-1.html">Hadoop's security</a> features (<a href="http://en.wikipedia.org/wiki/SPNEGO">SPENAGO</a>).</p>
+
+<p>See Samza's <a href="../operations/security.html">security</a> page for more details.</p>
+
+<h2><a href="isolation.html">Isolation »</a></h2>
+
+
+ </div>
+ </div>
+ </div>
+ </div>
+ <div class="footer">
+ <div class="page footer-content">
+ <!-- nothing for now. -->
+ </div>
+ </div>
+ </body>
+</html>
\ No newline at end of file
Added: incubator/samza/site/learn/documentation/0.7.0/yarn/isolation.html
URL: http://svn.apache.org/viewvc/incubator/samza/site/learn/documentation/0.7.0/yarn/isolation.html?rev=1509764&view=auto
==============================================================================
--- incubator/samza/site/learn/documentation/0.7.0/yarn/isolation.html (added)
+++ incubator/samza/site/learn/documentation/0.7.0/yarn/isolation.html Fri Aug 2 16:27:50 2013
@@ -0,0 +1,109 @@
+<html>
+ <head>
+ <title>Samza - Isolation</title>
+ <link href="/css/main.css" rel="stylesheet"/>
+ <link href='http://fonts.googleapis.com/css?family=Ropa+Sans' rel='stylesheet' type='text/css'/>
+ <link href="http://netdna.bootstrapcdn.com/font-awesome/3.1.1/css/font-awesome.css" rel="stylesheet"/>
+ <link rel="icon" type="image/png" href="/img/samza-icon.png">
+ </head>
+ <body>
+ <div class="container">
+ <div class="container-inner">
+ <div class="header">
+ <div class="page">
+ <div class="logo">
+ <a href="/" class="logo">samza</a>
+ </div>
+ <div class="top-icons">
+ <a href="/startup/download"><i class="icon-download top-icon"></i></a>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank"><i class="icon-code top-icon" style="font-weight: bold;"></i></a>
+ <a href="https://twitter.com/samzastream" target="_blank"><i class="icon-twitter top-icon"></i></a>
+ </div>
+ </div>
+ </div>
+
+ <div class="page">
+ <!-- menu -->
+ <div class="menu">
+ <div class="menu-inner">
+ <div class="menu-title"><i class="icon-rocket"></i> Getting Started</div>
+ <div class="menu-category">
+ <a href="/startup/hello-samza/0.7.0">Hello Samza</a><br/>
+ <a href="/startup/download">Download</a><br/>
+ </div>
+ <div class="menu-title"><i class="icon-book"></i> Learn</div>
+ <div class="menu-category">
+ <a href="/learn/documentation/0.7.0">Documentation</a><br/>
+ <a href="/learn/tutorials/0.7.0">Tutorials</a><br/>
+ FAQ<br/>
+ <!-- TODO add links to apache when we get them -->
+ Wiki<br/>
+ Papers & Talks<br/>
+ </div>
+ <div class="menu-title"><i class="icon-comments"></i> Community</div>
+ <div class="menu-category">
+ <a href="/community/mailing-lists.html">Mailing Lists</a><br/>
+ <a href="/community/irc.html">IRC</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Bugs<br/>
+ Powered by<br/>
+ Ecosystem<br/>
+ <a href="/community/committers.html">Committers</a>
+ </div>
+ <div class="menu-title"><i class="icon-code"></i> Contribute</div>
+ <div class="menu-category">
+ <a href="/contribute/rules.html">Rules</a><br/>
+ <a href="/contribute/coding-guide.html">Coding Guide</a><br/>
+ <a href="/contribute/projects.html">Projects</a><br/>
+ <a href="/contribute/seps.html">SEPs</a><br/>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank">Code</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Unit Tests<br/>
+ <a href="/contribute/disclaimer.html">Disclaimer</a>
+ </div>
+ </div>
+ </div>
+ <!-- body -->
+ <div class="body">
+ <h2>Isolation</h2>
+
+<p>When running Samza jobs in a shared, distributed environment, the stream processors can have an impact on one another's performance. A stream processor that uses 100% of a machine's CPU will slow down all other stream processors on the machine.</p>
+
+<p>One of <a href="http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/YARN.html">YARN</a>'s responsibilities is to manage resources so that this doesn't happen. Each of YARN's Node Managers (NM) has a chunk of "resources" dedicated to it. The YARN Resource Manager (RM) will only allow a container to be allocated on a NM if it has enough resources to satisfy the container's needs.</p>
+
+<p>YARN currently supports resource management for memory and CPU.</p>
+
+<h3>Memory</h3>
+
+<p>YARN will automatically enforce memory limits for all containers that it executes. All containers must have a max-memory size defined when they're created. If the sum of all memory usage for processes associated with a single YARN container exceeds this maximum, YARN will kill the container.</p>
+
+<p>Samza supports memory limits using the yarn.container.memory.mb and yarn.am.container.memory.mb configuration parameters. Keep in mind that this is simply the amount of memory YARN will allow a Samza <a href="../container/task-runner.html">TaskRunner</a> or <a href="application-master.html">ApplicationMaster</a> to have. You'll still need to configure your heap settings appropriately using task.opts, when using Java (the default is -Xmx160M). See the <a href="../jobs/configuration.html">Configuration</a> and <a href="../jobs/packaging.html">Packaging</a> pages for details.</p>
+
+<h3>CPU</h3>
+
+<p>YARN has the concept of a virtual core. Each NM is assigned a total number of virtual cores (32, by default). When a container request is made, it must specify how many virtual cores it needs. The YARN RM will only assign the container to a NM that has enough virtual cores to satisfy the request.</p>
+
+<h4>CGroups</h4>
+
+<p>Unlike memory, which YARN can enforce itself (by looking at the /proc folder), YARN can't enforce CPU isolation, since this must be done at the Linux kernel level. One of YARN's interesting new features is its support for Linux <a href="https://www.kernel.org/doc/Documentation/cgroups/cgroups.txt">CGroups</a>. CGroups are a way to control process utilization at the kernel level in Linux.</p>
+
+<p>If YARN is setup to use CGroups, then YARN will guarantee that a container will get at least the amount of CPU that it requires. Currently, YARN will give you more CPU, if it's available. For details on enforcing "at most" CPU usage, see <a href="https://issues.apache.org/jira/browse/YARN-810">YARN-810</a>. </p>
+
+<p>See <a href="http://riccomini.name/posts/hadoop/2013-06-14-yarn-with-cgroups/">this blog post</a> for details on setting up YARN with CGroups.</p>
+
+<h2><a href="../operations/security.html">Security »</a></h2>
+
+
+ </div>
+ </div>
+ </div>
+ </div>
+ <div class="footer">
+ <div class="page footer-content">
+ <!-- nothing for now. -->
+ </div>
+ </div>
+ </body>
+</html>
\ No newline at end of file
Added: incubator/samza/site/learn/tutorials/0.7.0/committing.html
URL: http://svn.apache.org/viewvc/incubator/samza/site/learn/tutorials/0.7.0/committing.html?rev=1509764&view=auto
==============================================================================
--- incubator/samza/site/learn/tutorials/0.7.0/committing.html (added)
+++ incubator/samza/site/learn/tutorials/0.7.0/committing.html Fri Aug 2 16:27:50 2013
@@ -0,0 +1,85 @@
+<html>
+ <head>
+ <title>Samza - Committing</title>
+ <link href="/css/main.css" rel="stylesheet"/>
+ <link href='http://fonts.googleapis.com/css?family=Ropa+Sans' rel='stylesheet' type='text/css'/>
+ <link href="http://netdna.bootstrapcdn.com/font-awesome/3.1.1/css/font-awesome.css" rel="stylesheet"/>
+ <link rel="icon" type="image/png" href="/img/samza-icon.png">
+ </head>
+ <body>
+ <div class="container">
+ <div class="container-inner">
+ <div class="header">
+ <div class="page">
+ <div class="logo">
+ <a href="/" class="logo">samza</a>
+ </div>
+ <div class="top-icons">
+ <a href="/startup/download"><i class="icon-download top-icon"></i></a>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank"><i class="icon-code top-icon" style="font-weight: bold;"></i></a>
+ <a href="https://twitter.com/samzastream" target="_blank"><i class="icon-twitter top-icon"></i></a>
+ </div>
+ </div>
+ </div>
+
+ <div class="page">
+ <!-- menu -->
+ <div class="menu">
+ <div class="menu-inner">
+ <div class="menu-title"><i class="icon-rocket"></i> Getting Started</div>
+ <div class="menu-category">
+ <a href="/startup/hello-samza/0.7.0">Hello Samza</a><br/>
+ <a href="/startup/download">Download</a><br/>
+ </div>
+ <div class="menu-title"><i class="icon-book"></i> Learn</div>
+ <div class="menu-category">
+ <a href="/learn/documentation/0.7.0">Documentation</a><br/>
+ <a href="/learn/tutorials/0.7.0">Tutorials</a><br/>
+ FAQ<br/>
+ <!-- TODO add links to apache when we get them -->
+ Wiki<br/>
+ Papers & Talks<br/>
+ </div>
+ <div class="menu-title"><i class="icon-comments"></i> Community</div>
+ <div class="menu-category">
+ <a href="/community/mailing-lists.html">Mailing Lists</a><br/>
+ <a href="/community/irc.html">IRC</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Bugs<br/>
+ Powered by<br/>
+ Ecosystem<br/>
+ <a href="/community/committers.html">Committers</a>
+ </div>
+ <div class="menu-title"><i class="icon-code"></i> Contribute</div>
+ <div class="menu-category">
+ <a href="/contribute/rules.html">Rules</a><br/>
+ <a href="/contribute/coding-guide.html">Coding Guide</a><br/>
+ <a href="/contribute/projects.html">Projects</a><br/>
+ <a href="/contribute/seps.html">SEPs</a><br/>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank">Code</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Unit Tests<br/>
+ <a href="/contribute/disclaimer.html">Disclaimer</a>
+ </div>
+ </div>
+ </div>
+ <!-- body -->
+ <div class="body">
+ <h2>Committing</h2>
+
+<p>haiii</p>
+
+
+ </div>
+ </div>
+ </div>
+ </div>
+ <div class="footer">
+ <div class="page footer-content">
+ <!-- nothing for now. -->
+ </div>
+ </div>
+ </body>
+</html>
\ No newline at end of file
Added: incubator/samza/site/learn/tutorials/0.7.0/configuring-kafka-system.html
URL: http://svn.apache.org/viewvc/incubator/samza/site/learn/tutorials/0.7.0/configuring-kafka-system.html?rev=1509764&view=auto
==============================================================================
--- incubator/samza/site/learn/tutorials/0.7.0/configuring-kafka-system.html (added)
+++ incubator/samza/site/learn/tutorials/0.7.0/configuring-kafka-system.html Fri Aug 2 16:27:50 2013
@@ -0,0 +1,85 @@
+<html>
+ <head>
+ <title>Samza - Configuring a Kafka System</title>
+ <link href="/css/main.css" rel="stylesheet"/>
+ <link href='http://fonts.googleapis.com/css?family=Ropa+Sans' rel='stylesheet' type='text/css'/>
+ <link href="http://netdna.bootstrapcdn.com/font-awesome/3.1.1/css/font-awesome.css" rel="stylesheet"/>
+ <link rel="icon" type="image/png" href="/img/samza-icon.png">
+ </head>
+ <body>
+ <div class="container">
+ <div class="container-inner">
+ <div class="header">
+ <div class="page">
+ <div class="logo">
+ <a href="/" class="logo">samza</a>
+ </div>
+ <div class="top-icons">
+ <a href="/startup/download"><i class="icon-download top-icon"></i></a>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank"><i class="icon-code top-icon" style="font-weight: bold;"></i></a>
+ <a href="https://twitter.com/samzastream" target="_blank"><i class="icon-twitter top-icon"></i></a>
+ </div>
+ </div>
+ </div>
+
+ <div class="page">
+ <!-- menu -->
+ <div class="menu">
+ <div class="menu-inner">
+ <div class="menu-title"><i class="icon-rocket"></i> Getting Started</div>
+ <div class="menu-category">
+ <a href="/startup/hello-samza/0.7.0">Hello Samza</a><br/>
+ <a href="/startup/download">Download</a><br/>
+ </div>
+ <div class="menu-title"><i class="icon-book"></i> Learn</div>
+ <div class="menu-category">
+ <a href="/learn/documentation/0.7.0">Documentation</a><br/>
+ <a href="/learn/tutorials/0.7.0">Tutorials</a><br/>
+ FAQ<br/>
+ <!-- TODO add links to apache when we get them -->
+ Wiki<br/>
+ Papers & Talks<br/>
+ </div>
+ <div class="menu-title"><i class="icon-comments"></i> Community</div>
+ <div class="menu-category">
+ <a href="/community/mailing-lists.html">Mailing Lists</a><br/>
+ <a href="/community/irc.html">IRC</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Bugs<br/>
+ Powered by<br/>
+ Ecosystem<br/>
+ <a href="/community/committers.html">Committers</a>
+ </div>
+ <div class="menu-title"><i class="icon-code"></i> Contribute</div>
+ <div class="menu-category">
+ <a href="/contribute/rules.html">Rules</a><br/>
+ <a href="/contribute/coding-guide.html">Coding Guide</a><br/>
+ <a href="/contribute/projects.html">Projects</a><br/>
+ <a href="/contribute/seps.html">SEPs</a><br/>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank">Code</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Unit Tests<br/>
+ <a href="/contribute/disclaimer.html">Disclaimer</a>
+ </div>
+ </div>
+ </div>
+ <!-- body -->
+ <div class="body">
+ <h2>Configuring a Kafka System</h2>
+
+<p>haiii</p>
+
+
+ </div>
+ </div>
+ </div>
+ </div>
+ <div class="footer">
+ <div class="page footer-content">
+ <!-- nothing for now. -->
+ </div>
+ </div>
+ </body>
+</html>
\ No newline at end of file
Added: incubator/samza/site/learn/tutorials/0.7.0/group-by-count.html
URL: http://svn.apache.org/viewvc/incubator/samza/site/learn/tutorials/0.7.0/group-by-count.html?rev=1509764&view=auto
==============================================================================
--- incubator/samza/site/learn/tutorials/0.7.0/group-by-count.html (added)
+++ incubator/samza/site/learn/tutorials/0.7.0/group-by-count.html Fri Aug 2 16:27:50 2013
@@ -0,0 +1,85 @@
+<html>
+ <head>
+ <title>Samza - Group-by and Counting</title>
+ <link href="/css/main.css" rel="stylesheet"/>
+ <link href='http://fonts.googleapis.com/css?family=Ropa+Sans' rel='stylesheet' type='text/css'/>
+ <link href="http://netdna.bootstrapcdn.com/font-awesome/3.1.1/css/font-awesome.css" rel="stylesheet"/>
+ <link rel="icon" type="image/png" href="/img/samza-icon.png">
+ </head>
+ <body>
+ <div class="container">
+ <div class="container-inner">
+ <div class="header">
+ <div class="page">
+ <div class="logo">
+ <a href="/" class="logo">samza</a>
+ </div>
+ <div class="top-icons">
+ <a href="/startup/download"><i class="icon-download top-icon"></i></a>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank"><i class="icon-code top-icon" style="font-weight: bold;"></i></a>
+ <a href="https://twitter.com/samzastream" target="_blank"><i class="icon-twitter top-icon"></i></a>
+ </div>
+ </div>
+ </div>
+
+ <div class="page">
+ <!-- menu -->
+ <div class="menu">
+ <div class="menu-inner">
+ <div class="menu-title"><i class="icon-rocket"></i> Getting Started</div>
+ <div class="menu-category">
+ <a href="/startup/hello-samza/0.7.0">Hello Samza</a><br/>
+ <a href="/startup/download">Download</a><br/>
+ </div>
+ <div class="menu-title"><i class="icon-book"></i> Learn</div>
+ <div class="menu-category">
+ <a href="/learn/documentation/0.7.0">Documentation</a><br/>
+ <a href="/learn/tutorials/0.7.0">Tutorials</a><br/>
+ FAQ<br/>
+ <!-- TODO add links to apache when we get them -->
+ Wiki<br/>
+ Papers & Talks<br/>
+ </div>
+ <div class="menu-title"><i class="icon-comments"></i> Community</div>
+ <div class="menu-category">
+ <a href="/community/mailing-lists.html">Mailing Lists</a><br/>
+ <a href="/community/irc.html">IRC</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Bugs<br/>
+ Powered by<br/>
+ Ecosystem<br/>
+ <a href="/community/committers.html">Committers</a>
+ </div>
+ <div class="menu-title"><i class="icon-code"></i> Contribute</div>
+ <div class="menu-category">
+ <a href="/contribute/rules.html">Rules</a><br/>
+ <a href="/contribute/coding-guide.html">Coding Guide</a><br/>
+ <a href="/contribute/projects.html">Projects</a><br/>
+ <a href="/contribute/seps.html">SEPs</a><br/>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank">Code</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Unit Tests<br/>
+ <a href="/contribute/disclaimer.html">Disclaimer</a>
+ </div>
+ </div>
+ </div>
+ <!-- body -->
+ <div class="body">
+ <h2>Group-by and Counting</h2>
+
+<p>haiii</p>
+
+
+ </div>
+ </div>
+ </div>
+ </div>
+ <div class="footer">
+ <div class="page footer-content">
+ <!-- nothing for now. -->
+ </div>
+ </div>
+ </body>
+</html>
\ No newline at end of file
Added: incubator/samza/site/learn/tutorials/0.7.0/index.html
URL: http://svn.apache.org/viewvc/incubator/samza/site/learn/tutorials/0.7.0/index.html?rev=1509764&view=auto
==============================================================================
--- incubator/samza/site/learn/tutorials/0.7.0/index.html (added)
+++ incubator/samza/site/learn/tutorials/0.7.0/index.html Fri Aug 2 16:27:50 2013
@@ -0,0 +1,96 @@
+<html>
+ <head>
+ <title>Samza - Tutorials</title>
+ <link href="/css/main.css" rel="stylesheet"/>
+ <link href='http://fonts.googleapis.com/css?family=Ropa+Sans' rel='stylesheet' type='text/css'/>
+ <link href="http://netdna.bootstrapcdn.com/font-awesome/3.1.1/css/font-awesome.css" rel="stylesheet"/>
+ <link rel="icon" type="image/png" href="/img/samza-icon.png">
+ </head>
+ <body>
+ <div class="container">
+ <div class="container-inner">
+ <div class="header">
+ <div class="page">
+ <div class="logo">
+ <a href="/" class="logo">samza</a>
+ </div>
+ <div class="top-icons">
+ <a href="/startup/download"><i class="icon-download top-icon"></i></a>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank"><i class="icon-code top-icon" style="font-weight: bold;"></i></a>
+ <a href="https://twitter.com/samzastream" target="_blank"><i class="icon-twitter top-icon"></i></a>
+ </div>
+ </div>
+ </div>
+
+ <div class="page">
+ <!-- menu -->
+ <div class="menu">
+ <div class="menu-inner">
+ <div class="menu-title"><i class="icon-rocket"></i> Getting Started</div>
+ <div class="menu-category">
+ <a href="/startup/hello-samza/0.7.0">Hello Samza</a><br/>
+ <a href="/startup/download">Download</a><br/>
+ </div>
+ <div class="menu-title"><i class="icon-book"></i> Learn</div>
+ <div class="menu-category">
+ <a href="/learn/documentation/0.7.0">Documentation</a><br/>
+ <a href="/learn/tutorials/0.7.0">Tutorials</a><br/>
+ FAQ<br/>
+ <!-- TODO add links to apache when we get them -->
+ Wiki<br/>
+ Papers & Talks<br/>
+ </div>
+ <div class="menu-title"><i class="icon-comments"></i> Community</div>
+ <div class="menu-category">
+ <a href="/community/mailing-lists.html">Mailing Lists</a><br/>
+ <a href="/community/irc.html">IRC</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Bugs<br/>
+ Powered by<br/>
+ Ecosystem<br/>
+ <a href="/community/committers.html">Committers</a>
+ </div>
+ <div class="menu-title"><i class="icon-code"></i> Contribute</div>
+ <div class="menu-category">
+ <a href="/contribute/rules.html">Rules</a><br/>
+ <a href="/contribute/coding-guide.html">Coding Guide</a><br/>
+ <a href="/contribute/projects.html">Projects</a><br/>
+ <a href="/contribute/seps.html">SEPs</a><br/>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank">Code</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Unit Tests<br/>
+ <a href="/contribute/disclaimer.html">Disclaimer</a>
+ </div>
+ </div>
+ </div>
+ <!-- body -->
+ <div class="body">
+ <h2>Tutorials</h2>
+
+<p>No tutorials are available right now.</p>
+
+<!-- TODO a bunch of tutorials
+[Log Walkthrough](log-walkthrough.html)
+<a href="configuring-kafka-system.html">Configuring a Kafka System</a><br/>
+<a href="joining-streams.html">Joining Streams</a><br/>
+<a href="sort-stream.html">Sorting a Stream</a><br/>
+<a href="group-by-count.html">Group-by and Counting</a><br/>
+<a href="initialize-close.html">Initializing and Closing</a><br/>
+<a href="windowing.html">Windowing</a><br/>
+<a href="committing.html">Committing</a><br/>
+-->
+
+
+ </div>
+ </div>
+ </div>
+ </div>
+ <div class="footer">
+ <div class="page footer-content">
+ <!-- nothing for now. -->
+ </div>
+ </div>
+ </body>
+</html>
\ No newline at end of file
Added: incubator/samza/site/learn/tutorials/0.7.0/initialize-close.html
URL: http://svn.apache.org/viewvc/incubator/samza/site/learn/tutorials/0.7.0/initialize-close.html?rev=1509764&view=auto
==============================================================================
--- incubator/samza/site/learn/tutorials/0.7.0/initialize-close.html (added)
+++ incubator/samza/site/learn/tutorials/0.7.0/initialize-close.html Fri Aug 2 16:27:50 2013
@@ -0,0 +1,85 @@
+<html>
+ <head>
+ <title>Samza - Initializing and Closing</title>
+ <link href="/css/main.css" rel="stylesheet"/>
+ <link href='http://fonts.googleapis.com/css?family=Ropa+Sans' rel='stylesheet' type='text/css'/>
+ <link href="http://netdna.bootstrapcdn.com/font-awesome/3.1.1/css/font-awesome.css" rel="stylesheet"/>
+ <link rel="icon" type="image/png" href="/img/samza-icon.png">
+ </head>
+ <body>
+ <div class="container">
+ <div class="container-inner">
+ <div class="header">
+ <div class="page">
+ <div class="logo">
+ <a href="/" class="logo">samza</a>
+ </div>
+ <div class="top-icons">
+ <a href="/startup/download"><i class="icon-download top-icon"></i></a>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank"><i class="icon-code top-icon" style="font-weight: bold;"></i></a>
+ <a href="https://twitter.com/samzastream" target="_blank"><i class="icon-twitter top-icon"></i></a>
+ </div>
+ </div>
+ </div>
+
+ <div class="page">
+ <!-- menu -->
+ <div class="menu">
+ <div class="menu-inner">
+ <div class="menu-title"><i class="icon-rocket"></i> Getting Started</div>
+ <div class="menu-category">
+ <a href="/startup/hello-samza/0.7.0">Hello Samza</a><br/>
+ <a href="/startup/download">Download</a><br/>
+ </div>
+ <div class="menu-title"><i class="icon-book"></i> Learn</div>
+ <div class="menu-category">
+ <a href="/learn/documentation/0.7.0">Documentation</a><br/>
+ <a href="/learn/tutorials/0.7.0">Tutorials</a><br/>
+ FAQ<br/>
+ <!-- TODO add links to apache when we get them -->
+ Wiki<br/>
+ Papers & Talks<br/>
+ </div>
+ <div class="menu-title"><i class="icon-comments"></i> Community</div>
+ <div class="menu-category">
+ <a href="/community/mailing-lists.html">Mailing Lists</a><br/>
+ <a href="/community/irc.html">IRC</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Bugs<br/>
+ Powered by<br/>
+ Ecosystem<br/>
+ <a href="/community/committers.html">Committers</a>
+ </div>
+ <div class="menu-title"><i class="icon-code"></i> Contribute</div>
+ <div class="menu-category">
+ <a href="/contribute/rules.html">Rules</a><br/>
+ <a href="/contribute/coding-guide.html">Coding Guide</a><br/>
+ <a href="/contribute/projects.html">Projects</a><br/>
+ <a href="/contribute/seps.html">SEPs</a><br/>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank">Code</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Unit Tests<br/>
+ <a href="/contribute/disclaimer.html">Disclaimer</a>
+ </div>
+ </div>
+ </div>
+ <!-- body -->
+ <div class="body">
+ <h2>Initializing and Closing</h2>
+
+<p>haiii</p>
+
+
+ </div>
+ </div>
+ </div>
+ </div>
+ <div class="footer">
+ <div class="page footer-content">
+ <!-- nothing for now. -->
+ </div>
+ </div>
+ </body>
+</html>
\ No newline at end of file
Added: incubator/samza/site/learn/tutorials/0.7.0/joining-streams.html
URL: http://svn.apache.org/viewvc/incubator/samza/site/learn/tutorials/0.7.0/joining-streams.html?rev=1509764&view=auto
==============================================================================
--- incubator/samza/site/learn/tutorials/0.7.0/joining-streams.html (added)
+++ incubator/samza/site/learn/tutorials/0.7.0/joining-streams.html Fri Aug 2 16:27:50 2013
@@ -0,0 +1,85 @@
+<html>
+ <head>
+ <title>Samza - Joining Streams</title>
+ <link href="/css/main.css" rel="stylesheet"/>
+ <link href='http://fonts.googleapis.com/css?family=Ropa+Sans' rel='stylesheet' type='text/css'/>
+ <link href="http://netdna.bootstrapcdn.com/font-awesome/3.1.1/css/font-awesome.css" rel="stylesheet"/>
+ <link rel="icon" type="image/png" href="/img/samza-icon.png">
+ </head>
+ <body>
+ <div class="container">
+ <div class="container-inner">
+ <div class="header">
+ <div class="page">
+ <div class="logo">
+ <a href="/" class="logo">samza</a>
+ </div>
+ <div class="top-icons">
+ <a href="/startup/download"><i class="icon-download top-icon"></i></a>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank"><i class="icon-code top-icon" style="font-weight: bold;"></i></a>
+ <a href="https://twitter.com/samzastream" target="_blank"><i class="icon-twitter top-icon"></i></a>
+ </div>
+ </div>
+ </div>
+
+ <div class="page">
+ <!-- menu -->
+ <div class="menu">
+ <div class="menu-inner">
+ <div class="menu-title"><i class="icon-rocket"></i> Getting Started</div>
+ <div class="menu-category">
+ <a href="/startup/hello-samza/0.7.0">Hello Samza</a><br/>
+ <a href="/startup/download">Download</a><br/>
+ </div>
+ <div class="menu-title"><i class="icon-book"></i> Learn</div>
+ <div class="menu-category">
+ <a href="/learn/documentation/0.7.0">Documentation</a><br/>
+ <a href="/learn/tutorials/0.7.0">Tutorials</a><br/>
+ FAQ<br/>
+ <!-- TODO add links to apache when we get them -->
+ Wiki<br/>
+ Papers & Talks<br/>
+ </div>
+ <div class="menu-title"><i class="icon-comments"></i> Community</div>
+ <div class="menu-category">
+ <a href="/community/mailing-lists.html">Mailing Lists</a><br/>
+ <a href="/community/irc.html">IRC</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Bugs<br/>
+ Powered by<br/>
+ Ecosystem<br/>
+ <a href="/community/committers.html">Committers</a>
+ </div>
+ <div class="menu-title"><i class="icon-code"></i> Contribute</div>
+ <div class="menu-category">
+ <a href="/contribute/rules.html">Rules</a><br/>
+ <a href="/contribute/coding-guide.html">Coding Guide</a><br/>
+ <a href="/contribute/projects.html">Projects</a><br/>
+ <a href="/contribute/seps.html">SEPs</a><br/>
+ <!-- TODO update link when apache gives us a real repo -->
+ <a href="http://github.com/linkedin/samsa" target="_blank">Code</a><br/>
+ <!-- TODO add links to apache when we get them -->
+ Unit Tests<br/>
+ <a href="/contribute/disclaimer.html">Disclaimer</a>
+ </div>
+ </div>
+ </div>
+ <!-- body -->
+ <div class="body">
+ <h2>Joining Streams</h2>
+
+<p>haiii</p>
+
+
+ </div>
+ </div>
+ </div>
+ </div>
+ <div class="footer">
+ <div class="page footer-content">
+ <!-- nothing for now. -->
+ </div>
+ </div>
+ </body>
+</html>
\ No newline at end of file