You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@flink.apache.org by rm...@apache.org on 2014/07/14 16:10:07 UTC
svn commit: r1610413 [3/4] - in /incubator/flink: ./ _layouts/ site/
site/docs/0.6-SNAPSHOT/ site/docs/0.6-SNAPSHOT/img/
Modified: incubator/flink/site/docs/0.6-SNAPSHOT/java_api_quickstart.html
URL: http://svn.apache.org/viewvc/incubator/flink/site/docs/0.6-SNAPSHOT/java_api_quickstart.html?rev=1610413&r1=1610412&r2=1610413&view=diff
==============================================================================
--- incubator/flink/site/docs/0.6-SNAPSHOT/java_api_quickstart.html (original)
+++ incubator/flink/site/docs/0.6-SNAPSHOT/java_api_quickstart.html Mon Jul 14 14:10:06 2014
@@ -109,6 +109,7 @@
<li>Setup & Configuration
<ul>
<li><a href="local_setup.html">Local Setup</a></li>
+ <li><a href="building.html">Build Flink</a></li>
<li><a href="cluster_setup.html">Cluster Setup</a></li>
<li><a href="yarn_setup.html">YARN Setup</a></li>
<li><a href="config.html">Configuration</a></li>
@@ -170,7 +171,7 @@
</ul>
- <p>Start working on your Stratosphere Java program in a few simple steps.</p>
+ <p>Start working on your Flink Java program in a few simple steps.</p>
<h1 id="requirements">Requirements</h1>
@@ -188,14 +189,14 @@
<div class="tab-content">
<div class="tab-pane active" id="quickstart-script">
-<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="nv">$ </span>curl https://raw.githubusercontent.com/apache/incubator-flink/master/stratosphere-quickstart/quickstart.sh <span class="p">|</span> bash</code></pre></div>
+<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="nv">$ </span>curl https://raw.githubusercontent.com/apache/incubator-flink/master/flink-quickstart/quickstart.sh <span class="p">|</span> bash</code></pre></div>
</div>
<div class="tab-pane" id="maven-archetype">
<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="nv">$ </span>mvn archetype:generate <span class="se">\</span>
- -DarchetypeGroupId<span class="o">=</span>eu.stratosphere <span class="se">\</span>
- -DarchetypeArtifactId<span class="o">=</span>quickstart-java <span class="se">\</span>
+ -DarchetypeGroupId<span class="o">=</span>org.apache.flink <span class="se">\</span>
+ -DarchetypeArtifactId<span class="o">=</span>flink-quickstart-java <span class="se">\</span>
-DarchetypeVersion<span class="o">=</span>0.5.1</code></pre></div>
This allows you to <strong>name your newly created project</strong>. It will interactively ask you for the groupId, artifactId, and package name.
@@ -206,15 +207,15 @@
<p>There will be a new directory in your working directory. If you've used the <em>curl</em> approach, the directory is called <code>quickstart</code>. Otherwise, it has the name of your artifactId.</p>
-<p>The sample project is a <strong>Maven project</strong>, which contains two classes. <em>Job</em> is a basic skeleton program and <em>WordCountJob</em> a working example. Please note that the <em>main</em> method of both classes allow you to start Stratosphere in a development/testing mode.</p>
+<p>The sample project is a <strong>Maven project</strong>, which contains two classes. <em>Job</em> is a basic skeleton program and <em>WordCountJob</em> a working example. Please note that the <em>main</em> method of both classes allow you to start Flink in a development/testing mode.</p>
<p>We recommend to <strong>import this project into your IDE</strong> to develop and test it. If you use Eclipse, the <a href="http://www.eclipse.org/m2e/">m2e plugin</a> allows to <a href="http://books.sonatype.com/m2eclipse-book/reference/creating-sect-importing-projects.html#fig-creating-import">import Maven projects</a>. Some Eclipse bundles include that plugin by default, other require you to install it manually. The IntelliJ IDE also supports Maven projects out of the box.</p>
-<p>A note to Mac OS X users: The default JVM heapsize for Java is too small for Stratosphere. You have to manually increase it. Choose "Run Configurations" -> Arguments and write into the "VM Arguments" box: "-Xmx800m" in Eclipse.</p>
+<p>A note to Mac OS X users: The default JVM heapsize for Java is too small for Flink. You have to manually increase it. Choose "Run Configurations" -> Arguments and write into the "VM Arguments" box: "-Xmx800m" in Eclipse.</p>
<h1 id="build-project">Build Project</h1>
-<p>If you want to <strong>build your project</strong>, go to your project directory and issue the <code>mvn clean package</code> command. You will <strong>find a jar</strong> that runs on every Stratosphere cluster in <code>target/stratosphere-project-0.1-SNAPSHOT.jar</code>.</p>
+<p>If you want to <strong>build your project</strong>, go to your project directory and issue the <code>mvn clean package</code> command. You will <strong>find a jar</strong> that runs on every Flink cluster in <code>target/flink-project-0.1-SNAPSHOT.jar</code>.</p>
<h1 id="next-steps">Next Steps</h1>
@@ -278,7 +279,7 @@ is 1
<span class="o">}</span>
<span class="o">}</span>
</code></pre></div>
-<p><a href=https://github.com/apache/incubator-flink/blob/master//stratosphere-examples/stratosphere-java-examples/src/main/java/eu/stratosphere/example/java/wordcount/WordCount.java>Check GitHub</a> for the full example code.</p>
+<p><a href=https://github.com/apache/incubator-flink/blob/master//flink-examples/flink-java-examples/src/main/java/org/apache/flink/example/java/wordcount/WordCount.java>Check GitHub</a> for the full example code.</p>
<p>For a complete overview over our Java API, have a look at the <a href="java_api_guide.html">API Documentation</a> and <a href="java_api_examples.html">further example programs</a>. If you have any trouble, ask on our <a href="http://mail-archives.apache.org/mod_mbox/incubator-flink-dev/">Mailing List</a>. We are happy to provide help.</p>
Modified: incubator/flink/site/docs/0.6-SNAPSHOT/local_execution.html
URL: http://svn.apache.org/viewvc/incubator/flink/site/docs/0.6-SNAPSHOT/local_execution.html?rev=1610413&r1=1610412&r2=1610413&view=diff
==============================================================================
--- incubator/flink/site/docs/0.6-SNAPSHOT/local_execution.html (original)
+++ incubator/flink/site/docs/0.6-SNAPSHOT/local_execution.html Mon Jul 14 14:10:06 2014
@@ -109,6 +109,7 @@
<li>Setup & Configuration
<ul>
<li><a href="local_setup.html">Local Setup</a></li>
+ <li><a href="building.html">Build Flink</a></li>
<li><a href="cluster_setup.html">Cluster Setup</a></li>
<li><a href="yarn_setup.html">YARN Setup</a></li>
<li><a href="config.html">Configuration</a></li>
@@ -172,13 +173,13 @@
<h1 id="local-execution/debugging">Local Execution/Debugging</h1>
-<p>Stratosphere can run on a single machine, even in a single Java Virtual Machine. This allows users to test and debug Stratosphere programs locally. This section gives an overview of the local execution mechanisms.</p>
+<p>Flink can run on a single machine, even in a single Java Virtual Machine. This allows users to test and debug Flink programs locally. This section gives an overview of the local execution mechanisms.</p>
<p><strong>NOTE:</strong> Please also refer to the <a href="java_api_guide.html#debugging">debugging section</a> in the Java API documentation for a guide to testing and local debugging utilities in the Java API.</p>
-<p>The local environments and executors allow you to run Stratosphere programs in local Java Virtual Machine, or with within any JVM as part of existing programs. Most examples can be launched locally by simply hitting the "Run" button of your IDE.</p>
+<p>The local environments and executors allow you to run Flink programs in local Java Virtual Machine, or with within any JVM as part of existing programs. Most examples can be launched locally by simply hitting the "Run" button of your IDE.</p>
-<p>If you are running Stratosphere programs locally, you can also debug your program like any other Java program. You can either use <code>System.out.println()</code> to write out some internal variables or you can use the debugger. It is possible to set breakpoints within <code>map()</code>, <code>reduce()</code> and all the other methods.</p>
+<p>If you are running Flink programs locally, you can also debug your program like any other Java program. You can either use <code>System.out.println()</code> to write out some internal variables or you can use the debugger. It is possible to set breakpoints within <code>map()</code>, <code>reduce()</code> and all the other methods.</p>
<p>The <code>JobExecutionResult</code> object, which is returned after the execution finished, contains the program runtime and the accumulator results.</p>
@@ -186,16 +187,16 @@
<h1 id="maven-dependency">Maven Dependency</h1>
-<p>If you are developing your program in a Maven project, you have to add the <code>stratosphere-clients</code> module using this dependency:</p>
+<p>If you are developing your program in a Maven project, you have to add the <code>flink-clients</code> module using this dependency:</p>
<div class="highlight"><pre><code class="language-xml" data-lang="xml"><span class="nt"><dependency></span>
- <span class="nt"><groupId></span>eu.stratosphere<span class="nt"></groupId></span>
- <span class="nt"><artifactId></span>stratosphere-clients<span class="nt"></artifactId></span>
+ <span class="nt"><groupId></span>org.apache.flink<span class="nt"></groupId></span>
+ <span class="nt"><artifactId></span>flink-clients<span class="nt"></artifactId></span>
<span class="nt"><version></span>0.5.1<span class="nt"></version></span>
<span class="nt"></dependency></span>
</code></pre></div>
<h1 id="local-environment">Local Environment</h1>
-<p>The <code>LocalEnvironment</code> is a handle to local execution for Stratosphere programs. Use it to run a program within a local JVM - standalone or embedded in other programs.</p>
+<p>The <code>LocalEnvironment</code> is a handle to local execution for Flink programs. Use it to run a program within a local JVM - standalone or embedded in other programs.</p>
<p>The local environment is instantiated via the method <code>ExecutionEnvironment.createLocalEnvironment()</code>. By default, it will use as many local threads for execution as your machine has CPU cores (hardware contexts). You can alternatively specify the desired parallelism. The local environment can be configured to log to the console using <code>enableLogging()</code>/<code>disableLogging()</code>.</p>
@@ -235,7 +236,7 @@
</code></pre></div>
<h1 id="localdistributedexecutor">LocalDistributedExecutor</h1>
-<p>Stratosphere also offers a <code>LocalDistributedExecutor</code> which starts multiple TaskManagers within one JVM. The standard <code>LocalExecutor</code> starts one JobManager and one TaskManager in one JVM.
+<p>Flink also offers a <code>LocalDistributedExecutor</code> which starts multiple TaskManagers within one JVM. The standard <code>LocalExecutor</code> starts one JobManager and one TaskManager in one JVM.
With the <code>LocalDistributedExecutor</code> you can define the number of TaskManagers to start. This is useful for debugging network related code and more of a developer tool than a user tool.</p>
<div class="highlight"><pre><code class="language-java" data-lang="java"><span class="kd">public</span> <span class="kd">static</span> <span class="kt">void</span> <span class="nf">main</span><span class="o">(</span><span class="n">String</span><span class="o">[]</span> <span class="n">args</span><span class="o">)</span> <span class="kd">throws</span> <span class="n">Exception</span> <span class="o">{</span>
<span class="n">ExecutionEnvironment</span> <span class="n">env</span> <span class="o">=</span> <span class="n">ExecutionEnvironment</span><span class="o">.</span><span class="na">getExecutionEnvironment</span><span class="o">();</span>
Modified: incubator/flink/site/docs/0.6-SNAPSHOT/local_setup.html
URL: http://svn.apache.org/viewvc/incubator/flink/site/docs/0.6-SNAPSHOT/local_setup.html?rev=1610413&r1=1610412&r2=1610413&view=diff
==============================================================================
--- incubator/flink/site/docs/0.6-SNAPSHOT/local_setup.html (original)
+++ incubator/flink/site/docs/0.6-SNAPSHOT/local_setup.html Mon Jul 14 14:10:06 2014
@@ -109,6 +109,7 @@
<li>Setup & Configuration
<ul>
<li><a href="local_setup.html">Local Setup</a></li>
+ <li><a href="building.html">Build Flink</a></li>
<li><a href="cluster_setup.html">Cluster Setup</a></li>
<li><a href="yarn_setup.html">YARN Setup</a></li>
<li><a href="config.html">Configuration</a></li>
@@ -162,23 +163,23 @@
<a href="#configuration">Configuration</a>
</li>
<li>
-<a href="#starting-stratosphere">Starting Stratosphere</a>
+<a href="#starting-flink">Starting Flink</a>
</li>
<li>
-<a href="#stratosphere-on-windows">Stratosphere on Windows</a>
+<a href="#flink-on-windows">Flink on Windows</a>
</li>
</ul>
- <p>This documentation is intended to provide instructions on how to run Stratosphere locally on a single machine.</p>
+ <p>This documentation is intended to provide instructions on how to run Flink locally on a single machine.</p>
<h1 id="download">Download</h1>
-<p>Go to the <a href="/downloads/">downloads page</a> and get the ready to run package. If you want to interact with Hadoop (e.g. HDFS or HBase), make sure to pick the Stratosphere package <strong>matching your Hadoop version</strong>. When in doubt or you plan to just work with the local file system pick the package for Hadoop 1.2.x.</p>
+<p>Go to the <a href="/downloads/">downloads page</a> and get the ready to run package. If you want to interact with Hadoop (e.g. HDFS or HBase), make sure to pick the Flink package <strong>matching your Hadoop version</strong>. When in doubt or you plan to just work with the local file system pick the package for Hadoop 1.2.x.</p>
<h1 id="requirements">Requirements</h1>
-<p>Stratosphere runs on <strong>Linux</strong>, <strong>Mac OS X</strong> and <strong>Windows</strong>. The only requirement for a local setup is <strong>Java 1.6.x</strong> or higher. The following manual assumes a <em>UNIX-like environment</em>, for Windows see <a href="#windows">Stratosphere on Windows</a>.</p>
+<p>Flink runs on <strong>Linux</strong>, <strong>Mac OS X</strong> and <strong>Windows</strong>. The only requirement for a local setup is <strong>Java 1.6.x</strong> or higher. The following manual assumes a <em>UNIX-like environment</em>, for Windows see <a href="#windows">Flink on Windows</a>.</p>
<p>You can check the correct installation of Java by issuing the following command:</p>
<div class="highlight"><pre><code class="language-bash" data-lang="bash">java -version
@@ -190,48 +191,48 @@ Java HotSpot<span class="o">(</span>TM<s
</code></pre></div>
<h1 id="configuration">Configuration</h1>
-<p><strong>For local mode Stratosphere is ready to go out of the box and you don't need to change the default configuration.</strong></p>
+<p><strong>For local mode Flink is ready to go out of the box and you don't need to change the default configuration.</strong></p>
-<p>The out of the box configuration will use your default Java installation. You can manually set the environment variable <code>JAVA_HOME</code> or the configuration key <code>env.java.home</code> in <code>conf/stratosphere-conf.yaml</code> if you want to manually override the Java runtime to use. Consult the <a href="config.html">configuration page</a> for further details about configuring Stratosphere.</p>
+<p>The out of the box configuration will use your default Java installation. You can manually set the environment variable <code>JAVA_HOME</code> or the configuration key <code>env.java.home</code> in <code>conf/flink-conf.yaml</code> if you want to manually override the Java runtime to use. Consult the <a href="config.html">configuration page</a> for further details about configuring Flink.</p>
-<h1 id="starting-stratosphere">Starting Stratosphere</h1>
+<h1 id="starting-flink">Starting Flink</h1>
-<p><strong>You are now ready to start Stratosphere.</strong> Unpack the downloaded archive and change to the newly created <code>stratosphere</code> directory. There you can start Stratosphere in local mode:</p>
-<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="nv">$ </span>tar xzf stratosphere-*.tgz
-<span class="nv">$ </span><span class="nb">cd </span>stratosphere
+<p><strong>You are now ready to start Flink.</strong> Unpack the downloaded archive and change to the newly created <code>flink</code> directory. There you can start Flink in local mode:</p>
+<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="nv">$ </span>tar xzf flink-*.tgz
+<span class="nv">$ </span><span class="nb">cd </span>flink
<span class="nv">$ </span>bin/start-local.sh
Starting job manager
</code></pre></div>
<p>You can check that the system is running by checking the log files in the <code>logs</code> directory:</p>
-<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="nv">$ </span>tail log/stratosphere-*-jobmanager-*.log
+<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="nv">$ </span>tail log/flink-*-jobmanager-*.log
INFO ... - Initializing memory manager with <span class="m">409</span> megabytes of memory
-INFO ... - Trying to load eu.stratosphere.nephele.jobmanager.scheduler.local.LocalScheduler as scheduler
+INFO ... - Trying to load org.apache.flinknephele.jobmanager.scheduler.local.LocalScheduler as scheduler
INFO ... - Setting up web info server, using web-root directory ...
INFO ... - Web info server will display information about nephele job-manager on localhost, port 8081.
INFO ... - Starting web info server <span class="k">for</span> JobManager on port 8081
</code></pre></div>
<p>The JobManager will also start a web frontend on port 8081, which you can check with your browser at <code>http://localhost:8081</code>.</p>
-<h1 id="stratosphere-on-windows">Stratosphere on Windows</h1>
+<h1 id="flink-on-windows">Flink on Windows</h1>
-<p>If you want to run Stratosphere on Windows you need to download, unpack and configure the Stratosphere archive as mentioned above. After that you can either use the <strong>Windows Batch</strong> file (<code>.bat</code>) or use <strong>Cygwin</strong> to run the Stratosphere Jobmanager.</p>
+<p>If you want to run Flink on Windows you need to download, unpack and configure the Flink archive as mentioned above. After that you can either use the <strong>Windows Batch</strong> file (<code>.bat</code>) or use <strong>Cygwin</strong> to run the Flink Jobmanager.</p>
-<p>To start Stratosphere in local mode from the <em>Windows Batch</em>, open the command window, navigate to the <code>bin/</code> directory of Stratosphere and run <code>start-local.bat</code>.</p>
-<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="nv">$ </span><span class="nb">cd </span>stratosphere
+<p>To start Flink in local mode from the <em>Windows Batch</em>, open the command window, navigate to the <code>bin/</code> directory of Flink and run <code>start-local.bat</code>.</p>
+<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="nv">$ </span><span class="nb">cd </span>flink
<span class="nv">$ </span><span class="nb">cd </span>bin
<span class="nv">$ </span>start-local.bat
-Starting Stratosphere job manager. Webinterface by default on http://localhost:8081/.
+Starting Flink job manager. Webinterface by default on http://localhost:8081/.
Do not close this batch window. Stop job manager by pressing Ctrl+C.
</code></pre></div>
-<p>After that, you need to open a second terminal to run jobs using <code>stratosphere.bat</code>.</p>
+<p>After that, you need to open a second terminal to run jobs using <code>flink.bat</code>.</p>
-<p>With <em>Cygwin</em> you need to start the Cygwin Terminal, navigate to your Stratosphere directory and run the <code>start-local.sh</code> script:</p>
-<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="nv">$ </span><span class="nb">cd </span>stratosphere
+<p>With <em>Cygwin</em> you need to start the Cygwin Terminal, navigate to your Flink directory and run the <code>start-local.sh</code> script:</p>
+<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="nv">$ </span><span class="nb">cd </span>flink
<span class="nv">$ </span>bin/start-local.sh
Starting Nephele job manager
</code></pre></div>
-<p>If you are installing Stratosphere from the git repository and you are using the Windows git shell, Cygwin can produce a failure similiar to this one:</p>
-<div class="highlight"><pre><code class="language-bash" data-lang="bash">c:/stratosphere/bin/start-local.sh: line 30: <span class="s1">$'\r'</span>: <span class="nb">command </span>not found
+<p>If you are installing Flink from the git repository and you are using the Windows git shell, Cygwin can produce a failure similiar to this one:</p>
+<div class="highlight"><pre><code class="language-bash" data-lang="bash">c:/flink/bin/start-local.sh: line 30: <span class="s1">$'\r'</span>: <span class="nb">command </span>not found
</code></pre></div>
<p>This error occurs, because git is automatically transforming UNIX line endings to Windows style line endings when running in Windows. The problem is, that Cygwin can only deal with UNIX style line endings. The solution is to adjust the Cygwin settings to deal with the correct line endings by following these three steps:</p>
Modified: incubator/flink/site/docs/0.6-SNAPSHOT/run_example_quickstart.html
URL: http://svn.apache.org/viewvc/incubator/flink/site/docs/0.6-SNAPSHOT/run_example_quickstart.html?rev=1610413&r1=1610412&r2=1610413&view=diff
==============================================================================
--- incubator/flink/site/docs/0.6-SNAPSHOT/run_example_quickstart.html (original)
+++ incubator/flink/site/docs/0.6-SNAPSHOT/run_example_quickstart.html Mon Jul 14 14:10:06 2014
@@ -109,6 +109,7 @@
<li>Setup & Configuration
<ul>
<li><a href="local_setup.html">Local Setup</a></li>
+ <li><a href="building.html">Build Flink</a></li>
<li><a href="cluster_setup.html">Cluster Setup</a></li>
<li><a href="yarn_setup.html">YARN Setup</a></li>
<li><a href="config.html">Configuration</a></li>
@@ -162,7 +163,7 @@
<a href="#run-clustering">Run Clustering</a>
</li>
<li>
-<a href="#review-stratosphere-compiler">Review Stratosphere Compiler</a>
+<a href="#review-flink-compiler">Review Flink Compiler</a>
</li>
<li>
<a href="#analyze-the-result">Analyze the Result</a>
@@ -170,20 +171,20 @@
</ul>
- <p>This guide will Peter demonstrate Stratosphere's features by example. You will see how you can leverage Stratosphere's Iteration-feature to find clusters in a dataset using <a href="http://en.wikipedia.org/wiki/K-means_clustering">K-Means clustering</a>.
+ <p>This guide will Peter demonstrate Flink's features by example. You will see how you can leverage Flink's Iteration-feature to find clusters in a dataset using <a href="http://en.wikipedia.org/wiki/K-means_clustering">K-Means clustering</a>.
On the way, you will see the compiler, the status interface and the result of the algorithm.</p>
<h1 id="generate-input-data">Generate Input Data</h1>
-<p>Stratosphere contains a data generator for K-Means.</p>
-<div class="highlight"><pre><code class="language-text" data-lang="text"># Download Stratosphere
+<p>Flink contains a data generator for K-Means.</p>
+<div class="highlight"><pre><code class="language-text" data-lang="text"># Download Flink
wget
-tar xzf stratosphere-*.tgz
-cd stratosphere-*
+tar xzf flink-*.tgz
+cd flink-*
mkdir kmeans
cd kmeans
# Run data generator
-java -cp ../examples/stratosphere-java-examples-0.5.1-KMeans.jar eu.stratosphere.example.java.clustering.util.KMeansDataGenerator 500 10 0.08
+java -cp ../examples/flink-java-examples-0.5.1-KMeans.jar org.apache.flinkexample.java.clustering.util.KMeansDataGenerator 500 10 0.08
cp /tmp/points .
cp /tmp/centers .
</code></pre></div>
@@ -219,17 +220,17 @@ cp /tmp/centers .
<h1 id="run-clustering">Run Clustering</h1>
-<p>We are using the generated input data to run the clustering using a Stratosphere job.</p>
-<div class="highlight"><pre><code class="language-text" data-lang="text"># go to the Stratosphere-root directory
-cd stratosphere
-# start Stratosphere (use ./bin/start-cluster.sh if you're on a cluster)
+<p>We are using the generated input data to run the clustering using a Flink job.</p>
+<div class="highlight"><pre><code class="language-text" data-lang="text"># go to the Flink-root directory
+cd flink
+# start Flink (use ./bin/start-cluster.sh if you're on a cluster)
./bin/start-local.sh
-# Start Stratosphere web client
+# Start Flink web client
./bin/start-webclient.sh
</code></pre></div>
-<h1 id="review-stratosphere-compiler">Review Stratosphere Compiler</h1>
+<h1 id="review-flink-compiler">Review Flink Compiler</h1>
-<p>The Stratosphere webclient allows to submit Stratosphere programs using a graphical user interface.</p>
+<p>The Flink webclient allows to submit Flink programs using a graphical user interface.</p>
<div class="row" style="padding-top:15px">
<div class="col-md-6">
@@ -239,7 +240,7 @@ cd stratosphere
1. <a href="http://localhost:8080/launch.html">Open webclient on localhost:8080</a> <br>
2. Upload the file.
-<div class="highlight"><pre><code class="language-bash" data-lang="bash">examples/stratosphere-java-examples-0.5-SNAPSHOT-KMeansIterative.jar</code></pre></div>
+<div class="highlight"><pre><code class="language-bash" data-lang="bash">examples/flink-java-examples-0.5-SNAPSHOT-KMeansIterative.jar</code></pre></div>
</br>
3. Select it in the left box to see how the operators in the plan are connected to each other. <br>
4. Enter the arguments in the lower left box:
@@ -248,7 +249,7 @@ cd stratosphere
For example:
-<div class="highlight"><pre><code class="language-bash" data-lang="bash">file:///tmp/stratosphere/kmeans/points file:///tmp/stratosphere/kmeans/centers file:///tmp/stratosphere/kmeans/result 20</code></pre></div>
+<div class="highlight"><pre><code class="language-bash" data-lang="bash">file:///tmp/flink/kmeans/points file:///tmp/flink/kmeans/centers file:///tmp/flink/kmeans/result 20</code></pre></div>
</div>
</div>
@@ -274,7 +275,7 @@ cd stratosphere
</div>
<div class="col-md-6">
1. Press the <b>Continue</b> button to start executing the job. <br>
- 2. <a href="http://localhost:8080/launch.html">Open Stratosphere's monitoring interface</a> to see the job's progress.<br>
+ 2. <a href="http://localhost:8080/launch.html">Open Flink's monitoring interface</a> to see the job's progress.<br>
3. Once the job has finished, you can analyize the runtime of the individual operators.
</div>
</div>
Modified: incubator/flink/site/docs/0.6-SNAPSHOT/scala_api_examples.html
URL: http://svn.apache.org/viewvc/incubator/flink/site/docs/0.6-SNAPSHOT/scala_api_examples.html?rev=1610413&r1=1610412&r2=1610413&view=diff
==============================================================================
--- incubator/flink/site/docs/0.6-SNAPSHOT/scala_api_examples.html (original)
+++ incubator/flink/site/docs/0.6-SNAPSHOT/scala_api_examples.html Mon Jul 14 14:10:06 2014
@@ -109,6 +109,7 @@
<li>Setup & Configuration
<ul>
<li><a href="local_setup.html">Local Setup</a></li>
+ <li><a href="building.html">Build Flink</a></li>
<li><a href="cluster_setup.html">Cluster Setup</a></li>
<li><a href="yarn_setup.html">YARN Setup</a></li>
<li><a href="config.html">Configuration</a></li>
@@ -167,10 +168,10 @@
</ul>
- <p>The following example programs showcase different applications of Stratosphere from simple word counting to graph algorithms.
-The code samples illustrate the use of <a href="scala_api_guide.html">Stratosphere's Scala API</a>. </p>
+ <p>The following example programs showcase different applications of Flink from simple word counting to graph algorithms.
+The code samples illustrate the use of <a href="scala_api_guide.html">Flink's Scala API</a>. </p>
-<p>The full source code of the following and more examples can be found in the <a href="https://github.com/apache/incubator-flink/tree/ca2b287a7a78328ebf43766b9fdf39b56fb5fd4f/stratosphere-examples/stratosphere-scala-examples">stratosphere-scala-examples</a> module.</p>
+<p>The full source code of the following and more examples can be found in the <a href="https://github.com/apache/incubator-flink/tree/ca2b287a7a78328ebf43766b9fdf39b56fb5fd4f/flink-examples/flink-scala-examples">flink-scala-examples</a> module.</p>
<h1 id="word-count">Word Count</h1>
@@ -187,7 +188,7 @@ The code samples illustrate the use of <
<span class="k">val</span> <span class="n">output</span> <span class="k">=</span> <span class="n">counts</span><span class="o">.</span><span class="n">write</span><span class="o">(</span><span class="n">wordsOutput</span><span class="o">,</span> <span class="nc">CsvOutputFormat</span><span class="o">()))</span>
</code></pre></div>
-<p>The <a href=https://github.com/apache/incubator-flink/blob/master//stratosphere-examples/stratosphere-scala-examples/src/main/scala/eu/stratosphere/examples/scala/wordcount/WordCount.scala>WordCount example</a> implements the above described algorithm with input parameters: <code><degree of parallelism>, <text input path>, <output path></code>. As test data, any text file will do.</p>
+<p>The <a href=https://github.com/apache/incubator-flink/blob/master//flink-examples/flink-scala-examples/src/main/scala/org/apache/flink/examples/scala/wordcount/WordCount.scala>WordCount example</a> implements the above described algorithm with input parameters: <code><degree of parallelism>, <text input path>, <output path></code>. As test data, any text file will do.</p>
<h1 id="page-rank">Page Rank</h1>
@@ -228,7 +229,7 @@ The code samples illustrate the use of <
<span class="k">val</span> <span class="n">finalRanks</span> <span class="k">=</span> <span class="n">pagesWithRank</span><span class="o">.</span><span class="n">iterate</span><span class="o">(</span><span class="n">numIterations</span><span class="o">,</span> <span class="n">computeRank</span><span class="o">)</span>
<span class="k">val</span> <span class="n">output</span> <span class="k">=</span> <span class="n">finalRanks</span><span class="o">.</span><span class="n">write</span><span class="o">(</span><span class="n">outputPath</span><span class="o">,</span> <span class="nc">CsvOutputFormat</span><span class="o">())</span>
</code></pre></div>
-<p>The <a href=https://github.com/apache/incubator-flink/blob/master//stratosphere-examples/stratosphere-scala-examples/src/main/scala/eu/stratosphere/examples/scala/graph/PageRank.scala>PageRank program</a> implements the above example.
+<p>The <a href=https://github.com/apache/incubator-flink/blob/master//flink-examples/flink-scala-examples/src/main/scala/org/apache/flink/examples/scala/graph/PageRank.scala>PageRank program</a> implements the above example.
It requires the following parameters to run: <code><pages input path>, <link input path>, <output path>, <num pages>, <num iterations></code>.</p>
<p>Input files are plain text files and must be formatted as follows:</p>
@@ -286,7 +287,7 @@ It requires the following parameters to
<span class="n">maxIterations</span><span class="o">)</span>
<span class="k">val</span> <span class="n">output</span> <span class="k">=</span> <span class="n">components</span><span class="o">.</span><span class="n">write</span><span class="o">(</span><span class="n">componentsOutput</span><span class="o">,</span> <span class="nc">CsvOutputFormat</span><span class="o">())</span>
</code></pre></div>
-<p>The <a href=https://github.com/apache/incubator-flink/blob/master//stratosphere-examples/stratosphere-scala-examples/src/main/scala/eu/stratosphere/examples/scala/graph/ConnectedComponents.scala>ConnectedComponents program</a> implements the above example. It requires the following parameters to run: <code><vertex input path>, <edge input path>, <output path> <max num iterations></code>.</p>
+<p>The <a href=https://github.com/apache/incubator-flink/blob/master//flink-examples/flink-scala-examples/src/main/scala/org/apache/flink/examples/scala/graph/ConnectedComponents.scala>ConnectedComponents program</a> implements the above example. It requires the following parameters to run: <code><vertex input path>, <edge input path>, <output path> <max num iterations></code>.</p>
<p>Input files are plain text files and must be formatted as follows:</p>
@@ -316,7 +317,7 @@ It requires the following parameters to
<span class="k">AND</span> <span class="n">o_orderpriority</span> <span class="k">LIKE</span> <span class="ss">"5%"</span>
<span class="k">GROUP</span> <span class="k">BY</span> <span class="n">l_orderkey</span><span class="p">,</span> <span class="n">o_shippriority</span><span class="p">;</span>
</code></pre></div>
-<p>The Stratosphere Scala program, which implements the above query looks as follows.</p>
+<p>The Flink Scala program, which implements the above query looks as follows.</p>
<div class="highlight"><pre><code class="language-scala" data-lang="scala"><span class="c1">// --- define some custom classes to address fields by name ---</span>
<span class="k">case</span> <span class="k">class</span> <span class="nc">Order</span><span class="o">(</span><span class="n">orderId</span><span class="k">:</span> <span class="kt">Int</span><span class="o">,</span> <span class="n">status</span><span class="k">:</span> <span class="kt">Char</span><span class="o">,</span> <span class="n">date</span><span class="k">:</span> <span class="kt">String</span><span class="o">,</span> <span class="n">orderPriority</span><span class="k">:</span> <span class="kt">String</span><span class="o">,</span> <span class="n">shipPriority</span><span class="k">:</span> <span class="kt">Int</span><span class="o">)</span>
<span class="k">case</span> <span class="k">class</span> <span class="nc">LineItem</span><span class="o">(</span><span class="n">orderId</span><span class="k">:</span> <span class="kt">Int</span><span class="o">,</span> <span class="n">extendedPrice</span><span class="k">:</span> <span class="kt">Double</span><span class="o">)</span>
@@ -337,10 +338,10 @@ It requires the following parameters to
<span class="k">val</span> <span class="n">output</span> <span class="k">=</span> <span class="n">prioritizedOrders</span><span class="o">.</span><span class="n">write</span><span class="o">(</span><span class="n">ordersOutput</span><span class="o">,</span> <span class="nc">CsvOutputFormat</span><span class="o">(</span><span class="n">formatOutput</span><span class="o">))</span>
</code></pre></div>
-<p>The <a href=https://github.com/apache/incubator-flink/blob/master//stratosphere-examples/stratosphere-scala-examples/src/main/scala/eu/stratosphere/examples/scala/relational/RelationalQuery.scala>Relational Query program</a> implements the above query. It requires the following parameters to run: <code><orders input path>, <lineitem input path>, <output path>, <degree of parallelism></code>.</p>
+<p>The <a href=https://github.com/apache/incubator-flink/blob/master//flink-examples/flink-scala-examples/src/main/scala/org/apache/flink/examples/scala/relational/RelationalQuery.scala>Relational Query program</a> implements the above query. It requires the following parameters to run: <code><orders input path>, <lineitem input path>, <output path>, <degree of parallelism></code>.</p>
<p>The orders and lineitem files can be generated using the <a href="http://www.tpc.org/tpch/">TPC-H benchmark</a> suite's data generator tool (DBGEN).
-Take the following steps to generate arbitrary large input files for the provided Stratosphere programs:</p>
+Take the following steps to generate arbitrary large input files for the provided Flink programs:</p>
<ol>
<li> Download and unpack DBGEN</li>
Modified: incubator/flink/site/docs/0.6-SNAPSHOT/scala_api_guide.html
URL: http://svn.apache.org/viewvc/incubator/flink/site/docs/0.6-SNAPSHOT/scala_api_guide.html?rev=1610413&r1=1610412&r2=1610413&view=diff
==============================================================================
--- incubator/flink/site/docs/0.6-SNAPSHOT/scala_api_guide.html (original)
+++ incubator/flink/site/docs/0.6-SNAPSHOT/scala_api_guide.html Mon Jul 14 14:10:06 2014
@@ -109,6 +109,7 @@
<li>Setup & Configuration
<ul>
<li><a href="local_setup.html">Local Setup</a></li>
+ <li><a href="building.html">Build Flink</a></li>
<li><a href="cluster_setup.html">Cluster Setup</a></li>
<li><a href="yarn_setup.html">YARN Setup</a></li>
<li><a href="config.html">Configuration</a></li>
@@ -281,12 +282,12 @@
<h1 id="scala-programming-guide">Scala Programming Guide</h1>
-<p>This guide explains how to develop Stratosphere programs with the Scala
+<p>This guide explains how to develop Flink programs with the Scala
programming interface. </p>
<p>Here we will look at the general structure of a Scala job. You will learn how to
write data sources, data sinks, and operators to create data flows that can be
-executed using the Stratosphere system.</p>
+executed using the Flink system.</p>
<p>Writing Scala jobs requires an understanding of Scala, there is excellent
documentation available <a href="http://scala-lang.org/documentation/">here</a>. Most
@@ -301,10 +302,10 @@ of programming in general, though.</p>
<p>To start, let's look at a Word Count job implemented in Scala. This program is
very simple but it will give you a basic idea of what a Scala job looks like.</p>
-<div class="highlight"><pre><code class="language-scala" data-lang="scala"><span class="k">import</span> <span class="nn">eu.stratosphere.client.LocalExecutor</span>
+<div class="highlight"><pre><code class="language-scala" data-lang="scala"><span class="k">import</span> <span class="nn">org.apache.flinkclient.LocalExecutor</span>
-<span class="k">import</span> <span class="nn">eu.stratosphere.api.scala._</span>
-<span class="k">import</span> <span class="nn">eu.stratosphere.api.scala.operators._</span>
+<span class="k">import</span> <span class="nn">org.apache.flinkapi.scala._</span>
+<span class="k">import</span> <span class="nn">org.apache.flinkapi.scala.operators._</span>
<span class="k">object</span> <span class="nc">WordCount</span> <span class="o">{</span>
<span class="k">def</span> <span class="n">main</span><span class="o">(</span><span class="n">args</span><span class="k">:</span> <span class="kt">Array</span><span class="o">[</span><span class="kt">String</span><span class="o">])</span> <span class="o">{</span>
@@ -322,12 +323,12 @@ very simple but it will give you a basic
<span class="o">}</span>
<span class="o">}</span>
</code></pre></div>
-<p>Same as any Stratosphere job a Scala job consists of one or several data
+<p>Same as any Flink job a Scala job consists of one or several data
sources, one or several data sinks and operators in between these that transform
data. Together these parts are referred to as the data flow graph. It dictates
the way data is passed when a job is executed.</p>
-<p>When using Scala in Stratosphere an important concept to grasp is that of the
+<p>When using Scala in Flink an important concept to grasp is that of the
<code>DataSet</code>. <code>DataSet</code> is an abstract concept that represents actual data sets at
runtime and which has operations that transform data to create a new transformed
data set. In this example the <code>TextFile("/some/input")</code> call creates a
@@ -356,33 +357,33 @@ for debugging your job before running it
<p>We will only cover maven here but the concepts should work equivalently with
other build systems such as Gradle or sbt. When wanting to develop a Scala job
-all that is needed as dependency is is <code>stratosphere-scala</code> (and <code>stratosphere-clients</code>, if
+all that is needed as dependency is is <code>flink-scala</code> (and <code>flink-clients</code>, if
you want to execute your jobs). So all that needs to be done is to add the
following lines to your POM.</p>
<div class="highlight"><pre><code class="language-xml" data-lang="xml"><span class="nt"><dependencies></span>
<span class="nt"><dependency></span>
- <span class="nt"><groupId></span>eu.stratosphere<span class="nt"></groupId></span>
- <span class="nt"><artifactId></span>stratosphere-scala<span class="nt"></artifactId></span>
+ <span class="nt"><groupId></span>org.apache.flink<span class="nt"></groupId></span>
+ <span class="nt"><artifactId></span>flink-scala<span class="nt"></artifactId></span>
<span class="nt"><version></span>0.5.1<span class="nt"></version></span>
<span class="nt"></dependency></span>
<span class="nt"><dependency></span>
- <span class="nt"><groupId></span>eu.stratosphere<span class="nt"></groupId></span>
- <span class="nt"><artifactId></span>stratosphere-clients<span class="nt"></artifactId></span>
+ <span class="nt"><groupId></span>org.apache.flink<span class="nt"></groupId></span>
+ <span class="nt"><artifactId></span>flink-clients<span class="nt"></artifactId></span>
<span class="nt"><version></span>0.5.1<span class="nt"></version></span>
<span class="nt"></dependency></span>
<span class="nt"></dependencies></span>
</code></pre></div>
-<p>To quickly get started you can use the Stratosphere Scala quickstart available
+<p>To quickly get started you can use the Flink Scala quickstart available
<a href="/quickstart/scala.html">here</a>. This will give you a
completeMaven project with some working example code that you can use to explore
the system or as basis for your own projects.</p>
<p>These imports are normally enough for any project:</p>
-<div class="highlight"><pre><code class="language-scala" data-lang="scala"><span class="k">import</span> <span class="nn">eu.stratosphere.api.scala._</span>
-<span class="k">import</span> <span class="nn">eu.stratosphere.api.scala.operators._</span>
+<div class="highlight"><pre><code class="language-scala" data-lang="scala"><span class="k">import</span> <span class="nn">org.apache.flinkapi.scala._</span>
+<span class="k">import</span> <span class="nn">org.apache.flinkapi.scala.operators._</span>
-<span class="k">import</span> <span class="nn">eu.stratosphere.client.LocalExecutor</span>
-<span class="k">import</span> <span class="nn">eu.stratosphere.client.RemoteExecutor</span>
+<span class="k">import</span> <span class="nn">org.apache.flinkclient.LocalExecutor</span>
+<span class="k">import</span> <span class="nn">org.apache.flinkclient.RemoteExecutor</span>
</code></pre></div>
<p>The first two imports contain things like <code>DataSet</code>, <code>Plan</code>, data sources, data
sinks, and the operations. The last two imports are required if you want to run
@@ -396,7 +397,7 @@ a data flow on your local machine, respe
<p>As already alluded to in the introductory example you write Scala jobs by using
operations on a <code>DataSet</code> to create new transformed <code>DataSet</code>. This concept is
-the core of the Stratosphere Scala API so it merits some more explanation. A
+the core of the Flink Scala API so it merits some more explanation. A
<code>DataSet</code> can look and behave like a regular Scala collection in your code but
it does not contain any actual data but only represents data. For example: when
you use <code>TextFile()</code> you get back a <code>DataSource[String]</code> that represents each
@@ -432,9 +433,9 @@ the primitive Scala types, case classes
data types.</p>
<p>Custom data types must implement the interface
-<a href=https://github.com/apache/incubator-flink/blob/master//stratosphere-core/src/main/java/eu/stratosphere/types/Value.java>Value</a>.
+<a href=https://github.com/apache/incubator-flink/blob/master//flink-core/src/main/java/org/apache/flink/types/Value.java>Value</a>.
For custom data types that should also be used as a grouping key or join key
-the <a href=https://github.com/apache/incubator-flink/blob/master//stratosphere-core/src/main/java/eu/stratosphere/types/Key.java>Key</a>
+the <a href=https://github.com/apache/incubator-flink/blob/master//flink-core/src/main/java/org/apache/flink/types/Key.java>Key</a>
interface must be implemented.</p>
<p><a href="#top">Back to top</a></p>
@@ -582,8 +583,8 @@ have something like this:</p>
<p>This input format is only meant to be used in conjunction with
<code>BinarySerializedOutputFormat</code>. You can use these to write elements to files using a
-Stratosphere-internal format that can efficiently be read again. You should only
-use this when output is only meant to be consumed by other Stratosphere jobs.
+Flink-internal format that can efficiently be read again. You should only
+use this when output is only meant to be consumed by other Flink jobs.
The format can be used on one of two ways:</p>
<div class="highlight"><pre><code class="language-scala" data-lang="scala"><span class="nc">BinarySerializedInputFormat</span><span class="o">[</span><span class="kt">Out</span><span class="o">]()</span>
<span class="nc">BinarySerializedInputFormat</span><span class="o">[</span><span class="kt">Out</span><span class="o">](</span><span class="n">blocksize</span><span class="k">:</span> <span class="kt">Long</span><span class="o">)</span>
@@ -615,7 +616,7 @@ reading the array and returns the elemen
<h2 id="operations-on-dataset">Operations on DataSet</h2>
<p>As explained in <a href="pmodel.html#operators">Programming Model</a>,
-a Stratosphere job is a graph of operators that process data coming from
+a Flink job is a graph of operators that process data coming from
sources that is finally written to sinks. When you use the Scala front end
these operators as well as the graph is created behind the scenes. For example,
when you write code like this:</p>
@@ -634,7 +635,7 @@ it helps to remember, that when you are
a data flow graph that processes data only when executed.</p>
<p>There are operations on <code>DataSet</code> that correspond to all the types of operators
-that the Stratosphere system supports. We will shortly go trough all of them with
+that the Flink system supports. We will shortly go trough all of them with
some examples.</p>
<p><a href="#top">Back to top</a></p>
@@ -862,13 +863,13 @@ an operation you can use a union to comb
<h2 id="iterations">Iterations</h2>
-<p>Iterations allow you to implement <em>loops</em> in Stratosphere programs.
+<p>Iterations allow you to implement <em>loops</em> in Flink programs.
<a href="iterations.html">This page</a> gives a
general introduction to iterations. This section here provides quick examples
of how to use the concepts using the Scala API.
The iteration operators encapsulate a part of the program and execute it
repeatedly, feeding back the result of one iteration (the partial solution) into
-the next iteration. Stratosphere has two different types of iterations,
+the next iteration. Flink has two different types of iterations,
<em>Bulk Iteration</em> and <em>Delta Iteration</em>.</p>
<p>For both types of iterations you provide the iteration body as a function
@@ -1037,8 +1038,8 @@ is used.</p>
<p>This output format is only meant to be used in conjunction with
<code>BinarySerializedInputFormat</code>. You can use these to write elements to files using a
-Stratosphere-internal format that can efficiently be read again. You should only
-use this when output is only meant to be consumed by other Stratosphere jobs.
+Flink-internal format that can efficiently be read again. You should only
+use this when output is only meant to be consumed by other Flink jobs.
The output format can be used on one of two ways:</p>
<div class="highlight"><pre><code class="language-scala" data-lang="scala"><span class="nc">BinarySerializedOutputFormat</span><span class="o">[</span><span class="kt">In</span><span class="o">]()</span>
<span class="nc">BinarySerializedOutputFormat</span><span class="o">[</span><span class="kt">In</span><span class="o">](</span><span class="n">blocksize</span><span class="k">:</span> <span class="kt">Long</span><span class="o">)</span>
@@ -1056,7 +1057,7 @@ by Scala.</p>
<h2 id="executing-jobs">Executing Jobs</h2>
-<p>To execute a data flow graph the sinks need to be wrapped in a <a href=https://github.com/apache/incubator-flink/blob/master//stratosphere-scala/src/main/scala/eu/stratosphere/api/scala/ScalaPlan.scala>ScalaPlan</a> object like this:</p>
+<p>To execute a data flow graph the sinks need to be wrapped in a <a href=https://github.com/apache/incubator-flink/blob/master//flink-scala/src/main/scala/org/apache/flink/api/scala/ScalaPlan.scala>ScalaPlan</a> object like this:</p>
<div class="highlight"><pre><code class="language-scala" data-lang="scala"><span class="k">val</span> <span class="n">out</span><span class="k">:</span> <span class="kt">DataSet</span><span class="o">[(</span><span class="kt">String</span>, <span class="kt">Int</span><span class="o">)]</span>
<span class="k">val</span> <span class="n">sink</span> <span class="k">=</span> <span class="n">out</span><span class="o">.</span><span class="n">write</span><span class="o">(</span><span class="s">"file:///some/file"</span><span class="o">,</span> <span class="nc">CsvOutputFormat</span><span class="o">())</span>
@@ -1072,7 +1073,7 @@ used on bigger data sets it can be execu
now give an example for each of the two execution modes.</p>
<p>First up is local execution:</p>
-<div class="highlight"><pre><code class="language-scala" data-lang="scala"><span class="k">import</span> <span class="nn">eu.stratosphere.client.LocalExecutor</span>
+<div class="highlight"><pre><code class="language-scala" data-lang="scala"><span class="k">import</span> <span class="nn">org.apache.flinkclient.LocalExecutor</span>
<span class="o">...</span>
@@ -1085,8 +1086,8 @@ now give an example for each of the two
to package your code in a jar file so that it can be distributed on the cluster.
Have a look at the <a href="scala_api_quickstart.html">scala quickstart</a> to see how you
can set up a maven project that does the packaging. Remote execution is done
-using the <a href=https://github.com/apache/incubator-flink/blob/master//stratosphere-clients/src/main/java/eu/stratosphere/client/RemoteExecutor.java>RemoteExecutor</a>, like this:</p>
-<div class="highlight"><pre><code class="language-scala" data-lang="scala"><span class="k">import</span> <span class="nn">eu.stratosphere.client.RemoteExecutor</span>
+using the <a href=https://github.com/apache/incubator-flink/blob/master//flink-clients/src/main/java/org/apache/flink/client/RemoteExecutor.java>RemoteExecutor</a>, like this:</p>
+<div class="highlight"><pre><code class="language-scala" data-lang="scala"><span class="k">import</span> <span class="nn">org.apache.flinkclient.RemoteExecutor</span>
<span class="o">...</span>
@@ -1094,7 +1095,7 @@ using the <a href=https://github.com/apa
<span class="k">val</span> <span class="n">ex</span> <span class="k">=</span> <span class="k">new</span> <span class="nc">RemoteExecutor</span><span class="o">(</span><span class="s">"<job manager ip address>"</span><span class="o">,</span> <span class="o"><</span><span class="n">job</span> <span class="n">manager</span> <span class="n">port</span><span class="o">>,</span> <span class="s">"your.jar"</span><span class="o">);</span>
<span class="n">ex</span><span class="o">.</span><span class="n">executePlan</span><span class="o">(</span><span class="n">plan</span><span class="o">);</span>
</code></pre></div>
-<p>The IP address and the port of the Stratosphere job manager depend on your
+<p>The IP address and the port of the Flink job manager depend on your
setup. Have a look at <a href="/quickstart/setup.html">cluster quickstart</a> for a quick
guide about how to set up a cluster. The default cluster port is 6123, so
if you run a job manger on your local computer you can give this and "localhost"
@@ -1136,14 +1137,14 @@ instead of the anonymous class we used h
<p>There are rich functions for all the various operator types. The basic
template is the some, though. The common interface that they implement
-is <a href=https://github.com/apache/incubator-flink/blob/master//stratosphere-core/src/main/java/eu/stratosphere/api/common/functions/Function.java>Function</a>. The <code>open</code> and <code>close</code> methods can be overridden to run set-up
+is <a href=https://github.com/apache/incubator-flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/functions/Function.java>Function</a>. The <code>open</code> and <code>close</code> methods can be overridden to run set-up
and tear-down code. The other methods can be used in a rich function to
work with the runtime context which gives information about the context
of the operator. Your operation code must now reside in an <code>apply</code> method
that has the same signature as the anonymous function you would normally
supply.</p>
-<p>The rich functions reside in the package <code>eu.stratosphere.api.scala.functions</code>.
+<p>The rich functions reside in the package <code>org.apache.flinkapi.scala.functions</code>.
This is a list of all the rich functions can can be used instead of
simple functions in the respective operations:</p>
<div class="highlight"><pre><code class="language-scala" data-lang="scala"><span class="k">abstract</span> <span class="k">class</span> <span class="nc">MapFunction</span><span class="o">[</span><span class="kt">In</span>, <span class="kt">Out</span><span class="o">]</span>
Modified: incubator/flink/site/docs/0.6-SNAPSHOT/scala_api_quickstart.html
URL: http://svn.apache.org/viewvc/incubator/flink/site/docs/0.6-SNAPSHOT/scala_api_quickstart.html?rev=1610413&r1=1610412&r2=1610413&view=diff
==============================================================================
--- incubator/flink/site/docs/0.6-SNAPSHOT/scala_api_quickstart.html (original)
+++ incubator/flink/site/docs/0.6-SNAPSHOT/scala_api_quickstart.html Mon Jul 14 14:10:06 2014
@@ -109,6 +109,7 @@
<li>Setup & Configuration
<ul>
<li><a href="local_setup.html">Local Setup</a></li>
+ <li><a href="building.html">Build Flink</a></li>
<li><a href="cluster_setup.html">Cluster Setup</a></li>
<li><a href="yarn_setup.html">YARN Setup</a></li>
<li><a href="config.html">Configuration</a></li>
@@ -170,7 +171,7 @@
</ul>
- <p>Start working on your Stratosphere Scala program in a few simple steps.</p>
+ <p>Start working on your Flink Scala program in a few simple steps.</p>
<h1 id="requirements">Requirements</h1>
@@ -188,14 +189,14 @@
<div class="tab-content">
<div class="tab-pane active" id="quickstart-script">
-<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="nv">$ </span>curl https://raw.githubusercontent.com/apache/incubator-flink/master/stratosphere-quickstart/quickstart-scala.sh <span class="p">|</span> bash</code></pre></div>
+<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="nv">$ </span>curl https://raw.githubusercontent.com/apache/incubator-flink/master/flink-quickstart/quickstart-scala.sh <span class="p">|</span> bash</code></pre></div>
</div>
<div class="tab-pane" id="maven-archetype">
<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="nv">$ </span>mvn archetype:generate <span class="se">\</span>
- -DarchetypeGroupId<span class="o">=</span>eu.stratosphere <span class="se">\</span>
- -DarchetypeArtifactId<span class="o">=</span>quickstart-scala <span class="se">\</span>
+ -DarchetypeGroupId<span class="o">=</span>org.apache.flink <span class="se">\</span>
+ -DarchetypeArtifactId<span class="o">=</span>flink-quickstart-scala <span class="se">\</span>
-DarchetypeVersion<span class="o">=</span>0.5.1</code></pre></div>
This allows you to <strong>name your newly created project</strong>. It will interactively ask you for the groupId, artifactId, and package name.
@@ -206,7 +207,7 @@
<p>There will be a <strong>new directory in your working directory</strong>. If you've used the <em>curl</em> approach, the directory is called <code>quickstart</code>. Otherwise, it has the name of your artifactId.</p>
-<p>The sample project is a <strong>Maven project</strong>, which contains a sample scala <em>job</em> that implements Word Count. Please note that the <em>RunJobLocal</em> and <em>RunJobRemote</em> objects allow you to start Stratosphere in a development/testing mode.</p></p>
+<p>The sample project is a <strong>Maven project</strong>, which contains a sample scala <em>job</em> that implements Word Count. Please note that the <em>RunJobLocal</em> and <em>RunJobRemote</em> objects allow you to start Flink in a development/testing mode.</p></p>
<p>We recommend to <strong>import this project into your IDE</strong>. For Eclipse, you need the following plugins, which you can install from the provided Eclipse Update Sites:</p>
@@ -231,7 +232,7 @@
<h1 id="build-project">Build Project</h1>
-<p>If you want to <strong>build your project</strong>, go to your project directory and issue the<code>mvn clean package</code> command. You will <strong>find a jar</strong> that runs on every Stratosphere cluster in <strong>target/stratosphere-project-0.1-SNAPSHOT.jar</strong>.</p>
+<p>If you want to <strong>build your project</strong>, go to your project directory and issue the<code>mvn clean package</code> command. You will <strong>find a jar</strong> that runs on every Flink cluster in <strong>target/flink-project-0.1-SNAPSHOT.jar</strong>.</p>
<h1 id="next-steps">Next Steps</h1>
Modified: incubator/flink/site/docs/0.6-SNAPSHOT/setup_quickstart.html
URL: http://svn.apache.org/viewvc/incubator/flink/site/docs/0.6-SNAPSHOT/setup_quickstart.html?rev=1610413&r1=1610412&r2=1610413&view=diff
==============================================================================
--- incubator/flink/site/docs/0.6-SNAPSHOT/setup_quickstart.html (original)
+++ incubator/flink/site/docs/0.6-SNAPSHOT/setup_quickstart.html Mon Jul 14 14:10:06 2014
@@ -109,6 +109,7 @@
<li>Setup & Configuration
<ul>
<li><a href="local_setup.html">Local Setup</a></li>
+ <li><a href="building.html">Build Flink</a></li>
<li><a href="cluster_setup.html">Cluster Setup</a></li>
<li><a href="yarn_setup.html">YARN Setup</a></li>
<li><a href="config.html">Configuration</a></li>
@@ -168,20 +169,20 @@
<a href="#cluster-setup">Cluster Setup</a>
</li>
<li>
-<a href="#stratosphere-on-yarn">Stratosphere on YARN</a>
+<a href="#flink-on-yarn">Flink on YARN</a>
</li>
</ul>
- <p>Get Stratosphere up and running in a few simple steps.</p>
+ <p>Get Flink up and running in a few simple steps.</p>
<h1 id="requirements">Requirements</h1>
-<p>Stratosphere runs on all <strong>UNIX-like</strong> environments: <strong>Linux</strong>, <strong>Mac OS X</strong>, <strong>Cygwin</strong>. The only requirement is to have a working <strong>Java 6.x</strong> (or higher) installation.</p>
+<p>Flink runs on all <strong>UNIX-like</strong> environments: <strong>Linux</strong>, <strong>Mac OS X</strong>, <strong>Cygwin</strong>. The only requirement is to have a working <strong>Java 6.x</strong> (or higher) installation.</p>
<h1 id="download">Download</h1>
-<p>Download the ready to run binary package. Choose the Stratosphere distribution that <strong>matches your Hadoop version</strong>. If you are unsure which version to choose or you just want to run locally, pick the package for Hadoop 1.2.</p>
+<p>Download the ready to run binary package. Choose the Flink distribution that <strong>matches your Hadoop version</strong>. If you are unsure which version to choose or you just want to run locally, pick the package for Hadoop 1.2.</p>
<ul class="nav nav-tabs">
<li class="active"><a href="#bin-hadoop1" data-toggle="tab">Hadoop 1.2</a></li>
@@ -190,10 +191,10 @@
<p><div class="tab-content text-center">
<div class="tab-pane active" id="bin-hadoop1">
- <a class="btn btn-info btn-lg" onclick="_gaq.push(['_trackEvent','Action','download-quickstart-setup-1',this.href]);" href="https://github.com/stratosphere/stratosphere/releases/download/release-0.5.1/stratosphere-bin-0.5.1.tgz"><i class="icon-download"> </i> Download Stratosphere for Hadoop 1.2</a>
+ <a class="btn btn-info btn-lg" onclick="_gaq.push(['_trackEvent','Action','download-quickstart-setup-1',this.href]);" href="https://github.com/stratosphere/stratosphere/releases/download/release-0.5.1/stratosphere-bin-0.5.1.tgz"><i class="icon-download"> </i> Download Flink for Hadoop 1.2</a>
</div>
<div class="tab-pane" id="bin-hadoop2">
- <a class="btn btn-info btn-lg" onclick="_gaq.push(['_trackEvent','Action','download-quickstart-setup-2',this.href]);" href="https://github.com/stratosphere/stratosphere/releases/download/release-0.5.1/stratosphere-bin-0.5.1-hadoop2.tgz"><i class="icon-download"> </i> Download Stratosphere for Hadoop 2</a>
+ <a class="btn btn-info btn-lg" onclick="_gaq.push(['_trackEvent','Action','download-quickstart-setup-2',this.href]);" href="https://github.com/stratosphere/stratosphere/releases/download/release-0.5.1/stratosphere-bin-0.5.1-hadoop2.tgz"><i class="icon-download"> </i> Download Flink for Hadoop 2</a>
</div>
</div>
</p></p>
@@ -205,18 +206,18 @@
<ol>
<li>Go to the download directory.</li>
<li>Unpack the downloaded archive.</li>
-<li>Start Stratosphere.</li>
+<li>Start Flink.</li>
</ol>
<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="nv">$ </span><span class="nb">cd</span> ~/Downloads <span class="c"># Go to download directory</span>
-<span class="nv">$ </span>tar xzf stratosphere-*.tgz <span class="c"># Unpack the downloaded archive</span>
-<span class="nv">$ </span><span class="nb">cd </span>stratosphere
-<span class="nv">$ </span>bin/start-local.sh <span class="c"># Start Stratosphere</span>
+<span class="nv">$ </span>tar xzf flink-*.tgz <span class="c"># Unpack the downloaded archive</span>
+<span class="nv">$ </span><span class="nb">cd </span>flink
+<span class="nv">$ </span>bin/start-local.sh <span class="c"># Start Flink</span>
</code></pre></div>
<p>Check the <strong>JobManager's web frontend</strong> at <a href="http://localhost:8081">http://localhost:8081</a> and make sure everything is up and running.</p>
<h1 id="run-example">Run Example</h1>
-<p>Run the <strong>Word Count example</strong> to see Stratosphere at work.</p>
+<p>Run the <strong>Word Count example</strong> to see Flink at work.</p>
<ul>
<li><strong>Download test data</strong>:
@@ -225,8 +226,8 @@ $ wget -O hamlet.txt http://www.gutenber
</code></li>
<li>You now have a text file called <em>hamlet.txt</em> in your working directory.</li>
<li><p><strong>Start the example program</strong>:</p>
-<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="nv">$ </span>bin/stratosphere run <span class="se">\</span>
---jarfile ./examples/stratosphere-java-examples-0.5.1-WordCount.jar <span class="se">\</span>
+<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="nv">$ </span>bin/flink run <span class="se">\</span>
+--jarfile ./examples/flink-java-examples-0.5.1-WordCount.jar <span class="se">\</span>
--arguments file://<span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span>/hamlet.txt file://<span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span>/wordcount-result.txt
</code></pre></div></li>
@@ -235,11 +236,11 @@ $ wget -O hamlet.txt http://www.gutenber
<h1 id="cluster-setup">Cluster Setup</h1>
-<p><strong>Running Stratosphere on a cluster</strong> is as easy as running it locally. Having <strong>passwordless SSH</strong> and <strong>the same directory structure</strong> on all your cluster nodes lets you use our scripts to control everything.</p>
+<p><strong>Running Flink on a cluster</strong> is as easy as running it locally. Having <strong>passwordless SSH</strong> and <strong>the same directory structure</strong> on all your cluster nodes lets you use our scripts to control everything.</p>
<ol>
-<li>Copy the unpacked <strong>stratosphere</strong> directory from the downloaded archive to the same file system path on each node of your setup.</li>
-<li>Choose a <strong>master node</strong> (JobManager) and set the <code>jobmanager.rpc.address</code> key in <code>conf/stratosphere-conf.yaml</code> to its IP or hostname. Make sure that all nodes in your cluster have the same <code>jobmanager.rpc.address</code> configured.</li>
+<li>Copy the unpacked <strong>flink</strong> directory from the downloaded archive to the same file system path on each node of your setup.</li>
+<li>Choose a <strong>master node</strong> (JobManager) and set the <code>jobmanager.rpc.address</code> key in <code>conf/flink-conf.yaml</code> to its IP or hostname. Make sure that all nodes in your cluster have the same <code>jobmanager.rpc.address</code> configured.</li>
<li>Add the IPs or hostnames (one per line) of all <strong>worker nodes</strong> (TaskManager) to the slaves files in <code>conf/slaves</code>.</li>
</ol>
@@ -254,13 +255,13 @@ $ wget -O hamlet.txt http://www.gutenber
<div class="col-md-6">
<div class="row">
<p class="lead text-center">
- /path/to/<strong>stratosphere/conf/<br>stratosphere-conf.yaml</strong>
+ /path/to/<strong>flink/conf/<br>flink-conf.yaml</strong>
<pre>jobmanager.rpc.address: 10.0.0.1</pre>
</p>
</div>
<div class="row" style="margin-top: 1em;">
<p class="lead text-center">
- /path/to/<strong>stratosphere/<br>conf/slaves</strong>
+ /path/to/<strong>flink/<br>conf/slaves</strong>
<pre>
10.0.0.2
10.0.0.3</pre>
@@ -270,12 +271,12 @@ $ wget -O hamlet.txt http://www.gutenber
<p></div>
</div></p>
-<h1 id="stratosphere-on-yarn">Stratosphere on YARN</h1>
+<h1 id="flink-on-yarn">Flink on YARN</h1>
-<p>You can easily deploy Stratosphere on your existing <strong>YARN cluster</strong>. </p>
+<p>You can easily deploy Flink on your existing <strong>YARN cluster</strong>. </p>
<ol>
-<li>Download the <strong>Stratosphere YARN package</strong> with the YARN client: <a href="https://github.com/stratosphere/stratosphere/releases/download/release-0.5.1/stratosphere-bin-0.5.1-yarn.tar.gz">Stratosphere for YARN</a></li>
+<li>Download the <strong>Flink YARN package</strong> with the YARN client: <a href="https://github.com/stratosphere/stratosphere/releases/download/release-0.5.1/stratosphere-bin-0.5.1-yarn.tar.gz">Flink for YARN</a></li>
<li>Make sure your <strong>HADOOP_HOME</strong> (or <em>YARN_CONF_DIR</em> or <em>HADOOP_CONF_DIR</em>) <strong>environment variable</strong> is set to read your YARN and HDFS configuration.</li>
<li>Run the <strong>YARN client</strong> with: <code>./bin/yarn-session.sh</code>. You can run the client with options <code>-n 10 -tm 8192</code> to allocate 10 TaskManagers with 8GB of memory each.</li>
</ol>
Modified: incubator/flink/site/docs/0.6-SNAPSHOT/spargel_guide.html
URL: http://svn.apache.org/viewvc/incubator/flink/site/docs/0.6-SNAPSHOT/spargel_guide.html?rev=1610413&r1=1610412&r2=1610413&view=diff
==============================================================================
--- incubator/flink/site/docs/0.6-SNAPSHOT/spargel_guide.html (original)
+++ incubator/flink/site/docs/0.6-SNAPSHOT/spargel_guide.html Mon Jul 14 14:10:06 2014
@@ -109,6 +109,7 @@
<li>Setup & Configuration
<ul>
<li><a href="local_setup.html">Local Setup</a></li>
+ <li><a href="building.html">Build Flink</a></li>
<li><a href="cluster_setup.html">Cluster Setup</a></li>
<li><a href="yarn_setup.html">YARN Setup</a></li>
<li><a href="config.html">Configuration</a></li>
@@ -181,11 +182,11 @@
<h2 id="spargel-api">Spargel API</h2>
-<p>The Spargel API is part of the <em>addons</em> Maven project. All relevant classes are located in the <em>eu.stratosphere.spargel.java</em> package.</p>
+<p>The Spargel API is part of the <em>addons</em> Maven project. All relevant classes are located in the <em>org.apache.flinkspargel.java</em> package.</p>
<p>Add the following dependency to your <code>pom.xml</code> to use the Spargel.</p>
<div class="highlight"><pre><code class="language-xml" data-lang="xml"><span class="nt"><dependency></span>
- <span class="nt"><groupId></span>eu.stratosphere<span class="nt"></groupId></span>
+ <span class="nt"><groupId></span>org.apache.flink<span class="nt"></groupId></span>
<span class="nt"><artifactId></span>spargel<span class="nt"></artifactId></span>
<span class="nt"><version></span>0.5.1<span class="nt"></version></span>
<span class="nt"></dependency></span>
Modified: incubator/flink/site/docs/0.6-SNAPSHOT/web_client.html
URL: http://svn.apache.org/viewvc/incubator/flink/site/docs/0.6-SNAPSHOT/web_client.html?rev=1610413&r1=1610412&r2=1610413&view=diff
==============================================================================
--- incubator/flink/site/docs/0.6-SNAPSHOT/web_client.html (original)
+++ incubator/flink/site/docs/0.6-SNAPSHOT/web_client.html Mon Jul 14 14:10:06 2014
@@ -109,6 +109,7 @@
<li>Setup & Configuration
<ul>
<li><a href="local_setup.html">Local Setup</a></li>
+ <li><a href="building.html">Build Flink</a></li>
<li><a href="cluster_setup.html">Cluster Setup</a></li>
<li><a href="yarn_setup.html">YARN Setup</a></li>
<li><a href="config.html">Configuration</a></li>
@@ -169,7 +170,7 @@
</ul>
- <p>Stratosphere provides a web interface to upload jobs, inspect their execution plans, and execute them. The interface is a great tool to showcase programs, debug execution plans, or demonstrate the system as a whole.</p>
+ <p>Flink provides a web interface to upload jobs, inspect their execution plans, and execute them. The interface is a great tool to showcase programs, debug execution plans, or demonstrate the system as a whole.</p>
<h1 id="start,-stop,-and-configure-the-web-interface">Start, Stop, and Configure the Web Interface</h1>
@@ -179,22 +180,22 @@
<p>and stop it by calling:</p>
<div class="highlight"><pre><code class="language-text" data-lang="text">./bin/stop-webclient.sh
</code></pre></div>
-<p>The web interface runs on port 8080 by default. To specify a custom port set the <code>webclient.port</code> property in the <em>./conf/stratosphere.yaml</em> configuration file. Jobs are submitted to the JobManager specified by <code>jobmanager.rpc.address</code> and <code>jobmanager.rpc.port</code>. Please consult the <a href="config.html#web_frontend">configuration</a> page for details and further configuration options.</p>
+<p>The web interface runs on port 8080 by default. To specify a custom port set the <code>webclient.port</code> property in the <em>./conf/flink.yaml</em> configuration file. Jobs are submitted to the JobManager specified by <code>jobmanager.rpc.address</code> and <code>jobmanager.rpc.port</code>. Please consult the <a href="config.html#web_frontend">configuration</a> page for details and further configuration options.</p>
<h1 id="use-the-web-interface">Use the Web Interface</h1>
<p>The web interface provides two views:</p>
<ol>
-<li> The <strong>job view</strong> to upload, preview, and submit Stratosphere programs.</li>
-<li> The <strong>plan view</strong> to analyze the optimized execution plans of Stratosphere programs.</li>
+<li> The <strong>job view</strong> to upload, preview, and submit Flink programs.</li>
+<li> The <strong>plan view</strong> to analyze the optimized execution plans of Flink programs.</li>
</ol>
<h2 id="job-view">Job View</h2>
<p>The interface starts serving the job view. </p>
-<p>You can <strong>upload</strong> a Stratosphere program as a jar file. To <strong>execute</strong> an uploaded program:</p>
+<p>You can <strong>upload</strong> a Flink program as a jar file. To <strong>execute</strong> an uploaded program:</p>
<ul>
<li>select it from the job list on the left, </li>