You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@flink.apache.org by mj...@apache.org on 2016/04/11 11:20:55 UTC
[1/8] flink-web git commit: fixed broken links and removed old stuff
(prior Flink)
Repository: flink-web
Updated Branches:
refs/heads/asf-site 029a30551 -> 24f3ba5a1
fixed broken links and removed old stuff (prior Flink)
Project: http://git-wip-us.apache.org/repos/asf/flink-web/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink-web/commit/52d8fe19
Tree: http://git-wip-us.apache.org/repos/asf/flink-web/tree/52d8fe19
Diff: http://git-wip-us.apache.org/repos/asf/flink-web/diff/52d8fe19
Branch: refs/heads/asf-site
Commit: 52d8fe19d0a89104178f4c5d4b7564ffacc528da
Parents: 029a305
Author: mjsax <mj...@apache.org>
Authored: Sun Apr 10 14:28:24 2016 +0200
Committer: mjsax <mj...@apache.org>
Committed: Sun Apr 10 14:31:48 2016 +0200
----------------------------------------------------------------------
_posts/2012-08-21-release02.html | 19 --
_posts/2012-10-15-icde2013.html | 18 --
_posts/2012-11-12-btw2013demo.html | 15 --
_posts/2012-11-21-previewICDE2013.html | 12 --
_posts/2013-03-27-www-demo-paper.html | 14 --
_posts/2013-10-21-cikm2013-paper.md | 49 -----
.../2013-12-13-humboldt-innovation-award.html | 20 --
_posts/2014-01-10-stratosphere-hadoop-summit.md | 10 -
_posts/2014-01-12-0.4-migration-guide.md | 90 ---------
_posts/2014-01-13-stratosphere-release-0.4.md | 75 -------
...4-01-26-optimizer_plan_visualization_tool.md | 22 ---
_posts/2014-01-28-querying_mongodb.md | 110 -----------
...02-18-amazon-elastic-mapreduce-cloud-yarn.md | 194 -------------------
...4-stratosphere-google-summer-of-code-2014.md | 16 --
...-04-16-stratosphere-goes-apache-incubator.md | 11 --
_posts/2014-05-31-release-0.5.md | 94 ---------
_posts/2014-11-18-hadoop-compatibility.md | 2 +-
_posts/2015-02-04-january-in-flink.md | 8 +-
_posts/2015-02-09-streaming-example.md | 12 +-
_posts/2015-03-02-february-2015-in-flink.md | 6 +-
...13-peeking-into-Apache-Flinks-Engine-Room.md | 6 +-
_posts/2015-04-07-march-in-flink.md | 21 +-
_posts/2015-04-13-release-0.9.0-milestone1.md | 8 +-
_posts/2015-05-14-Community-update-April.md | 13 +-
_posts/2015-09-03-flink-forward.md | 11 +-
_posts/2015-09-16-off-heap-memory.md | 2 +-
_posts/2015-12-11-storm-compatibility.md | 2 +-
_posts/2015-12-18-a-year-in-review.md | 4 +-
28 files changed, 45 insertions(+), 819 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2012-08-21-release02.html
----------------------------------------------------------------------
diff --git a/_posts/2012-08-21-release02.html b/_posts/2012-08-21-release02.html
deleted file mode 100644
index a7e3a77..0000000
--- a/_posts/2012-08-21-release02.html
+++ /dev/null
@@ -1,19 +0,0 @@
----
-layout: post
-title: 'Version 0.2 Released'
-date: 2012-08-21 14:57:18
-categories: news
----
-
-
-
-<p>We are happy to announce that version 0.2 of the Stratosphere System has been released. It has a lot of performance improvements as well as a bunch of exciting new features like:</p>
-<ul>
-<li>The new Sopremo Algebra Layer and the Meteor Scripting Language</li>
-<li>The whole new tuple data model for the PACT API</li>
-<li>Fault tolerance through local checkpoints</li>
-<li>A ton of performance improvements on all layers</li>
-<li>Support for plug-ins on the data flow channel layer</li>
-<li>Many new library classes (for example new Input-/Output-Formats)</li>
-</ul>
-<p>For a complete list of new features, check out the <a href="https://stratosphere.eu/wiki/doku.php/wiki:changesrelease0.2">change log</a>.</p>
\ No newline at end of file
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2012-10-15-icde2013.html
----------------------------------------------------------------------
diff --git a/_posts/2012-10-15-icde2013.html b/_posts/2012-10-15-icde2013.html
deleted file mode 100644
index 76e2cf6..0000000
--- a/_posts/2012-10-15-icde2013.html
+++ /dev/null
@@ -1,18 +0,0 @@
----
-layout: post
-title: 'Stratosphere Demo Accepted for ICDE 2013'
-date: 2012-10-15 14:57:18
-categories: news
----
-
-
- <p>Our demo submission<br />
-<strong><cite>"Peeking into the Optimization of Data Flow Programs with MapReduce-style UDFs"</cite></strong><br />
-has been accepted for ICDE 2013 in Brisbane, Australia.<br />
-The demo illustrates the contributions of our VLDB 2012 paper <cite>"Opening the Black Boxes in Data Flow Optimization"</cite> <a href="{{ site.baseurl }}/assets/papers/optimizationOfDataFlowsWithUDFs_13.pdf">[PDF]</a> and <a href="{{ site.baseurl }}/assets/papers/optimizationOfDataFlowsWithUDFs_poster_13.pdf">[Poster PDF]</a>.</p>
-<p>Visit our poster, enjoy the demo, and talk to us if you are going to attend ICDE 2013.</p>
-<p><strong>Abstract:</strong><br />
-Data flows are a popular abstraction to define data-intensive processing tasks. In order to support a wide range of use cases, many data processing systems feature MapReduce-style user-defined functions (UDFs). In contrast to UDFs as known from relational DBMS, MapReduce-style UDFs have less strict templates. These templates do not alone provide all the information needed to decide whether they can be reordered with relational operators and other UDFs. However, it is well-known that reordering operators such as filters, joins, and aggregations can yield runtime improvements by orders of magnitude.<br />
-We demonstrate an optimizer for data flows that is able to reorder operators with MapReduce-style UDFs written in an imperative language. Our approach leverages static code analysis to extract information from UDFs which is used to reason about the reorderbility of UDF operators. This information is sufficient to enumerate a large fraction of the search space covered by conventional RDBMS optimizers including filter and aggregation push-down, bushy join orders, and choice of physical execution strategies based on interesting properties.<br />
-We demonstrate our optimizer and a job submission client that allows users to peek step-by-step into each phase of the optimization process: the static code analysis of UDFs, the enumeration of reordered candidate data flows, the generation of physical execution plans, and their parallel execution. For the demonstration, we provide a selection of relational and non-relational data flow programs which highlight the salient features of our approach.</p>
-
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2012-11-12-btw2013demo.html
----------------------------------------------------------------------
diff --git a/_posts/2012-11-12-btw2013demo.html b/_posts/2012-11-12-btw2013demo.html
deleted file mode 100644
index 92b35c9..0000000
--- a/_posts/2012-11-12-btw2013demo.html
+++ /dev/null
@@ -1,15 +0,0 @@
----
-layout: post
-title: 'Stratosphere Demo Paper Accepted for BTW 2013'
-date: 2012-11-12 14:57:18
-categories: news
----
-
- <p>Our demo submission<br />
-<strong><cite>"Applying Stratosphere for Big Data Analytics"</cite></strong><br />
-has been accepted for BTW 2013 in Magdeburg, Germany.<br />
-The demo focuses on Stratosphere's query language Meteor, which has been presented in our paper <cite>"Meteor/Sopremo: An Extensible Query Language and Operator Model"</cite> <a href="{{ site.baseurl }}/assets/papers/Sopremo_Meteor BigData.pdf">[pdf]</a> at the BigData workshop associated with VLDB 2012 in Istanbul.</p>
-<p>Visit our demo, and talk to us if you are going to attend BTW 2013.</p>
-<p><strong>Abstract:</strong><br />
-Analyzing big data sets as they occur in modern business and science applications requires query languages that allow for the specification of complex data processing tasks. Moreover, these ideally declarative query specifications have to be optimized, parallelized and scheduled for processing on massively parallel data processing platforms. This paper demonstrates the application of Stratosphere to different kinds of Big Data Analytics tasks. Using examples from different application domains, we show how to formulate analytical tasks as Meteor queries and execute them with Stratosphere. These examples include data cleansing and information extraction tasks, and a correlation analysis of microblogging and stock trade volume data that we describe in detail in this paper.</p>
-
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2012-11-21-previewICDE2013.html
----------------------------------------------------------------------
diff --git a/_posts/2012-11-21-previewICDE2013.html b/_posts/2012-11-21-previewICDE2013.html
deleted file mode 100644
index f839a1b..0000000
--- a/_posts/2012-11-21-previewICDE2013.html
+++ /dev/null
@@ -1,12 +0,0 @@
----
-layout: post
-title: 'ICDE 2013 Demo Preview'
-date: 2012-11-21 14:57:18
-categories: news
----
-
-
- <p>This is a preview of our demo that will be presented at ICDE 2013 in Brisbane.<br />
-The demo shows how static code analysis can be leveraged to reordered UDF operators in data flow programs.</p>
-<p>Detailed information can be found in our papers which are available on the <a href="{{ site.baseurl }}/publications">publication</a> page.</p>
-<p><iframe width="420" height="315" src="http://www.youtube.com/embed/ZYwCMgPXFVE" frameborder="0" allowfullscreen></iframe></p>
\ No newline at end of file
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2013-03-27-www-demo-paper.html
----------------------------------------------------------------------
diff --git a/_posts/2013-03-27-www-demo-paper.html b/_posts/2013-03-27-www-demo-paper.html
deleted file mode 100644
index 750bd58..0000000
--- a/_posts/2013-03-27-www-demo-paper.html
+++ /dev/null
@@ -1,14 +0,0 @@
----
-layout: post
-title: 'Demo Paper "Large-Scale Social-Media Analytics on Stratosphere" Accepted at WWW 2013'
-date: 2013-03-27 14:57:18
-categories: news
----
-
- <p>Our demo submission<br />
-<strong><cite>"Large-Scale Social-Media Analytics on Stratosphere"</cite></strong><br />
-by Christoph Boden, Marcel Karnstedt, Miriam Fernandez and Volker Markl<br />
-has been accepted for WWW 2013 in Rio de Janeiro, Brazil.</p>
-<p>Visit our demo, and talk to us if you are attending WWW 2013.</p>
-<p><strong>Abstract:</strong><br />
-The importance of social-media platforms and online communities - in business as well as public context - is more and more acknowledged and appreciated by industry and researchers alike. Consequently, a wide range of analytics has been proposed to understand, steer, and exploit the mechanics and laws driving their functionality and creating the resulting benefits. However, analysts usually face significant problems in scaling existing and novel approaches to match the data volume and size of modern online communities. In this work, we propose and demonstrate the usage of the massively parallel data prossesing system Stratosphere, based on second order functions as an extended notion of the MapReduce paradigm, to provide a new level of scalability to such social-media analytics. Based on the popular example of role analysis, we present and illustrate how this massively parallel approach can be leveraged to scale out complex data-mining tasks, while providing a programming approach th
at eases the formulation of complete analytical workflows.</p>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2013-10-21-cikm2013-paper.md
----------------------------------------------------------------------
diff --git a/_posts/2013-10-21-cikm2013-paper.md b/_posts/2013-10-21-cikm2013-paper.md
deleted file mode 100644
index 0fd506f..0000000
--- a/_posts/2013-10-21-cikm2013-paper.md
+++ /dev/null
@@ -1,49 +0,0 @@
----
-layout: post
-title: 'Paper "All Roads Lead to Rome: Optimistic Recovery for Distributed
-Iterative Data Processing" accepted at CIKM 2013'
-date: 2013-10-21 9:57:18
-categories: news
----
-
-Our paper "“All Roads Lead to Rome:” Optimistic Recovery for Distributed
-Iterative Data Processing" authored by Sebastian Schelter, Kostas
-Tzoumas, Stephan Ewen and Volker Markl has been accepted accepted at the
-ACM International Conference on Information and Knowledge Management
-(CIKM 2013) in San Francisco.
-
-**Abstract**
-
-Executing data-parallel iterative algorithms on large datasets is
-crucial for many advanced analytical applications in the fields of data
-mining and machine learning. Current systems for executing iterative
-tasks in large clusters typically achieve fault tolerance through
-rollback recovery. The principle behind this pessimistic approach is to
-periodically checkpoint the algorithm state. Upon failure, the system
-restores a consistent state from a previously written checkpoint and
-resumes execution from that point.
-
-We propose an optimistic recovery mechanism using algorithmic
-compensations. Our method leverages the robust, self-correcting nature
-of a large class of fixpoint algorithms used in data mining and machine
-learning, which converge to the correct solution from various
-intermediate consistent states. In the case of a failure, we apply a
-user-defined compensate function that algorithmically creates such a
-consistent state, instead of rolling back to a previous checkpointed
-state. Our optimistic recovery does not checkpoint any state and hence
-achieves optimal failure-free performance with respect to the overhead
-necessary for guaranteeing fault tolerance. We illustrate the
-applicability of this approach for three wide classes of problems.
-Furthermore, we show how to implement the proposed optimistic recovery
-mechanism in a data flow system. Similar to the Combine operator in
-MapReduce, our proposed functionality is optional and can be applied to
-increase performance without changing the semantics of programs. In an
-experimental evaluation on large datasets, we show that our proposed
-approach provides optimal failure-free performance. In the absence of
-failures our optimistic scheme is able to outperform a pessimistic
-approach by a factor of two to five. In presence of failures, our
-approach provides fast recovery and outperforms pessimistic approaches
-in the majority of cases.
-
-<a href="{{ site.baseurl }}/assets/papers/optimistic.pdf">Download the paper [PDF]</a>
-
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2013-12-13-humboldt-innovation-award.html
----------------------------------------------------------------------
diff --git a/_posts/2013-12-13-humboldt-innovation-award.html b/_posts/2013-12-13-humboldt-innovation-award.html
deleted file mode 100644
index 9b88257..0000000
--- a/_posts/2013-12-13-humboldt-innovation-award.html
+++ /dev/null
@@ -1,20 +0,0 @@
----
-layout: post
-title: 'Stratosphere wins award at Humboldt Innovation Competition "Big Data: Research meets Startups"'
-date: 2013-12-13 14:57:18
-categories: news
----
-
-
- <p> Stratosphere won the second place in
- the <a href="http://www.humboldt-innovation.de/de/newsdetail/News/View/Forum%2BJunge%2BSpitzenforscher%2BBIG%2BData%2B%2BResearch%2Bmeets%2BStartups-123.html">competition</a>
- organized by Humboldt Innovation on "Big Data: Research meets
- Startups," where several research projects were evaluated by a
- panel of experts from the Berlin startup ecosystem. The award
- includes a monetary prize of 10,000 euros.
- </p>
-
- <p>We are extremely excited about this award, as it further
- showcases the relevance of the Stratosphere platform and Big Data
- technology in general for the technology startup world.
- </p>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2014-01-10-stratosphere-hadoop-summit.md
----------------------------------------------------------------------
diff --git a/_posts/2014-01-10-stratosphere-hadoop-summit.md b/_posts/2014-01-10-stratosphere-hadoop-summit.md
deleted file mode 100644
index bf0c734..0000000
--- a/_posts/2014-01-10-stratosphere-hadoop-summit.md
+++ /dev/null
@@ -1,10 +0,0 @@
----
-layout: post
-title: 'Stratosphere got accepted to the Hadoop Summit Europe in Amsterdam'
-date: 2014-01-10 10:57:18
-categories: news
----
-
-
-The Stratosphere team is proud to announce that it is going to present at the [Hadoop Summit 2014 in Amsterdam](http://hadoopsummit.org/amsterdam/) on April 2-3. Our talk "Big Data looks tiny from Stratosphere" is part of the "Future of Hadoop" Track. The talk abstract already made it into the top 5 in the [Community Vote](https://hadoopsummit.uservoice.com/forums/196822-future-of-apache-hadoop/filters/top) that took place by the end of last year.
-
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2014-01-12-0.4-migration-guide.md
----------------------------------------------------------------------
diff --git a/_posts/2014-01-12-0.4-migration-guide.md b/_posts/2014-01-12-0.4-migration-guide.md
deleted file mode 100644
index 995fd5b..0000000
--- a/_posts/2014-01-12-0.4-migration-guide.md
+++ /dev/null
@@ -1,90 +0,0 @@
----
-layout: post
-title: 'Stratosphere Version 0.4 Migration Guide'
-date: 2014-01-12 19:57:18
-categories: news
----
-
-This guide is intended to help users of previous Stratosphere versions to migrate their programs to the new API of v0.4.
-
-Version `0.4-rc1`, `0.4` and all newer versions have the new API. If you want to have the most recent version before the code change, please set the version to `0.4-alpha.3-SNAPSHOT`. (Note that the `0.4-alpha` versions are only available in the snapshot repository).
-
-#### Maven Dependencies
-Since we also reorganized the Maven project structure, existing programs need to update the Maven dependencies to `stratosphere-java` (and `stratosphere-clients`, for examples and executors).
-
-The typical set of Maven dependencies for Stratosphere Java programs is:
-
-```diff
- <groupId>eu.stratosphere</groupId>
-- <artifactId>pact-common</artifactId>
-- <version>0.4-SNAPSHOT</version>
-+ <artifactId>stratosphere-java</artifactId>
-+ <version>0.4</version>
-
-- <artifactId>pact-clients</artifactId>
-- <version>0.4-SNAPSHOT</version>
-+ <artifactId>stratosphere-clients</artifactId>
-+ <version>0.4</version>
-```
-
-
-#### Renamed classes
-
-We renamed many of the most commonly used classes to make their names more intuitive:
-
-<table class="table table-striped">
- <thead>
- <tr>
- <th>Old Name (before <code>0.4</code>)</th>
- <th>New Name (<code>0.4</code> and after)</th>
- </tr>
- </thead>
- <tbody>
- <tr>
- <td>Contract</td>
- <td>Operator</td>
- </tr>
- <tr>
- <td>MatchContract</td>
- <td>JoinOperator</td>
- </tr>
-
- <tr>
- <td>[Map, Reduce, ...]Stub</td>
- <td>[Map, Reduce, ...]Function</td>
- </tr>
- <tr>
- <td>MatchStub</td>
- <td>JoinFunction</td>
- </tr>
- <tr>
- <td>Pact[Integer, Double, ...]</td>
- <td>IntValue, DoubleValue, ...</td>
- </tr>
- <tr>
- <td>PactRecord</td>
- <td>Record</td>
- </tr>
- <tr>
- <td>PlanAssembler</td>
- <td>Program</td>
- </tr>
- <tr>
- <td>PlanAssemblerDescription</td>
- <td>ProgramDescription</td>
- </tr>
- <tr>
- <td>RecordOutputFormat</td>
- <td>CsvOutputFormat</td>
- </tr>
- </tbody>
-</table>
-
-
-Package names have been adapted as well.
-For a complete overview of the renamings, have a look at [issue #257 on GitHub](https://github.com/stratosphere/stratosphere/issues/257).
-
-
-We suggest for Eclipse user adjust the programs as follows: Delete all old Stratosphere imports, then rename the the classes (`PactRecord` to `Record` and so on). Finally, use the “Organize Imports” function (`CTRL+SHIFT+O`) to choose the right imports. The names should be unique so always pick the classes that are in the `eu.stratosphere` package.
-
-Please contact us in the comments below, on the mailing list or on GitHub if you have any issues migrating to the latest Stratosphere release.
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2014-01-13-stratosphere-release-0.4.md
----------------------------------------------------------------------
diff --git a/_posts/2014-01-13-stratosphere-release-0.4.md b/_posts/2014-01-13-stratosphere-release-0.4.md
deleted file mode 100644
index 22907c0..0000000
--- a/_posts/2014-01-13-stratosphere-release-0.4.md
+++ /dev/null
@@ -1,75 +0,0 @@
----
-layout: post
-title: 'Stratosphere 0.4 Released'
-date: 2014-01-13 20:57:18
-categories: news
----
-
-We are pleased to announce that version 0.4 of the Stratosphere system has been released.
-
-Our team has been working hard during the last few months to create an improved and stable Stratosphere version. The new version comes with many new features, usability and performance improvements in all levels, including a new Scala API for the concise specification of programs, a Pregel-like API, support for Yarn clusters, and major performance improvements. The system features now first-class support for iterative programs and thus covers traditional analytical use cases as well as data mining and graph processing use cases with great performance.
-
-In the course of the transition from v0.2 to v0.4 of the system, we have changed pre-existing APIs based on valuable user feedback. This means that, in the interest of easier programming, we have broken backwards compatibility and existing jobs must be adapted, as described in [the migration guide]({{ site.baseurl }}/blog/tutorial/2014/01/12/0.4-migration-guide.html).
-
-This article will guide you through the feature list of the new release.
-
-### Scala Programming Interface
-The new Stratosphere version comes with a new programming API in Scala that supports very fluent and efficient programs that can be expressed with very few lines of code. The API uses Scala's native type system (no special boxed data types) and supports grouping and joining on types beyond key/value pairs. We use code analysis and code generation to transform Scala's data model to the Stratosphere runtime. Stratosphere Scala programs are optimized before execution by Stratosphere's optimizer just like Stratosphere Java programs.
-
-Learn more about the Scala API at the [Scala Programming Guide]({{ site.baseurl }}/docs/0.4/programming_guides/scala.html)
-
-### Iterations
-Stratosphere v0.4 introduces deep support for iterative algorithms, required by a large class of advanced analysis algorithms. In contrast to most other systems, "looping over the data" is done inside the system's runtime, rather than in the client. Individual iterations (supersteps) can be as fast as sub-second times. Loop-invariant data is automatically cached in memory.
-
-We support a special form of iterations called “delta iterations” that selectively modify only some elements of intermediate solution in each iteration. These are applicable to a variety of applications, e.g., use cases of Apache Giraph. We have observed speedups of 70x when using delta iterations instead of regular iterations.
-
-Read more about the new iteration feature in [the documentation]({{ site.baseurl }}/docs/0.4/programming_guides/iterations.html)
-
-### Hadoop YARN Support
-YARN (Yet Another Resource Negotiator) is the major new feature of the recently announced [Hadoop 2.2](http://hadoop.apache.org/docs/r2.2.0/). It allows to share existing clusters with different runtimes. So you can run MapReduce alongside Storm and others. With the 0.4 release, Stratosphere supports YARN.
-Follow [our guide]({{ site.baseurl }}/docs/0.4/setup/yarn.html) on how to start a Stratosphere YARN session.
-
-### Improved Scripting Language Meteor
-The high-level language Meteor now natively serializes JSON trees for greater performance and offers additional operators and file formats. We greatly empowered the user to write crispier scripts by adding second-order functions, multi-output operators, and other syntactical sugar. For developers of Meteor packages, the API is much more comprehensive and allows to define custom data types that can be easily embedded in JSON trees through ad-hoc byte code generation.
-
-### Spargel: Pregel Inspired Graph Processing
-Spargel is a vertex-centric API similar to the interface proposed in Google's Pregel paper and implemented in Apache Giraph. Spargel is implemented in 500 lines of code (including comments) on top of Stratosphere's delta iterations feature. This confirms the flexibility of Stratosphere's architecture.
-
-### Web Frontend
-Using the new web frontend, you can monitor the progress of Stratosphere jobs. For finished jobs, the frontend shows a breakdown of the execution times for each operator. The webclient also visualizes the execution strategies chosen by the optimizer.
-
-### Accumulators
-Stratosphere's accumulators allow program developers to compute simple statistics, such as counts, sums, min/max values, or histograms, as a side effect of the processing functions. An example application would be to count the total number of records/tuples processed by a function. Stratosphere will not launch additional tasks (reducers), but will compute the number "on the fly" as a side-product of the functions application to the data. The concept is similar to Hadoop's counters, but supports more types of aggregation.
-
-### Refactored APIs
-Based on valuable user feedback, we refactored the Java programming interface to make it more intuitive and easier to use. The basic concepts are still the same, however the naming of most interfaces changed and the structure of the code was adapted. When updating to the 0.4 release you will need to adapt your jobs and dependencies. A previous blog post has a guide to the necessary changes to adapt programs to Stratosphere 0.4.
-
-### Local Debugging
-You can now test and debug Stratosphere jobs locally. The [LocalExecutor]({{ site.baseurl }}/docs/0.4/program_execution/local_executor.html) allows to execute Stratosphere Jobs from IDE's. The same code that runs on clusters also runs in a single JVM multi-threaded. The mode supports full debugging capabilities known from regular applications (placing breakpoints and stepping through the program's functions). An advanced mode supports simulating fully distributed operation locally.
-
-### Miscellaneous
-
-* The configuration of Stratosphere has been changed to YAML
-* HBase support
-* JDBC Input format
-* Improved Windows Compatibility: Batch-files to start Stratosphere on Windows and all unit tests passing on Windows.
-* Stratosphere is available in Maven Central and Sonatype Snapshot Repository
-* Improved build system that supports different Hadoop versions using Maven profiles
-* Maven Archetypes for Stratosphere Jobs.
-* Stability and Usability improvements with many bug fixes.
-
-
-### Download and get started with Stratosphere v0.4
-There are several options for getting started with Stratosphere.
-
-* Download it on the [download page]({{ site.baseurl }}/downloads)
-* Start your program with the [Quick-start guides]({{ site.baseurl }}/quickstart/).
-* Complete [documentation and set-up guides]({{ site.baseurl }}/docs/0.4/)
-
-### Tell us what you think!
-Are you using, or planning to use Stratosphere? Sign up in our [mailing list](https://groups.google.com/forum/#!forum/stratosphere-dev) and drop us a line.
-
-Have you found a bug? [Post an issue](https://github.com/stratosphere/stratosphere) on GitHub.
-
-Follow us on [Twitter](https://twitter.com/stratosphere_eu) and [GitHub](https://github.com/stratosphere/stratosphere) to stay in touch with the latest news!
-
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2014-01-26-optimizer_plan_visualization_tool.md
----------------------------------------------------------------------
diff --git a/_posts/2014-01-26-optimizer_plan_visualization_tool.md b/_posts/2014-01-26-optimizer_plan_visualization_tool.md
deleted file mode 100644
index 93da991..0000000
--- a/_posts/2014-01-26-optimizer_plan_visualization_tool.md
+++ /dev/null
@@ -1,22 +0,0 @@
----
-layout: post
-title: "Optimizer Plan Visualization Tool"
-date: 2014-01-26 9:00:00
-categories: news
----
-
-Stratosphere's hybrid approach combines **MapReduce** and **MPP database** techniques. One central part of this approach is to have a **separation between the programming (API) and the way programs are executed** *(execution plans)*. The **compiler/optimizer** decides the details concerning caching or when to partition/broadcast with a holistic view of the program. The same program may actually be executed differently in different scenarios (input data of different sizes, different number of machines).
-
-**If you want to know how exactly the system executes your program, you can find it out in two ways**:
-
- 1. The **browser-based webclient UI**, which takes programs packaged into JARs and draws the execution plan as a visual data flow (check out the [documentation](http://stratosphere.eu/docs/0.4/program_execution/web_interface.html) for details).
-
- 2. For **programs using the [Local- ](http://stratosphere.eu/docs/0.4/program_execution/local_executor.html) or [Remote Executor] (http://stratosphere.eu/docs/0.4/program_execution/remote_executor.html)**, you can get the optimizer plan using the method `LocalExecutor.optimizerPlanAsJSON(plan)`. The **resulting JSON** string describes the execution strategies chosen by the optimizer. Naturally, you do not want to parse that yourself, especially for longer programs.
-
- The builds *0.5-SNAPSHOT* and later come with a **tool that visualizes the JSON** string. It is a standalone version of the webclient's visualization, packed as an html document `tools/planVisualizer.html`.
-
- If you open it in a browser (for example `chromium-browser tools/planVisualizer.html`) it shows a text area where you can paste the JSON string and it renders that string as a dataflow plan (assuming it was a valid JSON string and plan). The pictures below show how that looks for the [included sample program](https://github.com/stratosphere/stratosphere/blob/release-0.4/stratosphere-examples/stratosphere-java-examples/src/main/java/eu/stratosphere/example/java/record/connectedcomponents/WorksetConnectedComponents.java?source=cc) that uses delta iterations to compute the connected components of a graph.
-
-<img src="{{ site.baseurl }}/img/blog/plan_visualizer1.png" style="width:100%;">
-
-<img src="{{ site.baseurl }}/img/blog/plan_visualizer2.png" style="width:100%;">
\ No newline at end of file
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2014-01-28-querying_mongodb.md
----------------------------------------------------------------------
diff --git a/_posts/2014-01-28-querying_mongodb.md b/_posts/2014-01-28-querying_mongodb.md
deleted file mode 100644
index 868abe4..0000000
--- a/_posts/2014-01-28-querying_mongodb.md
+++ /dev/null
@@ -1,110 +0,0 @@
----
-layout: post
-title: "Accessing Data Stored in MongoDB with Stratosphere"
-date: 2014-01-28 9:00:00
-author: "Robert Metzger"
-author-twitter: "rmetzger_"
-categories: news
----
-
-We recently merged a [pull request](https://github.com/stratosphere/stratosphere/pull/437) that allows you to use any existing Hadoop [InputFormat](http://developer.yahoo.com/hadoop/tutorial/module5.html#inputformat) with Stratosphere. So you can now (in the `0.5-SNAPSHOT` and upwards versions) define a Hadoop-based data source:
-
-```java
-HadoopDataSource source = new HadoopDataSource(new TextInputFormat(), new JobConf(), "Input Lines");
-TextInputFormat.addInputPath(source.getJobConf(), new Path(dataInput));
-```
-
-We describe in the following article how to access data stored in [MongoDB](http://www.mongodb.org/) with Stratosphere. This allows users to join data from multiple sources (e.g. MonogDB and HDFS) or perform machine learning with the documents stored in MongoDB.
-
-The approach here is to use the `MongoInputFormat` that was developed for Apache Hadoop but now also runs with Stratosphere.
-
-```java
-JobConf conf = new JobConf();
-conf.set("mongo.input.uri","mongodb://localhost:27017/enron_mail.messages");
-HadoopDataSource src = new HadoopDataSource(new MongoInputFormat(), conf, "Read from Mongodb", new WritableWrapperConverter());
-```
-
-### Example Program
-The example program reads data from the [enron dataset](http://www.cs.cmu.edu/~enron/) that contains about 500k internal e-mails. The data is stored in MongoDB and the Stratosphere program counts the number of e-mails per day.
-
-The complete code of this sample program is available on [GitHub](https://github.com/stratosphere/stratosphere-mongodb-example).
-
-#### Prepare MongoDB and the Data
-
- - Install MongoDB
- - Download the enron dataset from [their website](http://mongodb-enron-email.s3-website-us-east-1.amazonaws.com/).
- - Unpack and load it
-
- ```bash
- bunzip2 enron_mongo.tar.bz2
- tar xvf enron_mongo.tar
- mongorestore dump/enron_mail/messages.bson
- ```
-
-We used [Robomongo](http://robomongo.org/) to visually examine the dataset stored in MongoDB.
-
-<img src="{{ site.baseurl }}/img/blog/robomongo.png" style="width:90%;margin:15px">
-
-
-#### Build `MongoInputFormat`
-
-MongoDB offers an InputFormat for Hadoop on their [GitHub page](https://github.com/mongodb/mongo-hadoop). The code is not available in any Maven repository, so we have to build the jar file on our own.
-
-- Check out the repository
-
-```
-git clone https://github.com/mongodb/mongo-hadoop.git
-cd mongo-hadoop
-```
-
-- Set the appropriate Hadoop version in the `build.sbt`, we used `1.1`.
-
-```bash
-hadoopRelease in ThisBuild := "1.1"
-```
-- Build the input format
-
-```bash
-./sbt package
-```
-
-The jar-file is now located in `core/target`.
-
-#### The Stratosphere Program
-
-Now we have everything prepared to run the Stratosphere program. I only ran it on my local computer, out of Eclipse. To do that, check out the code ...
-
-```bash
-git clone https://github.com/stratosphere/stratosphere-mongodb-example.git
-```
-
-... and import it as a Maven project into your Eclipse. You have to manually add the previously built mongo-hadoop jar-file as a dependency.
-You can now press the "Run" button and see how Stratosphere executes the little program. It was running for about 8 seconds on the 1.5 GB dataset.
-
-
-The result (located in `/tmp/enronCountByDay`) now looks like this.
-
-```
-11,Fri Sep 26 10:00:00 CEST 1997
-154,Tue Jun 29 10:56:00 CEST 1999
-292,Tue Aug 10 12:11:00 CEST 1999
-185,Thu Aug 12 18:35:00 CEST 1999
-26,Fri Mar 19 12:33:00 CET 1999
-```
-
-There is one thing left I want to point out here. MongoDB represents objects stored in the database as JSON-documents. Since Stratosphere's standard types do not support JSON documents, I was using the `WritableWrapper` here. This wrapper allows to use any Hadoop datatype with Stratosphere.
-
-The following code example shows how the JSON-documents are accessed in Stratosphere.
-
-```java
-public void map(Record record, Collector<Record> out) throws Exception {
- Writable valWr = record.getField(1, WritableWrapper.class).value();
- BSONWritable value = (BSONWritable) valWr;
- Object headers = value.getDoc().get("headers");
- BasicDBObject headerOb = (BasicDBObject) headers;
- String date = (String) headerOb.get("Date");
- // further date processing
-}
-```
-
-Please use the comments if you have questions or if you want to showcase your own MongoDB-Stratosphere integration.
\ No newline at end of file
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2014-02-18-amazon-elastic-mapreduce-cloud-yarn.md
----------------------------------------------------------------------
diff --git a/_posts/2014-02-18-amazon-elastic-mapreduce-cloud-yarn.md b/_posts/2014-02-18-amazon-elastic-mapreduce-cloud-yarn.md
deleted file mode 100644
index 2b71c59..0000000
--- a/_posts/2014-02-18-amazon-elastic-mapreduce-cloud-yarn.md
+++ /dev/null
@@ -1,194 +0,0 @@
----
-layout: post
-title: 'Use Stratosphere with Amazon Elastic MapReduce'
-date: 2014-02-18 19:57:18
-author: "Robert Metzger"
-author-twitter: "rmetzger_"
-categories: news
----
-
-<div class="lead">Get started with Stratosphere within 10 minutes using Amazon Elastic MapReduce.</div>
-
-This step-by-step tutorial will guide you through the setup of Stratosphere using Amazon Elastic MapReduce.
-
-### Background
-[Amazon Elastic MapReduce](http://aws.amazon.com/elasticmapreduce/) (Amazon EMR) is part of Amazon Web services. EMR allows to create Hadoop clusters that analyze data stored in Amazon S3 (AWS' cloud storage). Stratosphere runs on top of Hadoop using the [recently](http://hadoop.apache.org/docs/r2.2.0/hadoop-project-dist/hadoop-common/releasenotes.html) released cluster resource manager [YARN](http://hadoop.apache.org/docs/current2/hadoop-yarn/hadoop-yarn-site/YARN.html). YARN allows to use many different data analysis tools in your cluster side by side. Tools that run with YARN are, for example [Apache Giraph](https://giraph.apache.org/), [Spark](http://spark.incubator.apache.org/) or [HBase](http://hortonworks.com/blog/introducing-hoya-hbase-on-yarn/). Stratosphere also [runs on YARN]({{site.baseurl}}/docs/0.4/setup/yarn.html) and that's the approach for this tutorial.
-
-### 1. Step: Login to AWS and prepare secure access
-
-* Log in to the [AWS Console](https://console.aws.amazon.com/console/home)
-
-You need to have SSH keys to access the Hadoop master node. If you do not have keys for your computer, generate them:
-
-<div class="row" style="padding-top:15px">
- <div class="col-md-6">
-<a data-lightbox="inputs" href="{{site.baseurl}}/img/blog/emr-security.png" data-lightbox="example-1"><img class="img-responsive" src="{{site.baseurl}}/img/blog/emr-security.png" /></a>
- </div>
- <div class="col-md-6">
- <ul>
- <li>Select <a href="https://console.aws.amazon.com/ec2/v2/home">EC2</a> and click on "Key Pairs" in the "NETWORK & SECURITY" section.</li>
- <li>Click on "Create Key Pair" and give it a name</li>
- <li>After pressing "Yes" it will download a .pem file.</li>
- <li>Change the permissions of the .pem file</li>
-{% highlight bash %}
-chmod og-rwx ~/work-laptop.pem
-{% endhighlight %}
- </ul>
- </div>
-</div>
-
-### 2. Step: Create your Hadoop Cluster in the cloud
-
-* Select [Elastic MapReduce](https://console.aws.amazon.com/elasticmapreduce/vnext/) from the AWS console
-* Click the blue "Create cluster" button.
-
-<div class="row" style="padding-top:15px">
- <div class="col-md-6">
-<a data-lightbox="inputs" href="{{site.baseurl}}/img/blog/emr-hadoopversion.png" data-lightbox="example-1"><img class="img-responsive" src="{{site.baseurl}}/img/blog/emr-hadoopversion.png" /></a>
- </div>
- <div class="col-md-6">
- <ul>
- <li>Choose a Cluster name</li>
- <li>You can let the other settings remain unchanged (termination protection, logging, debugging)</li>
- <li>For the Hadoop distribution, it is very important to choose one with YARN support. We use <b>3.0.3 (Hadoop 2.2.0)</b> (the minor version might change over time)</li>
- <li>Remove all applications to be installed (unless you want to use them)</li>
- <li>Choose the instance types you want to start. Stratosphere runs fine with m1.large instances. Core and Task instances both run Stratosphere, but only core instances contain HDFS data nodes.</li>
- <li>Choose the <b>EC2 key pair</b> you've created in the previous step!</li>
- </ul>
- </div>
-</div>
-
-* Thats it! You can now press the "Create cluster" button at the end of the form to boot it!
-
-### 3. Step: Launch Stratosphere
-
-You might need to wait a few minutes until Amazon started your cluster. (You can monitor the progress of the instances in EC2). Use the refresh button in the top right corner.
-
-You see that the master is up if the field <b>Master public DNS</b> contains a value (first line), connect to it using SSH.
-
-{% highlight bash %}
-ssh hadoop@<your master public DNS> -i <path to your .pem>
-# for my example, it looks like this:
-ssh hadoop@ec2-54-213-61-105.us-west-2.compute.amazonaws.com -i ~/Downloads/work-laptop.pem
-{% endhighlight %}
-
-
-(Windows users have to follow <a href="http://docs.aws.amazon.com/ElasticMapReduce/latest/DeveloperGuide/emr-connect-master-node-ssh.html">these instructions</a> to SSH into the machine running the master.) </br></br>
-Once connected to the master, download and start Stratosphere for YARN:
-<ul>
- <li>Download and extract Stratosphere-YARN</li>
-{% highlight bash %}
-wget http://stratosphere-bin.s3-website-us-east-1.amazonaws.com/stratosphere-dist-0.5-SNAPSHOT-yarn.tar.gz
-# extract it
-tar xvzf stratosphere-dist-0.5-SNAPSHOT-yarn.tar.gz
-{% endhighlight %}
- <li>Start Stratosphere in the cluster using Hadoop YARN</li>
-
-{% highlight bash %}
-cd stratosphere-yarn-0.5-SNAPSHOT/
-./bin/yarn-session.sh -n 4 -jm 1024 -tm 3000
-{% endhighlight %}
-
-The arguments have the following meaning
- <ul>
- <li><code>-n</code> number of TaskManagers (=workers). This number must not exeed the number of task instances</li>
- <li><code>-jm</code> memory (heapspace) for the JobManager</li>
- <li><code>-tm</code> memory for the TaskManagers</li>
- </ul>
-</ul>
-
-Once the output has changed from
-{% highlight bash %}
-JobManager is now running on N/A:6123
-{% endhighlight %}
-to
-{% highlight bash %}
-JobManager is now running on ip-172-31-13-68.us-west-2.compute.internal:6123
-{% endhighlight %}
-Stratosphere has started the JobManager. It will take a few seconds until the TaskManagers (workers) have connected to the JobManager. To see how many TaskManagers connected, you have to access the JobManager's web interface. Follow the steps below to do that ...
-
-
-
-
-<h3> 4. Step: Launch a Stratosphere Job</h3>
-
-This step shows how to submit and monitor a Stratosphere Job in the Amazon Cloud.
-
-<ul>
-<li> Open an additional terminal and connect again to the master of your cluster. </li>
-
-We recommend to create a SOCKS-proxy with your SSH that allows you to easily connect into the cluster. (If you've already a VPN setup with EC2, you can probably use that as well.)
-
-{% highlight bash %}
-ssh -D localhost:2001 hadoop@<your master dns name> -i <your pem file>
-{% endhighlight %}
-
-Notice the <code>-D localhost:2001</code> argument: It opens a SOCKS proxy on your computer allowing any application to use it to communicate through the proxy via an SSH tunnel to the master node. This allows you to access all services in your EMR cluster, such as the HDFS NameNode or the YARN web interface.
-
-<li>Configure a browser to use the SOCKS proxy. Open a browser with SOCKS proxy support (such as Firefox). Ideally, do not use your primary browser for this, since ALL traffic will be routed through Amazon.</li>
-
-<div class="row" style="padding-top:15px">
- <div class="col-md-6">
-<a data-lightbox="inputs" href="{{site.baseurl}}/img/blog/emr-firefoxsettings.png" data-lightbox="example-1"><img class="img-responsive" src="{{site.baseurl}}/img/blog/emr-firefoxsettings.png" /></a>
- </div>
- <div class="col-md-6">
- <ul>
- <li>To configure the SOCKS proxy with Firefox, click on "Edit", "Preferences", choose the "Advanced" tab and press the "Settings ..." button.</li>
- <li>Enter the details of the SOCKS proxy <b>localhost:2001</b>. Choose SOCKS v4.</li>
- <li>Close the settings, your browser is now talking to the master node of your cluster</li>
- </ul>
- </div>
-</div>
-
-</ul>
-
-Since you're connected to the master now, you can open several web interfaces: <br>
-<b>YARN Resource Manager</b>: <code>http://<masterIPAddress>:9026/</code> <br>
-<b>HDFS NameNode</b>: <code>http://<masterIPAddress>:9101/</code>
-
-You find the `masterIPAddress` by entering `ifconfig` into the terminal:
-{% highlight bash %}
-[hadoop@ip-172-31-38-95 ~]$ ifconfig
-eth0 Link encap:Ethernet HWaddr 02:CF:8E:CB:28:B2
- inet addr:172.31.38.95 Bcast:172.31.47.255 Mask:255.255.240.0
- inet6 addr: fe80::cf:8eff:fecb:28b2/64 Scope:Link
- RX bytes:166314967 (158.6 MiB) TX bytes:89319246 (85.1 MiB)
-{% endhighlight %}
-
-**Optional:** If you want to use the hostnames within your Firefox (that also makes the NameNode links work), you have to enable DNS resolution over the SOCKS proxy. Open the Firefox config `about:config` and set `network.proxy.socks_remote_dns` to `true`.
-
-The YARN ResourceManager also allows you to connect to <b>Stratosphere's JobManager web interface</b>. Click the <b>ApplicationMaster</b> link in the "Tracking UI" column.
-
-To run the Wordcount example, you have to upload some sample data.
-{% highlight bash %}
-# download a text
-wget http://www.gnu.org/licenses/gpl.txt
-# upload it to HDFS:
-hadoop fs -copyFromLocal gpl.txt /input
-{% endhighlight %}
-
-To run a Job, enter the following command into the master's command line:
-{% highlight bash %}
-# optional: go to the extracted directory
-cd stratosphere-yarn-0.5-SNAPSHOT/
-# run the wordcount example
-./bin/stratosphere run -w -j examples/stratosphere-java-examples-0.5-SNAPSHOT-WordCount.jar -a 16 hdfs:///input hdfs:///output
-{% endhighlight %}
-
-Make sure that the number of TaskManager's have connected to the JobManager.
-
-Lets go through the command in detail:
-
-* `./bin/stratosphere` is the standard launcher for Stratosphere jobs from the command line
-* The `-w` flag stands for "wait". It is a very useful to track the progress of the job.
-* `-j examples/stratosphere-java-examples-0.5-SNAPSHOT-WordCount.jar` the `-j` command sets the jar file containing the job. If you have you own application, place your Jar-file here.
-* `-a 16 hdfs:///input hdfs:///output` the `-a` command specifies the Job-specific arguments. In this case, the wordcount expects the following input `<numSubStasks> <input> <output>`.
-
-You can monitor the progress of your job in the JobManager webinterface. Once the job has finished (which should be the case after less than 10 seconds), you can analyze it there.
-Inspect the result in HDFS using:
-
-{% highlight bash %}
-hadoop fs -tail /output
-{% endhighlight %}
-
-If you want to shut down the whole cluster in the cloud, use Amazon's webinterface and click on "Terminate cluster". If you just want to stop the YARN session, press CTRL+C in the terminal. The Stratosphere instances will be killed by YARN.
\ No newline at end of file
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2014-02-24-stratosphere-google-summer-of-code-2014.md
----------------------------------------------------------------------
diff --git a/_posts/2014-02-24-stratosphere-google-summer-of-code-2014.md b/_posts/2014-02-24-stratosphere-google-summer-of-code-2014.md
deleted file mode 100644
index f343512..0000000
--- a/_posts/2014-02-24-stratosphere-google-summer-of-code-2014.md
+++ /dev/null
@@ -1,16 +0,0 @@
----
-layout: post
-title: 'Stratosphere got accepted for Google Summer of Code 2014'
-date: 2014-02-24 20:57:18
-categories: news
----
-
-<div class="lead">Students: Apply now for exciting summer projects in the Big Data / Analytics field</div>
-
-We are pleased to announce that Stratosphere got accepted to [Google Summer of Code 2014](http://www.google-melange.com/gsoc/homepage/google/gsoc2014) as a mentoring organization. This means that we will host a bunch of students to conduct projects within Stratosphere over the summer. [Read more on the GSoC manual for students](http://en.flossmanuals.net/GSoCStudentGuide/) and the [official FAQ](http://www.google-melange.com/gsoc/document/show/gsoc_program/google/gsoc2014/help_page). Students can improve their coding skills, learn to work with open-source projects, improve their CV and get a nice paycheck from Google.
-
-If you are an interested student, check out our [idea list](https://github.com/stratosphere/stratosphere/wiki/Google-Summer-of-Code-2014) in the wiki. It contains different projects with varying ranges of difficulty and requirement profiles. Students can also suggest their own projects.
-
-We welcome students to sign up at our [developer mailing list](https://groups.google.com/forum/#!forum/stratosphere-dev) to discuss their ideas.
-Applying students can use our wiki (create a new page) to create a project proposal. We are happy to have a look at it.
-
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2014-04-16-stratosphere-goes-apache-incubator.md
----------------------------------------------------------------------
diff --git a/_posts/2014-04-16-stratosphere-goes-apache-incubator.md b/_posts/2014-04-16-stratosphere-goes-apache-incubator.md
deleted file mode 100644
index 335840d..0000000
--- a/_posts/2014-04-16-stratosphere-goes-apache-incubator.md
+++ /dev/null
@@ -1,11 +0,0 @@
----
-layout: post
-title: 'Stratosphere accepted as Apache Incubator Project'
-date: 2014-04-16 10:00:00
-categories: news
----
-
-We are happy to announce that Stratosphere has been accepted as a project for the [Apache Incubator](https://incubator.apache.org/). The [proposal](https://wiki.apache.org/incubator/StratosphereProposal) has been accepted by the Incubator PMC members earlier this week. The Apache Incubator is the first step in the process of giving a project to the [Apache Software Foundation](http://apache.org). While under incubation, the project will move to the Apache infrastructure and adopt the community-driven development principles of the Apache Foundation. Projects can graduate from incubation to become top-level projects if they show activity, a healthy community dynamic, and releases.
-
-We are glad to have Alan Gates as champion on board, as well as a set of great mentors, including Sean Owen, Ted Dunning, Owen O'Malley, Henry Saputra, and Ashutosh Chauhan. We are confident that we will make this a great open source effort.
-
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2014-05-31-release-0.5.md
----------------------------------------------------------------------
diff --git a/_posts/2014-05-31-release-0.5.md b/_posts/2014-05-31-release-0.5.md
deleted file mode 100644
index 32bfde0..0000000
--- a/_posts/2014-05-31-release-0.5.md
+++ /dev/null
@@ -1,94 +0,0 @@
----
-layout: post
-title: 'Stratosphere version 0.5 available'
-date: 2014-05-31 10:00:00
-categories: news
----
-
-We are happy to announce a new major Stratosphere release, version 0.5. This release adds many new features and improves the interoperability, stability, and performance of the system. The major theme of the release is the completely new Java API that makes it easy to write powerful distributed programs.
-
-The release can be downloaded from the [Stratosphere website] (http://stratosphere.eu/downloads/) and from [GitHub] (https://github.com/stratosphere/stratosphere/releases/tag/release-0.5). All components are available as Apache Maven dependencies, making it simple to include Stratosphere in other projects. The website provides [extensive documentation](http://stratosphere.eu/docs/0.5/) of the system and the new features.
-
-
-
-## Shortlist of new Features
-
-Below is a short list of the most important additions to the Stratosphere system.
-
-#### New Java API
-This release introduces a completely new **data set-centric Java API**. This programming model significantly eases the development of Stratosphere programs, supports flexible use of regular Java classes as data types, and adds many new built-in operators to simplify the writing of powerful programs. The result are programs that need less code, are more readable, interoperate better with existing code, and execute faster.
-
-Take a look at the [examples](http://stratosphere.eu/docs/0.5/programming_guides/examples_java.html) to get a feel for the API.
-
-
-#### General API Improvements
-**Broadcast Variables:** Publish a data set to all instances of another operator. This is handy if the your operator depends on the result of a computation, e.g., filter all values smaller than the average.
-
-**Distributed Cache:** Make (local and HDFS) files locally available on each machine processing a task.
-
-**Iteration Termination Improvements** Iterative algorithms can now terminate based on intermediate data sets, not only through aggregated statistics.
-
-**Collection data sources and sinks:** Speed-up the development and testing of Stratosphere programs by reading data from regular Java collections and inserting back into them.
-
-**JDBC data sources and sinks:** Read data from and write data to relational databases using a JDBC driver.
-
-**Hadoop input format and output format support:** Read and write data with any Hadoop input or output format.
-
-**Support for Avro encoded data:** Read data that has been materialized using Avro.
-
-**Deflate Files:** Stratosphere now transparently reads `.deflate` compressed files.
-
-
-#### Runtime and Optimizer Improvements
-
-**DAG Runtime Streaming:** Detection and resolution of streaming data flow deadlocks in the data flow optimizer.
-
-**Intermediate results across iteration boundaries:** Intermediate results computed outside iterative parts can be used inside iterative parts of the program.
-
-**Stability fixes:** Various stability fixes in both optimizer and runtime.
-
-
-#### Setup & Tooling
-
-**Improved YARN support:** Many improvements based on user-feedback: Packaging, Permissions, Error handling.
-
-**Java 8 compatibility**
-
-
-## Contributors
-
-In total, 26 people have contributed to Stratosphere since the last release. Thank you for making this project possible!
-
-
-* Alexander Alexandrov
-* Jesus Camacho
-* Ufuk Celebi
-* Mikhail Erofeev
-* Stephan Ewen
-* Alexandr Ferodov
-* Filip Haase
-* Jonathan Hasenberg
-* Markus Holzemer
-* Fabian Hueske
-* Vasia Kalavri
-* Aljoscha Krettek
-* Rajika Kumarasiri
-* Sebastian Kunert
-* Aaron Lam
-* Robert Metzger
-* Faisal Moeen
-* Martin Neumann
-* Mingliang Qi
-* Till Rohrmann
-* Chesnay Schepler
-* Vyachislav Soludev
-* Tuan Trieu
-* Artem Tsikiridis
-* Timo Walther
-* Robert Waury
-
-
-## Stratosphere is going Apache
-
-The Stratosphere project has been accepted to the Apache Incubator and will continue its work under the umbrella of the Apache Software Foundation. Due to a name conflict, we are switching the name of the project. We will make future releases of Stratosphere through the Apache foundation under a new name.
-
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2014-11-18-hadoop-compatibility.md
----------------------------------------------------------------------
diff --git a/_posts/2014-11-18-hadoop-compatibility.md b/_posts/2014-11-18-hadoop-compatibility.md
index 154c92a..ac599ce 100644
--- a/_posts/2014-11-18-hadoop-compatibility.md
+++ b/_posts/2014-11-18-hadoop-compatibility.md
@@ -87,4 +87,4 @@ While the Hadoop compatibility package is already very useful, we are currently
Flink lets you reuse a lot of the code you wrote for Hadoop MapReduce, including all data types, all Input- and OutputFormats, and Mapper and Reducers of the mapred-API. Hadoop functions can be used within Flink programs and mixed with all other Flink functions. Due to Flink’s pipelined execution, Hadoop functions can arbitrarily be assembled without data exchange via HDFS. Moreover, the Flink community is currently working on a dedicated Hadoop Job operation to supporting the execution of Hadoop jobs as a whole.
-If you want to use Flink’s Hadoop compatibility package checkout our [documentation](http://ci.apache.org/projects/flink/flink-docs-release-0.7/hadoop_compatibility.html).
\ No newline at end of file
+If you want to use Flink’s Hadoop compatibility package checkout our [documentation](https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/hadoop_compatibility.html).
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2015-02-04-january-in-flink.md
----------------------------------------------------------------------
diff --git a/_posts/2015-02-04-january-in-flink.md b/_posts/2015-02-04-january-in-flink.md
index 6a5315a..9d638e6 100644
--- a/_posts/2015-02-04-january-in-flink.md
+++ b/_posts/2015-02-04-january-in-flink.md
@@ -15,17 +15,13 @@ Flink 0.8.0 was released. See [here](http://flink.apache.org/news/2015/01/21/rel
The community has published a [roadmap for 2015](https://cwiki.apache.org/confluence/display/FLINK/Flink+Roadmap) on the Flink wiki. Check it out to see what is coming up in Flink, and pick up an issue to contribute!
-### Scaling ALS
-
-Flink committers employed at [data Artisans](http://data-artisans.com) published a [blog post](http://data-artisans.com/computing-recommendations-with-flink.html) on how they scaled matrix factorization with Flink and Google Compute Engine to matrices with 28 billion elements.
-
### Articles in the press
The Apache Software Foundation [announced](https://blogs.apache.org/foundation/entry/the_apache_software_foundation_announces69) Flink as a Top-Level Project. The announcement was picked up by the media, e.g., [here](http://sdtimes.com/inside-apache-software-foundations-newest-top-level-project-apache-flink/?utm_content=11232092&utm_medium=social&utm_source=twitter), [here](http://www.datanami.com/2015/01/12/apache-flink-takes-route-distributed-data-processing/), and [here](http://i-programmer.info/news/197-data-mining/8176-flink-reaches-top-level-status.html).
### Hadoop Summit
-A submitted abstract on Flink Streaming [won the community](http://2015.hadoopsummit.org/amsterdam-blog/announcing-the-community-vote-session-winners-for-the-2015-hadoop-summit-europe/) vote at “The Future of Hadoop” track.
+A submitted abstract on Flink Streaming won the community vote at “The Future of Hadoop” track.
### Meetups and talks
@@ -49,4 +45,4 @@ Semantic annotations are a powerful mechanism to expose information about the be
### [New YARN client](https://github.com/apache/flink/pull/292)
-The improved YARN client of Flink now allows users to deploy Flink on YARN for executing a single job. Older versions only supported a long-running YARN session. The code of the YARN client has been refactored to provide an (internal) Java API for controlling YARN clusters more easily.
\ No newline at end of file
+The improved YARN client of Flink now allows users to deploy Flink on YARN for executing a single job. Older versions only supported a long-running YARN session. The code of the YARN client has been refactored to provide an (internal) Java API for controlling YARN clusters more easily.
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2015-02-09-streaming-example.md
----------------------------------------------------------------------
diff --git a/_posts/2015-02-09-streaming-example.md b/_posts/2015-02-09-streaming-example.md
index 1027272..7dfd6a0 100644
--- a/_posts/2015-02-09-streaming-example.md
+++ b/_posts/2015-02-09-streaming-example.md
@@ -15,7 +15,7 @@ In this post, we go through an example that uses the Flink Streaming
API to compute statistics on stock market data that arrive
continuously and combine the stock market data with Twitter streams.
See the [Streaming Programming
-Guide](http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html) for a
+Guide](http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/index.html) for a
detailed presentation of the Streaming API.
First, we read a bunch of stock price streams and combine them into
@@ -115,11 +115,11 @@ public static void main(String[] args) throws Exception {
</div>
See
-[here](http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html#sources)
+[here](http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/index.html#data-sources)
on how you can create streaming sources for Flink Streaming
programs. Flink, of course, has support for reading in streams from
[external
-sources](http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html#stream-connectors)
+sources](http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/connectors/index.html)
such as Apache Kafka, Apache Flume, RabbitMQ, and others. For the sake
of this example, the data streams are simply generated using the
`generateStock` method:
@@ -230,7 +230,7 @@ Window aggregations
---------------
We first compute aggregations on time-based windows of the
-data. Flink provides [flexible windowing semantics](http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html#window-operators) where windows can
+data. Flink provides [flexible windowing semantics](http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/windows.html) where windows can
also be defined based on count of records or any custom user defined
logic.
@@ -432,7 +432,7 @@ Combining with a Twitter stream
Next, we will read a Twitter stream and correlate it with our stock
price stream. Flink has support for connecting to [Twitter's
-API](http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html#twitter-streaming-api),
+API](https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/connectors/twitter.html)
but for the sake of this example we generate dummy tweet data.
<img alt="Social media analytics" src="{{ site.baseurl }}/img/blog/blog_social_media.png" width="100%" class="img-responsive center-block">
@@ -666,7 +666,7 @@ public static final class WindowCorrelation
Other things to try
---------------
-For a full feature overview please check the [Streaming Guide](http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html), which describes all the available API features.
+For a full feature overview please check the [Streaming Guide](http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/index.html), which describes all the available API features.
You are very welcome to try out our features for different use-cases we are looking forward to your experiences. Feel free to [contact us](http://flink.apache.org/community.html#mailing-lists).
Upcoming for streaming
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2015-03-02-february-2015-in-flink.md
----------------------------------------------------------------------
diff --git a/_posts/2015-03-02-february-2015-in-flink.md b/_posts/2015-03-02-february-2015-in-flink.md
index a9fe325..5a85f9f 100644
--- a/_posts/2015-03-02-february-2015-in-flink.md
+++ b/_posts/2015-03-02-february-2015-in-flink.md
@@ -70,12 +70,12 @@ DataSet<Vertex<Long, Double>> singleSourceShortestPaths = graph
{% endhighlight %}
See more Gelly examples
-[here](https://github.com/apache/flink/tree/master/flink-staging/flink-gelly/src/main/java/org/apache/flink/graph/example).
+[here](https://github.com/apache/flink/tree/master/flink-libraries/flink-gelly-examples).
### Flink Expressions
The newly merged
-[flink-table](https://github.com/apache/flink/tree/master/flink-staging/flink-table)
+[flink-table](https://github.com/apache/flink/tree/master/flink-libraries/flink-table)
module is the first step in Flink’s roadmap towards logical queries
and SQL support. Here’s a preview on how you can read two CSV file,
assign a logical schema to, and apply transformations like filters and
@@ -99,7 +99,7 @@ val items =
### Access to HCatalog tables
With the [flink-hcatalog
-module](https://github.com/apache/flink/tree/master/flink-staging/flink-hcatalog),
+module](https://github.com/apache/flink/tree/master/flink-batch-connectors/flink-hcatalog),
you can now conveniently access HCatalog/Hive tables. The module
supports projection (selection and order of fields) and partition
filters.
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2015-03-13-peeking-into-Apache-Flinks-Engine-Room.md
----------------------------------------------------------------------
diff --git a/_posts/2015-03-13-peeking-into-Apache-Flinks-Engine-Room.md b/_posts/2015-03-13-peeking-into-Apache-Flinks-Engine-Room.md
index 8156780..0d136ed 100644
--- a/_posts/2015-03-13-peeking-into-Apache-Flinks-Engine-Room.md
+++ b/_posts/2015-03-13-peeking-into-Apache-Flinks-Engine-Room.md
@@ -122,7 +122,7 @@ The Hybrid-Hash-Join distinguishes its inputs as build-side and probe-side input
Ship and local strategies do not depend on each other and can be independently chosen. Therefore, Flink can execute a join of two data sets R and S in nine different ways by combining any of the three ship strategies (RR, BF with R being broadcasted, BF with S being broadcasted) with any of the three local strategies (SM, HH with R being build-side, HH with S being build-side). Each of these strategy combinations results in different execution performance depending on the data sizes and the available amount of working memory. In case of a small data set R and a much larger data set S, broadcasting R and using it as build-side input of a Hybrid-Hash-Join is usually a good choice because the much larger data set S is not shipped and not materialized (given that the hash table completely fits into memory). If both data sets are rather large or the join is performed on many parallel instances, repartitioning both inputs is a robust choice.
-Flink features a cost-based optimizer which automatically chooses the execution strategies for all operators including joins. Without going into the details of cost-based optimization, this is done by computing cost estimates for execution plans with different strategies and picking the plan with the least estimated costs. Thereby, the optimizer estimates the amount of data which is shipped over the the network and written to disk. If no reliable size estimates for the input data can be obtained, the optimizer falls back to robust default choices. A key feature of the optimizer is to reason about existing data properties. For example, if the data of one input is already partitioned in a suitable way, the generated candidate plans will not repartition this input. Hence, the choice of a RR ship strategy becomes more likely. The same applies for previously sorted data and the Sort-Merge-Join strategy. Flink programs can help the optimizer to reason about existing data properties by pro
viding semantic information about user-defined functions [[4]](http://ci.apache.org/projects/flink/flink-docs-master/apis/programming_guide.html#semantic-annotations). While the optimizer is a killer feature of Flink, it can happen that a user knows better than the optimizer how to execute a specific join. Similar to relational database systems, Flink offers optimizer hints to tell the optimizer which join strategies to pick [[5]](http://ci.apache.org/projects/flink/flink-docs-master/apis/dataset_transformations.html#join-algorithm-hints).
+Flink features a cost-based optimizer which automatically chooses the execution strategies for all operators including joins. Without going into the details of cost-based optimization, this is done by computing cost estimates for execution plans with different strategies and picking the plan with the least estimated costs. Thereby, the optimizer estimates the amount of data which is shipped over the the network and written to disk. If no reliable size estimates for the input data can be obtained, the optimizer falls back to robust default choices. A key feature of the optimizer is to reason about existing data properties. For example, if the data of one input is already partitioned in a suitable way, the generated candidate plans will not repartition this input. Hence, the choice of a RR ship strategy becomes more likely. The same applies for previously sorted data and the Sort-Merge-Join strategy. Flink programs can help the optimizer to reason about existing data properties by pro
viding semantic information about user-defined functions [[4]](https://ci.apache.org/projects/flink/flink-docs-release-1.0/apis/batch/index.html#semantic-annotations). While the optimizer is a killer feature of Flink, it can happen that a user knows better than the optimizer how to execute a specific join. Similar to relational database systems, Flink offers optimizer hints to tell the optimizer which join strategies to pick [[5]](https://ci.apache.org/projects/flink/flink-docs-release-1.0/apis/batch/dataset_transformations.html#join-algorithm-hints).
### How is Flink’s join performance?
@@ -173,5 +173,5 @@ We have seen that off-the-shelf distributed joins work really well in Flink. But
[1] [“MapReduce: Simplified data processing on large clusters”](), Dean, Ghemawat, 2004 <br>
[2] [Flink 0.8.1 documentation: Data Transformations](http://ci.apache.org/projects/flink/flink-docs-release-0.8/dataset_transformations.html) <br>
[3] [Flink 0.8.1 documentation: Joins](http://ci.apache.org/projects/flink/flink-docs-release-0.8/dataset_transformations.html#join) <br>
-[4] [Flink 0.9-SNAPSHOT documentation: Semantic annotations](http://ci.apache.org/projects/flink/flink-docs-master/apis/programming_guide.html#semantic-annotations) <br>
-[5] [Flink 0.9-SNAPSHOT documentation: Optimizer join hints](http://ci.apache.org/projects/flink/flink-docs-master/apis/dataset_transformations.html#join-algorithm-hints) <br>
+[4] [Flink 1.0 documentation: Semantic annotations](https://ci.apache.org/projects/flink/flink-docs-release-1.0/apis/batch/index.html#semantic-annotations) <br>
+[5] [Flink 1.0 documentation: Optimizer join hints](https://ci.apache.org/projects/flink/flink-docs-release-1.0/apis/batch/dataset_transformations.html#join-algorithm-hints) <br>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2015-04-07-march-in-flink.md
----------------------------------------------------------------------
diff --git a/_posts/2015-04-07-march-in-flink.md b/_posts/2015-04-07-march-in-flink.md
index cf0c8e6..3a9044e 100644
--- a/_posts/2015-04-07-march-in-flink.md
+++ b/_posts/2015-04-07-march-in-flink.md
@@ -7,15 +7,9 @@ categories: news
March has been a busy month in the Flink community.
-### Flink runner for Google Cloud Dataflow
+### Scaling ALS
-A Flink runner for Google Cloud Dataflow was announced. See the blog
-posts by [data Artisans](http://data-artisans.com/dataflow.html) and
-the [Google Cloud Platform Blog](http://googlecloudplatform.blogspot.de/2015/03/announcing-Google-Cloud-Dataflow-runner-for-Apache-Flink.html).
-Google Cloud Dataflow programs can be written using and open-source
-SDK and run in multiple backends, either as a managed service inside
-Google's infrastructure, or leveraging open source runners,
-including Apache Flink.
+Flink committers employed at [data Artisans](http://data-artisans.com) published a [blog post](http://data-artisans.com/how-to-factorize-a-700-gb-matrix-with-apache-flink/) on how they scaled matrix factorization with Flink and Google Compute Engine to matrices with 28 billion elements.
### Learn about the internals of Flink
@@ -48,14 +42,14 @@ future of Flink. The talk is available on
### Table API in Scala and Java
The new [Table
-API](https://github.com/apache/flink/tree/master/flink-staging/flink-table)
+API](https://github.com/apache/flink/tree/master/flink-libraries/flink-table)
in Flink is now available in both Java and Scala. Check out the
-examples [here (Java)](https://github.com/apache/flink/blob/master/flink-staging/flink-table/src/main/java/org/apache/flink/examples/java/JavaTableExample.java) and [here (Scala)](https://github.com/apache/flink/tree/master/flink-staging/flink-table/src/main/scala/org/apache/flink/examples/scala).
+examples [here (Java)](https://github.com/apache/flink/blob/master/flink-libraries/flink-table/src/main/java/org/apache/flink/examples/java/JavaTableExample.java) and [here (Scala)](https://github.com/apache/flink/tree/master/flink-libraries/flink-table/src/main/scala/org/apache/flink/examples/scala).
### Additions to the Machine Learning library
Flink's [Machine Learning
-library](https://github.com/apache/flink/tree/master/flink-staging/flink-ml)
+library](https://github.com/apache/flink/tree/master/flink-libraries/flink-ml)
is seeing quite a bit of traction. Recent additions include the [CoCoA
algorithm](http://arxiv.org/abs/1409.1458) for distributed
optimization.
@@ -70,8 +64,3 @@ checkpoints at failure recovery. This functionality is currently
limited in that it does not yet handle large state and iterative
programs.
-### Flink on Tez
-
-A new execution environment enables non-iterative Flink jobs to use
-Tez as an execution backend instead of Flink's own network stack. Learn more
-[here](http://ci.apache.org/projects/flink/flink-docs-master/setup/flink_on_tez.html).
\ No newline at end of file
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2015-04-13-release-0.9.0-milestone1.md
----------------------------------------------------------------------
diff --git a/_posts/2015-04-13-release-0.9.0-milestone1.md b/_posts/2015-04-13-release-0.9.0-milestone1.md
index f10823d..145c407 100644
--- a/_posts/2015-04-13-release-0.9.0-milestone1.md
+++ b/_posts/2015-04-13-release-0.9.0-milestone1.md
@@ -45,7 +45,7 @@ for Flink programs. Tables are available for both static and streaming
data sources (DataSet and DataStream APIs).
Check out the Table guide for Java and Scala
-[here](http://ci.apache.org/projects/flink/flink-docs-master/libs/table.html).
+[here](https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/libs/table.html).
### Gelly Graph Processing API
@@ -60,13 +60,13 @@ algorithms, including PageRank, SSSP, label propagation, and community
detection.
Gelly internally builds on top of Flink’s [delta
-iterations](http://ci.apache.org/projects/flink/flink-docs-master/apis/iterations.html). Iterative
+iterations](https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/iterations.html). Iterative
graph algorithms are executed leveraging mutable state, achieving
similar performance with specialized graph processing systems.
Gelly will eventually subsume Spargel, Flink’s Pregel-like API. Check
out the Gelly guide
-[here](http://ci.apache.org/projects/flink/flink-docs-master/libs/gelly_guide.html).
+[here](https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/libs/gelly.html).
### Flink Machine Learning Library
@@ -227,4 +227,4 @@ automatically. Users can also manually register serializers to Kryo
socket sink
* [FLINK-1436](https://issues.apache.org/jira/browse/FLINK-1436):
- Improve usability of command line interface
\ No newline at end of file
+ Improve usability of command line interface
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2015-05-14-Community-update-April.md
----------------------------------------------------------------------
diff --git a/_posts/2015-05-14-Community-update-April.md b/_posts/2015-05-14-Community-update-April.md
index a524ec9..79bb258 100644
--- a/_posts/2015-05-14-Community-update-April.md
+++ b/_posts/2015-05-14-Community-update-April.md
@@ -11,6 +11,17 @@ excerpt: "<p>The monthly update from the Flink community. Including the availabi
April was an packed month for Apache Flink.
+### Flink runner for Google Cloud Dataflow
+
+A Flink runner for Google Cloud Dataflow was announced. See the blog
+posts by [data Artisans](http://data-artisans.com/announcing-google-cloud-dataflow-on-flink-and-easy-flink-deployment-on-google-cloud/) and
+the [Google Cloud Platform Blog](http://googlecloudplatform.blogspot.de/2015/03/announcing-Google-Cloud-Dataflow-runner-for-Apache-Flink.html).
+Google Cloud Dataflow programs can be written using and open-source
+SDK and run in multiple backends, either as a managed service inside
+Google's infrastructure, or leveraging open source runners,
+including Apache Flink.
+
+
## Flink 0.9.0-milestone1 release
The highlight of April was of course the availability of [Flink 0.9-milestone1]({{site.baseurl}}/news/2015/04/13/release-0.9.0-milestone1.html). This was a release packed with new features, including, a Python DataSet API, the new SQL-like Table API, FlinkML, a machine learning library on Flink, Gelly, FLink's Graph API, as well as a mode to run Flink on YARN leveraging Tez. In case you missed it, check out the [release announcement blog post]({{site.baseurl}}/news/2015/04/13/release-0.9.0-milestone1.html) for details
@@ -29,4 +40,4 @@ Fabian Hueske gave an [interview at InfoQ](http://www.infoq.com/news/2015/04/hue
## Upcoming events
-Stay tuned for a wealth of upcoming events! Two Flink talsk will be presented at [Berlin Buzzwords](http://berlinbuzzwords.de/15/sessions), Flink will be presented at the [Hadoop Summit in San Jose](http://2015.hadoopsummit.org/san-jose/). A [training workshop on Apache Flink](http://www.meetup.com/Apache-Flink-Meetup/events/220557545/) is being organized in Berlin. Finally, [Flink Forward](http://flink-forward.org), the first conference to bring together the whole Flink community is taking place in Berlin in October 2015.
\ No newline at end of file
+Stay tuned for a wealth of upcoming events! Two Flink talsk will be presented at [Berlin Buzzwords](http://berlinbuzzwords.de/15/sessions), Flink will be presented at the [Hadoop Summit in San Jose](http://2015.hadoopsummit.org/san-jose/). A [training workshop on Apache Flink](http://www.meetup.com/Apache-Flink-Meetup/events/220557545/) is being organized in Berlin. Finally, [Flink Forward](http://2015.flink-forward.org/), the first conference to bring together the whole Flink community is taking place in Berlin in October 2015.
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2015-09-03-flink-forward.md
----------------------------------------------------------------------
diff --git a/_posts/2015-09-03-flink-forward.md b/_posts/2015-09-03-flink-forward.md
index 146f14d..cd35e13 100644
--- a/_posts/2015-09-03-flink-forward.md
+++ b/_posts/2015-09-03-flink-forward.md
@@ -5,7 +5,7 @@ date: 2015-09-03 08:00:00
categories: news
---
-[Flink Forward 2015](http://flink-forward.org/) is the first
+[Flink Forward 2015](http://2015.flink-forward.org/) is the first
conference with Flink at its center that aims to bring together the
Apache Flink community in a single place. The organizers are starting
this conference in October 12 and 13 from Berlin, the place where
@@ -15,7 +15,7 @@ Apache Flink started.
<img src="{{ site.baseurl }}/img/blog/flink-forward-banner.png" style="width:80%;margin:15px">
</center>
-The [conference program](http://flink-forward.org/?post_type=day) has
+The [conference program](http://2015.flink-forward.org/?post_type=day) has
been announced by the organizers and a program committee consisting of
Flink PMC members. The agenda contains talks from industry and
academia as well as a dedicated session on hands-on Flink training.
@@ -23,7 +23,7 @@ academia as well as a dedicated session on hands-on Flink training.
Some highlights of the talks include
- A keynote by [William
- Vambenepe](http://flink-forward.org/?speaker=william-vambenepe),
+ Vambenepe](http://2015.flink-forward.org/?speaker=william-vambenepe),
lead of the product management team responsible for Big Data
services on Google Cloud Platform (BigQuery, Dataflow, etc...) on
data streaming, Google Cloud Dataflow, and Apache Flink.
@@ -39,7 +39,6 @@ Some highlights of the talks include
- Talks by Flink committers on several aspects of the system, such as
fault tolerance, the internal runtime architecture, and others.
-Check out the [schedule](http://flink-forward.org/?post_type=day) and
-[register](http://flink-forward.org/?page_id=96) for the
-conference.
+Check out the [schedule](http://2015.flink-forward.org/?post_type=day) and
+register for the conference.
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2015-09-16-off-heap-memory.md
----------------------------------------------------------------------
diff --git a/_posts/2015-09-16-off-heap-memory.md b/_posts/2015-09-16-off-heap-memory.md
index 1208406..0b75945 100644
--- a/_posts/2015-09-16-off-heap-memory.md
+++ b/_posts/2015-09-16-off-heap-memory.md
@@ -159,7 +159,7 @@ There is still a bit of mystery left, specifically why sometimes code is faster
## Appendix: Detailed Micro Benchmarks
-These microbenchmarks test the performance of the different memory segment implementations on various operation. The code is available [as part of the Flink project](https://github.com/apache/flink/blob/master/flink-core/src/test/java/org/apache/flink/core/memory/benchmarks/MemorySegmentSpeedBenchmark.java)
+These microbenchmarks test the performance of the different memory segment implementations on various operation.
Each experiments tests the different implementations multiple times in different orders, to balance the advantage/disadvantage of the JIT compiler specializing towards certain code paths. All experiments were run 5x, discarding the fastest and slowest run, and then averaged. This compensated for delay before the JIT kicks in.
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2015-12-11-storm-compatibility.md
----------------------------------------------------------------------
diff --git a/_posts/2015-12-11-storm-compatibility.md b/_posts/2015-12-11-storm-compatibility.md
index 1dae5df..5fa39c3 100644
--- a/_posts/2015-12-11-storm-compatibility.md
+++ b/_posts/2015-12-11-storm-compatibility.md
@@ -148,7 +148,7 @@ Flink's compatibility package for Storm allows using unmodified Spouts and Bolts
This enables you to even embed third-party Spouts and Bolts where the source code is not available.
While you can embed Spouts/Bolts in a Flink program and mix-and-match them with Flink operators, running whole topologies is the easiest way to get started and can be achieved with almost no code changes.
-If you want to try out Flink's Storm compatibility package checkout our [Documentation](https://ci.apache.org/projects/flink/flink-docs-master/apis/storm_compatibility.html).
+If you want to try out Flink's Storm compatibility package checkout our [Documentation](https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/storm_compatibility.html).
<hr />
http://git-wip-us.apache.org/repos/asf/flink-web/blob/52d8fe19/_posts/2015-12-18-a-year-in-review.md
----------------------------------------------------------------------
diff --git a/_posts/2015-12-18-a-year-in-review.md b/_posts/2015-12-18-a-year-in-review.md
index 538bc73..de516da 100644
--- a/_posts/2015-12-18-a-year-in-review.md
+++ b/_posts/2015-12-18-a-year-in-review.md
@@ -49,14 +49,14 @@ meetups around the globe](http://apache-flink.meetup.com/):
# Flink Forward 2015
One of the highlights of the year for Flink was undoubtedly the [Flink
-Forward](http://flink-forward.org/) conference, the first conference
+Forward](http://2015.flink-forward.org/) conference, the first conference
on Apache Flink that was held in October in Berlin. More than 250
participants (roughly half based outside Germany where the conference
was held) attended more than 33 technical talks from organizations
including Google, MongoDB, Bouygues Telecom, NFLabs, Euranova, RedHat,
IBM, Huawei, Intel, Ericsson, Capital One, Zalando, Amadeus, the Otto
Group, and ResearchGate. If you have not yet watched their talks,
-check out the [slides](http://flink-forward.org/?post_type=day) and
+check out the [slides](http://2015.flink-forward.org/?post_type=day) and
[videos](https://www.youtube.com/playlist?list=PLDX4T_cnKjD31JeWR1aMOi9LXPRQ6nyHO)
from Flink Forward.
[6/8] flink-web git commit: rebuild web page
Posted by mj...@apache.org.
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/blog/index.html
----------------------------------------------------------------------
diff --git a/content/blog/index.html b/content/blog/index.html
index d388ac9..4c083bc 100644
--- a/content/blog/index.html
+++ b/content/blog/index.html
@@ -292,7 +292,7 @@
</li>
<li>
- <span class="page_number ">Page: 1 of 5</span>
+ <span class="page_number ">Page: 1 of 3</span>
</li>
<li>
@@ -607,176 +607,6 @@
<li><a href="/news/2014/08/26/release-0.6.html">Apache Flink 0.6 available</a></li>
-
-
-
-
-
-
-
- <li><a href="/news/2014/05/31/release-0.5.html">Stratosphere version 0.5 available</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/04/16/stratosphere-goes-apache-incubator.html">Stratosphere accepted as Apache Incubator Project</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/02/24/stratosphere-google-summer-of-code-2014.html">Stratosphere got accepted for Google Summer of Code 2014</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/02/18/amazon-elastic-mapreduce-cloud-yarn.html">Use Stratosphere with Amazon Elastic MapReduce</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/28/querying_mongodb.html">Accessing Data Stored in MongoDB with Stratosphere</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/26/optimizer_plan_visualization_tool.html">Optimizer Plan Visualization Tool</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/13/stratosphere-release-0.4.html">Stratosphere 0.4 Released</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/12/0.4-migration-guide.html">Stratosphere Version 0.4 Migration Guide</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/10/stratosphere-hadoop-summit.html">Stratosphere got accepted to the Hadoop Summit Europe in Amsterdam</a></li>
-
-
-
- </ul>
- <hr>
- <h2>2013</h2>
- <ul id="markdown-toc">
-
-
-
-
-
-
-
- <li><a href="/news/2013/12/13/humboldt-innovation-award.html">Stratosphere wins award at Humboldt Innovation Competition "Big Data: Research meets Startups"</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2013/10/21/cikm2013-paper.html">Paper "All Roads Lead to Rome: Optimistic Recovery for Distributed Iterative Data Processing" accepted at CIKM 2013</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2013/03/27/www-demo-paper.html">Demo Paper "Large-Scale Social-Media Analytics on Stratosphere" Accepted at WWW 2013</a></li>
-
-
-
- </ul>
- <hr>
- <h2>2012</h2>
- <ul id="markdown-toc">
-
-
-
-
-
-
-
- <li><a href="/news/2012/11/21/previewICDE2013.html">ICDE 2013 Demo Preview</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2012/11/12/btw2013demo.html">Stratosphere Demo Paper Accepted for BTW 2013</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2012/10/15/icde2013.html">Stratosphere Demo Accepted for ICDE 2013</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2012/08/21/release02.html">Version 0.2 Released</a></li>
-
-
</ul>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/blog/page2/index.html
----------------------------------------------------------------------
diff --git a/content/blog/page2/index.html b/content/blog/page2/index.html
index 07d0f6c..cd7b9c8 100644
--- a/content/blog/page2/index.html
+++ b/content/blog/page2/index.html
@@ -164,7 +164,7 @@
<h2 class="blog-title"><a href="/news/2015/09/03/flink-forward.html">Announcing Flink Forward 2015</a></h2>
<p>03 Sep 2015</p>
- <p><p><a href="http://flink-forward.org/">Flink Forward 2015</a> is the first
+ <p><p><a href="http://2015.flink-forward.org/">Flink Forward 2015</a> is the first
conference with Flink at its center that aims to bring together the
Apache Flink community in a single place. The organizers are starting
this conference in October 12 and 13 from Berlin, the place where
@@ -310,7 +310,7 @@ community last month.</p>
</li>
<li>
- <span class="page_number ">Page: 2 of 5</span>
+ <span class="page_number ">Page: 2 of 3</span>
</li>
<li>
@@ -625,176 +625,6 @@ community last month.</p>
<li><a href="/news/2014/08/26/release-0.6.html">Apache Flink 0.6 available</a></li>
-
-
-
-
-
-
-
- <li><a href="/news/2014/05/31/release-0.5.html">Stratosphere version 0.5 available</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/04/16/stratosphere-goes-apache-incubator.html">Stratosphere accepted as Apache Incubator Project</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/02/24/stratosphere-google-summer-of-code-2014.html">Stratosphere got accepted for Google Summer of Code 2014</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/02/18/amazon-elastic-mapreduce-cloud-yarn.html">Use Stratosphere with Amazon Elastic MapReduce</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/28/querying_mongodb.html">Accessing Data Stored in MongoDB with Stratosphere</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/26/optimizer_plan_visualization_tool.html">Optimizer Plan Visualization Tool</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/13/stratosphere-release-0.4.html">Stratosphere 0.4 Released</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/12/0.4-migration-guide.html">Stratosphere Version 0.4 Migration Guide</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/10/stratosphere-hadoop-summit.html">Stratosphere got accepted to the Hadoop Summit Europe in Amsterdam</a></li>
-
-
-
- </ul>
- <hr>
- <h2>2013</h2>
- <ul id="markdown-toc">
-
-
-
-
-
-
-
- <li><a href="/news/2013/12/13/humboldt-innovation-award.html">Stratosphere wins award at Humboldt Innovation Competition "Big Data: Research meets Startups"</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2013/10/21/cikm2013-paper.html">Paper "All Roads Lead to Rome: Optimistic Recovery for Distributed Iterative Data Processing" accepted at CIKM 2013</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2013/03/27/www-demo-paper.html">Demo Paper "Large-Scale Social-Media Analytics on Stratosphere" Accepted at WWW 2013</a></li>
-
-
-
- </ul>
- <hr>
- <h2>2012</h2>
- <ul id="markdown-toc">
-
-
-
-
-
-
-
- <li><a href="/news/2012/11/21/previewICDE2013.html">ICDE 2013 Demo Preview</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2012/11/12/btw2013demo.html">Stratosphere Demo Paper Accepted for BTW 2013</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2012/10/15/icde2013.html">Stratosphere Demo Accepted for ICDE 2013</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2012/08/21/release02.html">Version 0.2 Released</a></li>
-
-
</ul>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/blog/page3/index.html
----------------------------------------------------------------------
diff --git a/content/blog/page3/index.html b/content/blog/page3/index.html
index 43c454b..ff9d4aa 100644
--- a/content/blog/page3/index.html
+++ b/content/blog/page3/index.html
@@ -284,19 +284,6 @@ academic and open source project that Flink originates from.</p>
<hr>
- <article>
- <h2 class="blog-title"><a href="/news/2014/05/31/release-0.5.html">Stratosphere version 0.5 available</a></h2>
- <p>31 May 2014</p>
-
- <p><p>We are happy to announce a new major Stratosphere release, version 0.5. This release adds many new features and improves the interoperability, stability, and performance of the system. The major theme of the release is the completely new Java API that makes it easy to write powerful distributed programs.</p>
-
-</p>
-
- <p><a href="/news/2014/05/31/release-0.5.html">Continue reading »</a></p>
- </article>
-
- <hr>
-
<!-- Pagination links -->
@@ -307,11 +294,11 @@ academic and open source project that Flink originates from.</p>
</li>
<li>
- <span class="page_number ">Page: 3 of 5</span>
+ <span class="page_number ">Page: 3 of 3</span>
</li>
<li>
- <a href="/blog/page4" class="next">Next</a>
+ <span>Next</span>
</li>
</ul>
@@ -622,176 +609,6 @@ academic and open source project that Flink originates from.</p>
<li><a href="/news/2014/08/26/release-0.6.html">Apache Flink 0.6 available</a></li>
-
-
-
-
-
-
-
- <li><a href="/news/2014/05/31/release-0.5.html">Stratosphere version 0.5 available</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/04/16/stratosphere-goes-apache-incubator.html">Stratosphere accepted as Apache Incubator Project</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/02/24/stratosphere-google-summer-of-code-2014.html">Stratosphere got accepted for Google Summer of Code 2014</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/02/18/amazon-elastic-mapreduce-cloud-yarn.html">Use Stratosphere with Amazon Elastic MapReduce</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/28/querying_mongodb.html">Accessing Data Stored in MongoDB with Stratosphere</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/26/optimizer_plan_visualization_tool.html">Optimizer Plan Visualization Tool</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/13/stratosphere-release-0.4.html">Stratosphere 0.4 Released</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/12/0.4-migration-guide.html">Stratosphere Version 0.4 Migration Guide</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/10/stratosphere-hadoop-summit.html">Stratosphere got accepted to the Hadoop Summit Europe in Amsterdam</a></li>
-
-
-
- </ul>
- <hr>
- <h2>2013</h2>
- <ul id="markdown-toc">
-
-
-
-
-
-
-
- <li><a href="/news/2013/12/13/humboldt-innovation-award.html">Stratosphere wins award at Humboldt Innovation Competition "Big Data: Research meets Startups"</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2013/10/21/cikm2013-paper.html">Paper "All Roads Lead to Rome: Optimistic Recovery for Distributed Iterative Data Processing" accepted at CIKM 2013</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2013/03/27/www-demo-paper.html">Demo Paper "Large-Scale Social-Media Analytics on Stratosphere" Accepted at WWW 2013</a></li>
-
-
-
- </ul>
- <hr>
- <h2>2012</h2>
- <ul id="markdown-toc">
-
-
-
-
-
-
-
- <li><a href="/news/2012/11/21/previewICDE2013.html">ICDE 2013 Demo Preview</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2012/11/12/btw2013demo.html">Stratosphere Demo Paper Accepted for BTW 2013</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2012/10/15/icde2013.html">Stratosphere Demo Accepted for ICDE 2013</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2012/08/21/release02.html">Version 0.2 Released</a></li>
-
-
</ul>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/blog/page4/index.html
----------------------------------------------------------------------
diff --git a/content/blog/page4/index.html b/content/blog/page4/index.html
deleted file mode 100644
index 3f64e0d..0000000
--- a/content/blog/page4/index.html
+++ /dev/null
@@ -1,828 +0,0 @@
-<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
- <title>Apache Flink: Blog</title>
- <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
- <link rel="icon" href="/favicon.ico" type="image/x-icon">
-
- <!-- Bootstrap -->
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css">
- <link rel="stylesheet" href="/css/flink.css">
- <link rel="stylesheet" href="/css/syntax.css">
-
- <!-- Blog RSS feed -->
- <link href="/blog/feed.xml" rel="alternate" type="application/rss+xml" title="Apache Flink Blog: RSS feed" />
-
- <!-- jQuery (necessary for Bootstrap's JavaScript plugins) -->
- <!-- We need to load Jquery in the header for custom google analytics event tracking-->
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js"></script>
-
- <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
- <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
-
-
- <!-- Top navbar. -->
- <nav class="navbar navbar-default navbar-fixed-top">
- <div class="container">
- <!-- The logo. -->
- <div class="navbar-header">
- <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- <div class="navbar-logo">
- <a href="/">
- <img alt="Apache Flink" src="/img/navbar-brand-logo.jpg" width="78px" height="40px">
- </a>
- </div>
- </div><!-- /.navbar-header -->
-
- <!-- The navigation links. -->
- <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
- <ul class="nav navbar-nav">
-
- <!-- Overview -->
- <li><a href="/index.html">Overview</a></li>
-
- <!-- Features -->
- <li><a href="/features.html">Features</a></li>
-
- <!-- Downloads -->
- <li><a href="/downloads.html">Downloads</a></li>
-
- <!-- FAQ -->
- <li><a href="/faq.html">FAQ</a></li>
-
-
- <!-- Quickstart -->
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Quickstart <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html">Setup</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/run_example_quickstart.html">Example: Wikipedia Edit Stream</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html">Java API</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/scala_api_quickstart.html">Scala API</a></li>
- </ul>
- </li>
-
- <!-- Documentation -->
- <li class="dropdown">
- <a href="" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Documentation <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Latest stable release -->
- <li role="presentation" class="dropdown-header"><strong>Latest Release</strong> (Stable)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0">1.0 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/java" class="active">1.0 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/scala/index.html" class="active">1.0 ScalaDocs</a></li>
-
- <!-- Snapshot docs -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Snapshot</strong> (Development)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master">1.1 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/java" class="active">1.1 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/scala/index.html" class="active">1.1 ScalaDocs</a></li>
-
- <!-- Wiki -->
- <li class="divider"></li>
- <li><a href="/visualizer/"><small><span class="glyphicon glyphicon-new-window"></span></small> Plan Visualizer</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
-
- </ul>
-
- <ul class="nav navbar-nav navbar-right">
- <!-- Blog -->
- <li class=" active hidden-md hidden-sm"><a href="/blog/">Blog</a></li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Community <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Community -->
- <li role="presentation" class="dropdown-header"><strong>Community</strong></li>
- <li><a href="/community.html#mailing-lists">Mailing Lists</a></li>
- <li><a href="/community.html#irc">IRC</a></li>
- <li><a href="/community.html#stack-overflow">Stack Overflow</a></li>
- <li><a href="/community.html#issue-tracker">Issue Tracker</a></li>
- <li><a href="/community.html#third-party-packages">Third Party Packages</a></li>
- <li><a href="/community.html#source-code">Source Code</a></li>
- <li><a href="/community.html#people">People</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink"><small><span class="glyphicon glyphicon-new-window"></span></small> Powered by Flink</a></li>
-
- <!-- Contribute -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Contribute</strong></li>
- <li><a href="/how-to-contribute.html">How to Contribute</a></li>
- <li><a href="/contribute-code.html">Contribute Code</a></li>
- <li><a href="/contribute-documentation.html">Contribute Documentation</a></li>
- <li><a href="/improve-website.html">Improve the Website</a></li>
- </ul>
- </li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Project <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Project -->
- <li role="presentation" class="dropdown-header"><strong>Project</strong></li>
- <li><a href="/slides.html">Slides</a></li>
- <li><a href="/material.html">Material</a></li>
- <li><a href="https://twitter.com/apacheflink"><small><span class="glyphicon glyphicon-new-window"></span></small> Twitter</a></li>
- <li><a href="https://github.com/apache/flink"><small><span class="glyphicon glyphicon-new-window"></span></small> GitHub</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
- </ul>
- </div><!-- /.navbar-collapse -->
- </div><!-- /.container -->
- </nav>
-
-
- <!-- Main content. -->
- <div class="container">
-
-
-<div class="row">
- <div class="col-sm-12"><h1>Blog</h1></div>
-</div>
-
-<div class="row">
- <div class="col-sm-8">
- <!-- Blog posts -->
-
- <article>
- <h2 class="blog-title"><a href="/news/2014/04/16/stratosphere-goes-apache-incubator.html">Stratosphere accepted as Apache Incubator Project</a></h2>
- <p>16 Apr 2014</p>
-
- <p><p>We are happy to announce that Stratosphere has been accepted as a project for the <a href="https://incubator.apache.org/">Apache Incubator</a>. The <a href="https://wiki.apache.org/incubator/StratosphereProposal">proposal</a> has been accepted by the Incubator PMC members earlier this week. The Apache Incubator is the first step in the process of giving a project to the <a href="http://apache.org">Apache Software Foundation</a>. While under incubation, the project will move to the Apache infrastructure and adopt the community-driven development principles of the Apache Foundation. Projects can graduate from incubation to become top-level projects if they show activity, a healthy community dynamic, and releases.</p>
-
-</p>
-
- <p><a href="/news/2014/04/16/stratosphere-goes-apache-incubator.html">Continue reading »</a></p>
- </article>
-
- <hr>
-
- <article>
- <h2 class="blog-title"><a href="/news/2014/02/24/stratosphere-google-summer-of-code-2014.html">Stratosphere got accepted for Google Summer of Code 2014</a></h2>
- <p>24 Feb 2014</p>
-
- <p><div class="lead">Students: Apply now for exciting summer projects in the Big Data / Analytics field</div>
-
-</p>
-
- <p><a href="/news/2014/02/24/stratosphere-google-summer-of-code-2014.html">Continue reading »</a></p>
- </article>
-
- <hr>
-
- <article>
- <h2 class="blog-title"><a href="/news/2014/02/18/amazon-elastic-mapreduce-cloud-yarn.html">Use Stratosphere with Amazon Elastic MapReduce</a></h2>
- <p>18 Feb 2014 by Robert Metzger (<a href="https://twitter.com/rmetzger_">@rmetzger_</a>)</p>
-
- <p><div class="lead">Get started with Stratosphere within 10 minutes using Amazon Elastic MapReduce.</div>
-
-</p>
-
- <p><a href="/news/2014/02/18/amazon-elastic-mapreduce-cloud-yarn.html">Continue reading »</a></p>
- </article>
-
- <hr>
-
- <article>
- <h2 class="blog-title"><a href="/news/2014/01/28/querying_mongodb.html">Accessing Data Stored in MongoDB with Stratosphere</a></h2>
- <p>28 Jan 2014 by Robert Metzger (<a href="https://twitter.com/rmetzger_">@rmetzger_</a>)</p>
-
- <p><p>We recently merged a <a href="https://github.com/stratosphere/stratosphere/pull/437">pull request</a> that allows you to use any existing Hadoop <a href="http://developer.yahoo.com/hadoop/tutorial/module5.html#inputformat">InputFormat</a> with Stratosphere. So you can now (in the <code>0.5-SNAPSHOT</code> and upwards versions) define a Hadoop-based data source:</p>
-
-</p>
-
- <p><a href="/news/2014/01/28/querying_mongodb.html">Continue reading »</a></p>
- </article>
-
- <hr>
-
- <article>
- <h2 class="blog-title"><a href="/news/2014/01/26/optimizer_plan_visualization_tool.html">Optimizer Plan Visualization Tool</a></h2>
- <p>26 Jan 2014</p>
-
- <p><p>Stratosphere’s hybrid approach combines <strong>MapReduce</strong> and <strong>MPP database</strong> techniques. One central part of this approach is to have a <strong>separation between the programming (API) and the way programs are executed</strong> <em>(execution plans)</em>. The <strong>compiler/optimizer</strong> decides the details concerning caching or when to partition/broadcast with a holistic view of the program. The same program may actually be executed differently in different scenarios (input data of different sizes, different number of machines).</p>
-
-</p>
-
- <p><a href="/news/2014/01/26/optimizer_plan_visualization_tool.html">Continue reading »</a></p>
- </article>
-
- <hr>
-
- <article>
- <h2 class="blog-title"><a href="/news/2014/01/13/stratosphere-release-0.4.html">Stratosphere 0.4 Released</a></h2>
- <p>13 Jan 2014</p>
-
- <p><p>We are pleased to announce that version 0.4 of the Stratosphere system has been released. </p>
-
-</p>
-
- <p><a href="/news/2014/01/13/stratosphere-release-0.4.html">Continue reading »</a></p>
- </article>
-
- <hr>
-
- <article>
- <h2 class="blog-title"><a href="/news/2014/01/12/0.4-migration-guide.html">Stratosphere Version 0.4 Migration Guide</a></h2>
- <p>12 Jan 2014</p>
-
- <p><p>This guide is intended to help users of previous Stratosphere versions to migrate their programs to the new API of v0.4.</p>
-
-</p>
-
- <p><a href="/news/2014/01/12/0.4-migration-guide.html">Continue reading »</a></p>
- </article>
-
- <hr>
-
- <article>
- <h2 class="blog-title"><a href="/news/2014/01/10/stratosphere-hadoop-summit.html">Stratosphere got accepted to the Hadoop Summit Europe in Amsterdam</a></h2>
- <p>10 Jan 2014</p>
-
- <p><p>The Stratosphere team is proud to announce that it is going to present at the <a href="http://hadoopsummit.org/amsterdam/">Hadoop Summit 2014 in Amsterdam</a> on April 2-3. Our talk “Big Data looks tiny from Stratosphere” is part of the “Future of Hadoop” Track. The talk abstract already made it into the top 5 in the <a href="https://hadoopsummit.uservoice.com/forums/196822-future-of-apache-hadoop/filters/top">Community Vote</a> that took place by the end of last year.</p>
-
-</p>
-
- <p><a href="/news/2014/01/10/stratosphere-hadoop-summit.html">Continue reading »</a></p>
- </article>
-
- <hr>
-
- <article>
- <h2 class="blog-title"><a href="/news/2013/12/13/humboldt-innovation-award.html">Stratosphere wins award at Humboldt Innovation Competition "Big Data: Research meets Startups"</a></h2>
- <p>13 Dec 2013</p>
-
- <p> <p> Stratosphere won the second place in
- the <a href="http://www.humboldt-innovation.de/de/newsdetail/News/View/Forum%2BJunge%2BSpitzenforscher%2BBIG%2BData%2B%2BResearch%2Bmeets%2BStartups-123.html">competition</a>
- organized by Humboldt Innovation on "Big Data: Research meets
- Startups," where several research projects were evaluated by a
- panel of experts from the Berlin startup ecosystem. The award
- includes a monetary prize of 10,000 euros.
- </p>
-
-</p>
-
- <p><a href="/news/2013/12/13/humboldt-innovation-award.html">Continue reading »</a></p>
- </article>
-
- <hr>
-
- <article>
- <h2 class="blog-title"><a href="/news/2013/10/21/cikm2013-paper.html">Paper "All Roads Lead to Rome: Optimistic Recovery for Distributed Iterative Data Processing" accepted at CIKM 2013</a></h2>
- <p>21 Oct 2013</p>
-
- <p><p>Our paper ““All Roads Lead to Rome:” Optimistic Recovery for Distributed
-Iterative Data Processing” authored by Sebastian Schelter, Kostas
-Tzoumas, Stephan Ewen and Volker Markl has been accepted accepted at the
-ACM International Conference on Information and Knowledge Management
-(CIKM 2013) in San Francisco.</p>
-
-</p>
-
- <p><a href="/news/2013/10/21/cikm2013-paper.html">Continue reading »</a></p>
- </article>
-
- <hr>
-
-
- <!-- Pagination links -->
-
- <ul class="pager">
- <li>
-
- <a href="/blog/page3" class="previous">Previous</a>
-
- </li>
- <li>
- <span class="page_number ">Page: 4 of 5</span>
- </li>
- <li>
-
- <a href="/blog/page5" class="next">Next</a>
-
- </li>
- </ul>
-
- </div>
-
- <div class="col-sm-4" markdown="1">
- <!-- Blog posts by YEAR -->
-
-
-
-
-
- <h2>2016</h2>
-
- <ul id="markdown-toc">
-
- <li><a href="/news/2016/04/06/cep-monitoring.html">Introducing Complex Event Processing (CEP) with Apache Flink</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2016/04/06/release-1.0.1.html">Flink 1.0.1 Released</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2016/03/08/release-1.0.0.html">Announcing Apache Flink 1.0.0</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2016/02/11/release-0.10.2.html">Flink 0.10.2 Released</a></li>
-
-
-
- </ul>
- <hr>
- <h2>2015</h2>
- <ul id="markdown-toc">
-
-
-
-
-
-
-
- <li><a href="/news/2015/12/18/a-year-in-review.html">Flink 2015: A year in review, and a lookout to 2016</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/12/11/storm-compatibility.html">Storm Compatibility in Apache Flink: How to run existing Storm topologies on Flink</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/12/04/Introducing-windows.html">Introducing Stream Windows in Apache Flink</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/11/27/release-0.10.1.html">Flink 0.10.1 released</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/11/16/release-0.10.0.html">Announcing Apache Flink 0.10.0</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/09/16/off-heap-memory.html">Off-heap Memory in Apache Flink and the curious JIT compiler</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/09/03/flink-forward.html">Announcing Flink Forward 2015</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/09/01/release-0.9.1.html">Apache Flink 0.9.1 available</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/08/24/introducing-flink-gelly.html">Introducing Gelly: Graph Processing with Apache Flink</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/06/24/announcing-apache-flink-0.9.0-release.html">Announcing Apache Flink 0.9.0</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/05/14/Community-update-April.html">April 2015 in the Flink community</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/05/11/Juggling-with-Bits-and-Bytes.html">Juggling with Bits and Bytes</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/04/13/release-0.9.0-milestone1.html">Announcing Flink 0.9.0-milestone1 preview release</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/04/07/march-in-flink.html">March 2015 in the Flink community</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/03/13/peeking-into-Apache-Flinks-Engine-Room.html">Peeking into Apache Flink's Engine Room</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/03/02/february-2015-in-flink.html">February 2015 in the Flink community</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/02/09/streaming-example.html">Introducing Flink Streaming</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/02/04/january-in-flink.html">January 2015 in the Flink community</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/01/21/release-0.8.html">Apache Flink 0.8.0 available</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/01/06/december-in-flink.html">December 2014 in the Flink community</a></li>
-
-
-
- </ul>
- <hr>
- <h2>2014</h2>
- <ul id="markdown-toc">
-
-
-
-
-
-
-
- <li><a href="/news/2014/11/18/hadoop-compatibility.html">Hadoop Compatibility in Flink</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/11/04/release-0.7.0.html">Apache Flink 0.7.0 available</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/10/03/upcoming_events.html">Upcoming Events</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/09/26/release-0.6.1.html">Apache Flink 0.6.1 available</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/08/26/release-0.6.html">Apache Flink 0.6 available</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/05/31/release-0.5.html">Stratosphere version 0.5 available</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/04/16/stratosphere-goes-apache-incubator.html">Stratosphere accepted as Apache Incubator Project</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/02/24/stratosphere-google-summer-of-code-2014.html">Stratosphere got accepted for Google Summer of Code 2014</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/02/18/amazon-elastic-mapreduce-cloud-yarn.html">Use Stratosphere with Amazon Elastic MapReduce</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/28/querying_mongodb.html">Accessing Data Stored in MongoDB with Stratosphere</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/26/optimizer_plan_visualization_tool.html">Optimizer Plan Visualization Tool</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/13/stratosphere-release-0.4.html">Stratosphere 0.4 Released</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/12/0.4-migration-guide.html">Stratosphere Version 0.4 Migration Guide</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/10/stratosphere-hadoop-summit.html">Stratosphere got accepted to the Hadoop Summit Europe in Amsterdam</a></li>
-
-
-
- </ul>
- <hr>
- <h2>2013</h2>
- <ul id="markdown-toc">
-
-
-
-
-
-
-
- <li><a href="/news/2013/12/13/humboldt-innovation-award.html">Stratosphere wins award at Humboldt Innovation Competition "Big Data: Research meets Startups"</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2013/10/21/cikm2013-paper.html">Paper "All Roads Lead to Rome: Optimistic Recovery for Distributed Iterative Data Processing" accepted at CIKM 2013</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2013/03/27/www-demo-paper.html">Demo Paper "Large-Scale Social-Media Analytics on Stratosphere" Accepted at WWW 2013</a></li>
-
-
-
- </ul>
- <hr>
- <h2>2012</h2>
- <ul id="markdown-toc">
-
-
-
-
-
-
-
- <li><a href="/news/2012/11/21/previewICDE2013.html">ICDE 2013 Demo Preview</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2012/11/12/btw2013demo.html">Stratosphere Demo Paper Accepted for BTW 2013</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2012/10/15/icde2013.html">Stratosphere Demo Accepted for ICDE 2013</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2012/08/21/release02.html">Version 0.2 Released</a></li>
-
-
- </ul>
-
-
- </div>
-</div>
-
- <hr />
- <div class="footer text-center">
- <p>Copyright © 2014-2015 <a href="http://apache.org">The Apache Software Foundation</a>. All Rights Reserved.</p>
- <p>Apache Flink, Apache, and the Apache feather logo are trademarks of The Apache Software Foundation.</p>
- <p><a href="/privacy-policy.html">Privacy Policy</a> · <a href="/blog/feed.xml">RSS feed</a></p>
- </div>
-
- </div><!-- /.container -->
-
- <!-- Include all compiled plugins (below), or include individual files as needed -->
- <script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
- <script src="/js/codetabs.js"></script>
-
- <!-- Google Analytics -->
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-52545728-1', 'auto');
- ga('send', 'pageview');
- </script>
- </body>
-</html>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/blog/page5/index.html
----------------------------------------------------------------------
diff --git a/content/blog/page5/index.html b/content/blog/page5/index.html
deleted file mode 100644
index 9e4c8d5..0000000
--- a/content/blog/page5/index.html
+++ /dev/null
@@ -1,786 +0,0 @@
-<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
- <title>Apache Flink: Blog</title>
- <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
- <link rel="icon" href="/favicon.ico" type="image/x-icon">
-
- <!-- Bootstrap -->
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css">
- <link rel="stylesheet" href="/css/flink.css">
- <link rel="stylesheet" href="/css/syntax.css">
-
- <!-- Blog RSS feed -->
- <link href="/blog/feed.xml" rel="alternate" type="application/rss+xml" title="Apache Flink Blog: RSS feed" />
-
- <!-- jQuery (necessary for Bootstrap's JavaScript plugins) -->
- <!-- We need to load Jquery in the header for custom google analytics event tracking-->
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js"></script>
-
- <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
- <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
-
-
- <!-- Top navbar. -->
- <nav class="navbar navbar-default navbar-fixed-top">
- <div class="container">
- <!-- The logo. -->
- <div class="navbar-header">
- <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- <div class="navbar-logo">
- <a href="/">
- <img alt="Apache Flink" src="/img/navbar-brand-logo.jpg" width="78px" height="40px">
- </a>
- </div>
- </div><!-- /.navbar-header -->
-
- <!-- The navigation links. -->
- <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
- <ul class="nav navbar-nav">
-
- <!-- Overview -->
- <li><a href="/index.html">Overview</a></li>
-
- <!-- Features -->
- <li><a href="/features.html">Features</a></li>
-
- <!-- Downloads -->
- <li><a href="/downloads.html">Downloads</a></li>
-
- <!-- FAQ -->
- <li><a href="/faq.html">FAQ</a></li>
-
-
- <!-- Quickstart -->
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Quickstart <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html">Setup</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/run_example_quickstart.html">Example: Wikipedia Edit Stream</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html">Java API</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/scala_api_quickstart.html">Scala API</a></li>
- </ul>
- </li>
-
- <!-- Documentation -->
- <li class="dropdown">
- <a href="" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Documentation <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Latest stable release -->
- <li role="presentation" class="dropdown-header"><strong>Latest Release</strong> (Stable)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0">1.0 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/java" class="active">1.0 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/scala/index.html" class="active">1.0 ScalaDocs</a></li>
-
- <!-- Snapshot docs -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Snapshot</strong> (Development)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master">1.1 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/java" class="active">1.1 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/scala/index.html" class="active">1.1 ScalaDocs</a></li>
-
- <!-- Wiki -->
- <li class="divider"></li>
- <li><a href="/visualizer/"><small><span class="glyphicon glyphicon-new-window"></span></small> Plan Visualizer</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
-
- </ul>
-
- <ul class="nav navbar-nav navbar-right">
- <!-- Blog -->
- <li class=" active hidden-md hidden-sm"><a href="/blog/">Blog</a></li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Community <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Community -->
- <li role="presentation" class="dropdown-header"><strong>Community</strong></li>
- <li><a href="/community.html#mailing-lists">Mailing Lists</a></li>
- <li><a href="/community.html#irc">IRC</a></li>
- <li><a href="/community.html#stack-overflow">Stack Overflow</a></li>
- <li><a href="/community.html#issue-tracker">Issue Tracker</a></li>
- <li><a href="/community.html#third-party-packages">Third Party Packages</a></li>
- <li><a href="/community.html#source-code">Source Code</a></li>
- <li><a href="/community.html#people">People</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink"><small><span class="glyphicon glyphicon-new-window"></span></small> Powered by Flink</a></li>
-
- <!-- Contribute -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Contribute</strong></li>
- <li><a href="/how-to-contribute.html">How to Contribute</a></li>
- <li><a href="/contribute-code.html">Contribute Code</a></li>
- <li><a href="/contribute-documentation.html">Contribute Documentation</a></li>
- <li><a href="/improve-website.html">Improve the Website</a></li>
- </ul>
- </li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Project <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Project -->
- <li role="presentation" class="dropdown-header"><strong>Project</strong></li>
- <li><a href="/slides.html">Slides</a></li>
- <li><a href="/material.html">Material</a></li>
- <li><a href="https://twitter.com/apacheflink"><small><span class="glyphicon glyphicon-new-window"></span></small> Twitter</a></li>
- <li><a href="https://github.com/apache/flink"><small><span class="glyphicon glyphicon-new-window"></span></small> GitHub</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
- </ul>
- </div><!-- /.navbar-collapse -->
- </div><!-- /.container -->
- </nav>
-
-
- <!-- Main content. -->
- <div class="container">
-
-
-<div class="row">
- <div class="col-sm-12"><h1>Blog</h1></div>
-</div>
-
-<div class="row">
- <div class="col-sm-8">
- <!-- Blog posts -->
-
- <article>
- <h2 class="blog-title"><a href="/news/2013/03/27/www-demo-paper.html">Demo Paper "Large-Scale Social-Media Analytics on Stratosphere" Accepted at WWW 2013</a></h2>
- <p>27 Mar 2013</p>
-
- <p> <p>Our demo submission<br />
-<strong><cite>"Large-Scale Social-Media Analytics on Stratosphere"</cite></strong><br />
-by Christoph Boden, Marcel Karnstedt, Miriam Fernandez and Volker Markl<br />
-has been accepted for WWW 2013 in Rio de Janeiro, Brazil.</p>
-<p>Visit our demo, and talk to us if you are attending WWW 2013.</p>
-<p><strong>Abstract:</strong><br />
-The importance of social-media platforms and online communities - in business as well as public context - is more and more acknowledged and appreciated by industry and researchers alike. Consequently, a wide range of analytics has been proposed to understand, steer, and exploit the mechanics and laws driving their functionality and creating the resulting benefits. However, analysts usually face significant problems in scaling existing and novel approaches to match the data volume and size of modern online communities. In this work, we propose and demonstrate the usage of the massively parallel data prossesing system Stratosphere, based on second order functions as an extended notion of the MapReduce paradigm, to provide a new level of scalability to such social-media analytics. Based on the popular example of role analysis, we present and illustrate how this massively parallel approach can be leveraged to scale out complex data-mining tasks, while providing a programming approach th
at eases the formulation of complete analytical workflows.</p>
-
-
-</p>
-
- <p><a href="/news/2013/03/27/www-demo-paper.html">Continue reading »</a></p>
- </article>
-
- <hr>
-
- <article>
- <h2 class="blog-title"><a href="/news/2012/11/21/previewICDE2013.html">ICDE 2013 Demo Preview</a></h2>
- <p>21 Nov 2012</p>
-
- <p> <p>This is a preview of our demo that will be presented at ICDE 2013 in Brisbane.<br />
-The demo shows how static code analysis can be leveraged to reordered UDF operators in data flow programs.</p>
-<p>Detailed information can be found in our papers which are available on the <a href="/publications">publication</a> page.</p>
-<p><iframe width="420" height="315" src="http://www.youtube.com/embed/ZYwCMgPXFVE" frameborder="0" allowfullscreen></iframe></p>
-
-</p>
-
- <p><a href="/news/2012/11/21/previewICDE2013.html">Continue reading »</a></p>
- </article>
-
- <hr>
-
- <article>
- <h2 class="blog-title"><a href="/news/2012/11/12/btw2013demo.html">Stratosphere Demo Paper Accepted for BTW 2013</a></h2>
- <p>12 Nov 2012</p>
-
- <p> <p>Our demo submission<br />
-<strong><cite>"Applying Stratosphere for Big Data Analytics"</cite></strong><br />
-has been accepted for BTW 2013 in Magdeburg, Germany.<br />
-The demo focuses on Stratosphere's query language Meteor, which has been presented in our paper <cite>"Meteor/Sopremo: An Extensible Query Language and Operator Model"</cite> <a href="/assets/papers/Sopremo_Meteor BigData.pdf">[pdf]</a> at the BigData workshop associated with VLDB 2012 in Istanbul.</p>
-<p>Visit our demo, and talk to us if you are going to attend BTW 2013.</p>
-<p><strong>Abstract:</strong><br />
-Analyzing big data sets as they occur in modern business and science applications requires query languages that allow for the specification of complex data processing tasks. Moreover, these ideally declarative query specifications have to be optimized, parallelized and scheduled for processing on massively parallel data processing platforms. This paper demonstrates the application of Stratosphere to different kinds of Big Data Analytics tasks. Using examples from different application domains, we show how to formulate analytical tasks as Meteor queries and execute them with Stratosphere. These examples include data cleansing and information extraction tasks, and a correlation analysis of microblogging and stock trade volume data that we describe in detail in this paper.</p>
-
-</p>
-
- <p><a href="/news/2012/11/12/btw2013demo.html">Continue reading »</a></p>
- </article>
-
- <hr>
-
- <article>
- <h2 class="blog-title"><a href="/news/2012/10/15/icde2013.html">Stratosphere Demo Accepted for ICDE 2013</a></h2>
- <p>15 Oct 2012</p>
-
- <p> <p>Our demo submission<br />
-<strong><cite>"Peeking into the Optimization of Data Flow Programs with MapReduce-style UDFs"</cite></strong><br />
-has been accepted for ICDE 2013 in Brisbane, Australia.<br />
-The demo illustrates the contributions of our VLDB 2012 paper <cite>"Opening the Black Boxes in Data Flow Optimization"</cite> <a href="/assets/papers/optimizationOfDataFlowsWithUDFs_13.pdf">[PDF]</a> and <a href="/assets/papers/optimizationOfDataFlowsWithUDFs_poster_13.pdf">[Poster PDF]</a>.</p>
-<p>Visit our poster, enjoy the demo, and talk to us if you are going to attend ICDE 2013.</p>
-<p><strong>Abstract:</strong><br />
-Data flows are a popular abstraction to define data-intensive processing tasks. In order to support a wide range of use cases, many data processing systems feature MapReduce-style user-defined functions (UDFs). In contrast to UDFs as known from relational DBMS, MapReduce-style UDFs have less strict templates. These templates do not alone provide all the information needed to decide whether they can be reordered with relational operators and other UDFs. However, it is well-known that reordering operators such as filters, joins, and aggregations can yield runtime improvements by orders of magnitude.<br />
-We demonstrate an optimizer for data flows that is able to reorder operators with MapReduce-style UDFs written in an imperative language. Our approach leverages static code analysis to extract information from UDFs which is used to reason about the reorderbility of UDF operators. This information is sufficient to enumerate a large fraction of the search space covered by conventional RDBMS optimizers including filter and aggregation push-down, bushy join orders, and choice of physical execution strategies based on interesting properties.<br />
-We demonstrate our optimizer and a job submission client that allows users to peek step-by-step into each phase of the optimization process: the static code analysis of UDFs, the enumeration of reordered candidate data flows, the generation of physical execution plans, and their parallel execution. For the demonstration, we provide a selection of relational and non-relational data flow programs which highlight the salient features of our approach.</p>
-
-</p>
-
- <p><a href="/news/2012/10/15/icde2013.html">Continue reading »</a></p>
- </article>
-
- <hr>
-
- <article>
- <h2 class="blog-title"><a href="/news/2012/08/21/release02.html">Version 0.2 Released</a></h2>
- <p>21 Aug 2012</p>
-
- <p><p>We are happy to announce that version 0.2 of the Stratosphere System has been released. It has a lot of performance improvements as well as a bunch of exciting new features like:</p>
-<ul>
-<li>The new Sopremo Algebra Layer and the Meteor Scripting Language</li>
-<li>The whole new tuple data model for the PACT API</li>
-<li>Fault tolerance through local checkpoints</li>
-<li>A ton of performance improvements on all layers</li>
-<li>Support for plug-ins on the data flow channel layer</li>
-<li>Many new library classes (for example new Input-/Output-Formats)</li>
-</ul>
-<p>For a complete list of new features, check out the <a href="https://stratosphere.eu/wiki/doku.php/wiki:changesrelease0.2">change log</a>.</p>
-
-</p>
-
- <p><a href="/news/2012/08/21/release02.html">Continue reading »</a></p>
- </article>
-
- <hr>
-
-
- <!-- Pagination links -->
-
- <ul class="pager">
- <li>
-
- <a href="/blog/page4" class="previous">Previous</a>
-
- </li>
- <li>
- <span class="page_number ">Page: 5 of 5</span>
- </li>
- <li>
-
- <span>Next</span>
-
- </li>
- </ul>
-
- </div>
-
- <div class="col-sm-4" markdown="1">
- <!-- Blog posts by YEAR -->
-
-
-
-
-
- <h2>2016</h2>
-
- <ul id="markdown-toc">
-
- <li><a href="/news/2016/04/06/cep-monitoring.html">Introducing Complex Event Processing (CEP) with Apache Flink</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2016/04/06/release-1.0.1.html">Flink 1.0.1 Released</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2016/03/08/release-1.0.0.html">Announcing Apache Flink 1.0.0</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2016/02/11/release-0.10.2.html">Flink 0.10.2 Released</a></li>
-
-
-
- </ul>
- <hr>
- <h2>2015</h2>
- <ul id="markdown-toc">
-
-
-
-
-
-
-
- <li><a href="/news/2015/12/18/a-year-in-review.html">Flink 2015: A year in review, and a lookout to 2016</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/12/11/storm-compatibility.html">Storm Compatibility in Apache Flink: How to run existing Storm topologies on Flink</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/12/04/Introducing-windows.html">Introducing Stream Windows in Apache Flink</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/11/27/release-0.10.1.html">Flink 0.10.1 released</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/11/16/release-0.10.0.html">Announcing Apache Flink 0.10.0</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/09/16/off-heap-memory.html">Off-heap Memory in Apache Flink and the curious JIT compiler</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/09/03/flink-forward.html">Announcing Flink Forward 2015</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/09/01/release-0.9.1.html">Apache Flink 0.9.1 available</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/08/24/introducing-flink-gelly.html">Introducing Gelly: Graph Processing with Apache Flink</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/06/24/announcing-apache-flink-0.9.0-release.html">Announcing Apache Flink 0.9.0</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/05/14/Community-update-April.html">April 2015 in the Flink community</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/05/11/Juggling-with-Bits-and-Bytes.html">Juggling with Bits and Bytes</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/04/13/release-0.9.0-milestone1.html">Announcing Flink 0.9.0-milestone1 preview release</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/04/07/march-in-flink.html">March 2015 in the Flink community</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/03/13/peeking-into-Apache-Flinks-Engine-Room.html">Peeking into Apache Flink's Engine Room</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/03/02/february-2015-in-flink.html">February 2015 in the Flink community</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/02/09/streaming-example.html">Introducing Flink Streaming</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/02/04/january-in-flink.html">January 2015 in the Flink community</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/01/21/release-0.8.html">Apache Flink 0.8.0 available</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2015/01/06/december-in-flink.html">December 2014 in the Flink community</a></li>
-
-
-
- </ul>
- <hr>
- <h2>2014</h2>
- <ul id="markdown-toc">
-
-
-
-
-
-
-
- <li><a href="/news/2014/11/18/hadoop-compatibility.html">Hadoop Compatibility in Flink</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/11/04/release-0.7.0.html">Apache Flink 0.7.0 available</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/10/03/upcoming_events.html">Upcoming Events</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/09/26/release-0.6.1.html">Apache Flink 0.6.1 available</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/08/26/release-0.6.html">Apache Flink 0.6 available</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/05/31/release-0.5.html">Stratosphere version 0.5 available</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/04/16/stratosphere-goes-apache-incubator.html">Stratosphere accepted as Apache Incubator Project</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/02/24/stratosphere-google-summer-of-code-2014.html">Stratosphere got accepted for Google Summer of Code 2014</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/02/18/amazon-elastic-mapreduce-cloud-yarn.html">Use Stratosphere with Amazon Elastic MapReduce</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/28/querying_mongodb.html">Accessing Data Stored in MongoDB with Stratosphere</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/26/optimizer_plan_visualization_tool.html">Optimizer Plan Visualization Tool</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/13/stratosphere-release-0.4.html">Stratosphere 0.4 Released</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/12/0.4-migration-guide.html">Stratosphere Version 0.4 Migration Guide</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2014/01/10/stratosphere-hadoop-summit.html">Stratosphere got accepted to the Hadoop Summit Europe in Amsterdam</a></li>
-
-
-
- </ul>
- <hr>
- <h2>2013</h2>
- <ul id="markdown-toc">
-
-
-
-
-
-
-
- <li><a href="/news/2013/12/13/humboldt-innovation-award.html">Stratosphere wins award at Humboldt Innovation Competition "Big Data: Research meets Startups"</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2013/10/21/cikm2013-paper.html">Paper "All Roads Lead to Rome: Optimistic Recovery for Distributed Iterative Data Processing" accepted at CIKM 2013</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2013/03/27/www-demo-paper.html">Demo Paper "Large-Scale Social-Media Analytics on Stratosphere" Accepted at WWW 2013</a></li>
-
-
-
- </ul>
- <hr>
- <h2>2012</h2>
- <ul id="markdown-toc">
-
-
-
-
-
-
-
- <li><a href="/news/2012/11/21/previewICDE2013.html">ICDE 2013 Demo Preview</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2012/11/12/btw2013demo.html">Stratosphere Demo Paper Accepted for BTW 2013</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2012/10/15/icde2013.html">Stratosphere Demo Accepted for ICDE 2013</a></li>
-
-
-
-
-
-
-
-
-
- <li><a href="/news/2012/08/21/release02.html">Version 0.2 Released</a></li>
-
-
- </ul>
-
-
- </div>
-</div>
-
- <hr />
- <div class="footer text-center">
- <p>Copyright © 2014-2015 <a href="http://apache.org">The Apache Software Foundation</a>. All Rights Reserved.</p>
- <p>Apache Flink, Apache, and the Apache feather logo are trademarks of The Apache Software Foundation.</p>
- <p><a href="/privacy-policy.html">Privacy Policy</a> · <a href="/blog/feed.xml">RSS feed</a></p>
- </div>
-
- </div><!-- /.container -->
-
- <!-- Include all compiled plugins (below), or include individual files as needed -->
- <script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
- <script src="/js/codetabs.js"></script>
-
- <!-- Google Analytics -->
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-52545728-1', 'auto');
- ga('send', 'pageview');
- </script>
- </body>
-</html>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2012/08/21/release02.html
----------------------------------------------------------------------
diff --git a/content/news/2012/08/21/release02.html b/content/news/2012/08/21/release02.html
deleted file mode 100644
index 810b1d4..0000000
--- a/content/news/2012/08/21/release02.html
+++ /dev/null
@@ -1,217 +0,0 @@
-<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
- <title>Apache Flink: Version 0.2 Released</title>
- <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
- <link rel="icon" href="/favicon.ico" type="image/x-icon">
-
- <!-- Bootstrap -->
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css">
- <link rel="stylesheet" href="/css/flink.css">
- <link rel="stylesheet" href="/css/syntax.css">
-
- <!-- Blog RSS feed -->
- <link href="/blog/feed.xml" rel="alternate" type="application/rss+xml" title="Apache Flink Blog: RSS feed" />
-
- <!-- jQuery (necessary for Bootstrap's JavaScript plugins) -->
- <!-- We need to load Jquery in the header for custom google analytics event tracking-->
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js"></script>
-
- <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
- <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
-
-
- <!-- Top navbar. -->
- <nav class="navbar navbar-default navbar-fixed-top">
- <div class="container">
- <!-- The logo. -->
- <div class="navbar-header">
- <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- <div class="navbar-logo">
- <a href="/">
- <img alt="Apache Flink" src="/img/navbar-brand-logo.jpg" width="78px" height="40px">
- </a>
- </div>
- </div><!-- /.navbar-header -->
-
- <!-- The navigation links. -->
- <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
- <ul class="nav navbar-nav">
-
- <!-- Overview -->
- <li><a href="/index.html">Overview</a></li>
-
- <!-- Features -->
- <li><a href="/features.html">Features</a></li>
-
- <!-- Downloads -->
- <li><a href="/downloads.html">Downloads</a></li>
-
- <!-- FAQ -->
- <li><a href="/faq.html">FAQ</a></li>
-
-
- <!-- Quickstart -->
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Quickstart <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html">Setup</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/run_example_quickstart.html">Example: Wikipedia Edit Stream</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html">Java API</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/scala_api_quickstart.html">Scala API</a></li>
- </ul>
- </li>
-
- <!-- Documentation -->
- <li class="dropdown">
- <a href="" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Documentation <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Latest stable release -->
- <li role="presentation" class="dropdown-header"><strong>Latest Release</strong> (Stable)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0">1.0 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/java" class="active">1.0 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/scala/index.html" class="active">1.0 ScalaDocs</a></li>
-
- <!-- Snapshot docs -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Snapshot</strong> (Development)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master">1.1 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/java" class="active">1.1 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/scala/index.html" class="active">1.1 ScalaDocs</a></li>
-
- <!-- Wiki -->
- <li class="divider"></li>
- <li><a href="/visualizer/"><small><span class="glyphicon glyphicon-new-window"></span></small> Plan Visualizer</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
-
- </ul>
-
- <ul class="nav navbar-nav navbar-right">
- <!-- Blog -->
- <li class=" active hidden-md hidden-sm"><a href="/blog/">Blog</a></li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Community <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Community -->
- <li role="presentation" class="dropdown-header"><strong>Community</strong></li>
- <li><a href="/community.html#mailing-lists">Mailing Lists</a></li>
- <li><a href="/community.html#irc">IRC</a></li>
- <li><a href="/community.html#stack-overflow">Stack Overflow</a></li>
- <li><a href="/community.html#issue-tracker">Issue Tracker</a></li>
- <li><a href="/community.html#third-party-packages">Third Party Packages</a></li>
- <li><a href="/community.html#source-code">Source Code</a></li>
- <li><a href="/community.html#people">People</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink"><small><span class="glyphicon glyphicon-new-window"></span></small> Powered by Flink</a></li>
-
- <!-- Contribute -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Contribute</strong></li>
- <li><a href="/how-to-contribute.html">How to Contribute</a></li>
- <li><a href="/contribute-code.html">Contribute Code</a></li>
- <li><a href="/contribute-documentation.html">Contribute Documentation</a></li>
- <li><a href="/improve-website.html">Improve the Website</a></li>
- </ul>
- </li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Project <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Project -->
- <li role="presentation" class="dropdown-header"><strong>Project</strong></li>
- <li><a href="/slides.html">Slides</a></li>
- <li><a href="/material.html">Material</a></li>
- <li><a href="https://twitter.com/apacheflink"><small><span class="glyphicon glyphicon-new-window"></span></small> Twitter</a></li>
- <li><a href="https://github.com/apache/flink"><small><span class="glyphicon glyphicon-new-window"></span></small> GitHub</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
- </ul>
- </div><!-- /.navbar-collapse -->
- </div><!-- /.container -->
- </nav>
-
-
- <!-- Main content. -->
- <div class="container">
-
-
-<div class="row">
- <div class="col-sm-8 col-sm-offset-2">
- <div class="row">
- <h1>Version 0.2 Released</h1>
-
- <article>
- <p>21 Aug 2012</p>
-
-<p>We are happy to announce that version 0.2 of the Stratosphere System has been released. It has a lot of performance improvements as well as a bunch of exciting new features like:</p>
-<ul>
-<li>The new Sopremo Algebra Layer and the Meteor Scripting Language</li>
-<li>The whole new tuple data model for the PACT API</li>
-<li>Fault tolerance through local checkpoints</li>
-<li>A ton of performance improvements on all layers</li>
-<li>Support for plug-ins on the data flow channel layer</li>
-<li>Many new library classes (for example new Input-/Output-Formats)</li>
-</ul>
-<p>For a complete list of new features, check out the <a href="https://stratosphere.eu/wiki/doku.php/wiki:changesrelease0.2">change log</a>.</p>
- </article>
- </div>
-
- <div class="row">
- <div id="disqus_thread"></div>
- <script type="text/javascript">
- /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
- var disqus_shortname = 'stratosphere-eu'; // required: replace example with your forum shortname
-
- /* * * DON'T EDIT BELOW THIS LINE * * */
- (function() {
- var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
- dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js';
- (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
- })();
- </script>
- </div>
- </div>
-</div>
-
- <hr />
- <div class="footer text-center">
- <p>Copyright © 2014-2015 <a href="http://apache.org">The Apache Software Foundation</a>. All Rights Reserved.</p>
- <p>Apache Flink, Apache, and the Apache feather logo are trademarks of The Apache Software Foundation.</p>
- <p><a href="/privacy-policy.html">Privacy Policy</a> · <a href="/blog/feed.xml">RSS feed</a></p>
- </div>
-
- </div><!-- /.container -->
-
- <!-- Include all compiled plugins (below), or include individual files as needed -->
- <script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
- <script src="/js/codetabs.js"></script>
-
- <!-- Google Analytics -->
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-52545728-1', 'auto');
- ga('send', 'pageview');
- </script>
- </body>
-</html>
[3/8] flink-web git commit: rebuild web page
Posted by mj...@apache.org.
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2014/02/18/amazon-elastic-mapreduce-cloud-yarn.html
----------------------------------------------------------------------
diff --git a/content/news/2014/02/18/amazon-elastic-mapreduce-cloud-yarn.html b/content/news/2014/02/18/amazon-elastic-mapreduce-cloud-yarn.html
deleted file mode 100644
index 4616924..0000000
--- a/content/news/2014/02/18/amazon-elastic-mapreduce-cloud-yarn.html
+++ /dev/null
@@ -1,390 +0,0 @@
-<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
- <title>Apache Flink: Use Stratosphere with Amazon Elastic MapReduce</title>
- <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
- <link rel="icon" href="/favicon.ico" type="image/x-icon">
-
- <!-- Bootstrap -->
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css">
- <link rel="stylesheet" href="/css/flink.css">
- <link rel="stylesheet" href="/css/syntax.css">
-
- <!-- Blog RSS feed -->
- <link href="/blog/feed.xml" rel="alternate" type="application/rss+xml" title="Apache Flink Blog: RSS feed" />
-
- <!-- jQuery (necessary for Bootstrap's JavaScript plugins) -->
- <!-- We need to load Jquery in the header for custom google analytics event tracking-->
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js"></script>
-
- <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
- <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
-
-
- <!-- Top navbar. -->
- <nav class="navbar navbar-default navbar-fixed-top">
- <div class="container">
- <!-- The logo. -->
- <div class="navbar-header">
- <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- <div class="navbar-logo">
- <a href="/">
- <img alt="Apache Flink" src="/img/navbar-brand-logo.jpg" width="78px" height="40px">
- </a>
- </div>
- </div><!-- /.navbar-header -->
-
- <!-- The navigation links. -->
- <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
- <ul class="nav navbar-nav">
-
- <!-- Overview -->
- <li><a href="/index.html">Overview</a></li>
-
- <!-- Features -->
- <li><a href="/features.html">Features</a></li>
-
- <!-- Downloads -->
- <li><a href="/downloads.html">Downloads</a></li>
-
- <!-- FAQ -->
- <li><a href="/faq.html">FAQ</a></li>
-
-
- <!-- Quickstart -->
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Quickstart <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html">Setup</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/run_example_quickstart.html">Example: Wikipedia Edit Stream</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html">Java API</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/scala_api_quickstart.html">Scala API</a></li>
- </ul>
- </li>
-
- <!-- Documentation -->
- <li class="dropdown">
- <a href="" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Documentation <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Latest stable release -->
- <li role="presentation" class="dropdown-header"><strong>Latest Release</strong> (Stable)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0">1.0 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/java" class="active">1.0 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/scala/index.html" class="active">1.0 ScalaDocs</a></li>
-
- <!-- Snapshot docs -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Snapshot</strong> (Development)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master">1.1 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/java" class="active">1.1 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/scala/index.html" class="active">1.1 ScalaDocs</a></li>
-
- <!-- Wiki -->
- <li class="divider"></li>
- <li><a href="/visualizer/"><small><span class="glyphicon glyphicon-new-window"></span></small> Plan Visualizer</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
-
- </ul>
-
- <ul class="nav navbar-nav navbar-right">
- <!-- Blog -->
- <li class=" active hidden-md hidden-sm"><a href="/blog/">Blog</a></li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Community <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Community -->
- <li role="presentation" class="dropdown-header"><strong>Community</strong></li>
- <li><a href="/community.html#mailing-lists">Mailing Lists</a></li>
- <li><a href="/community.html#irc">IRC</a></li>
- <li><a href="/community.html#stack-overflow">Stack Overflow</a></li>
- <li><a href="/community.html#issue-tracker">Issue Tracker</a></li>
- <li><a href="/community.html#third-party-packages">Third Party Packages</a></li>
- <li><a href="/community.html#source-code">Source Code</a></li>
- <li><a href="/community.html#people">People</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink"><small><span class="glyphicon glyphicon-new-window"></span></small> Powered by Flink</a></li>
-
- <!-- Contribute -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Contribute</strong></li>
- <li><a href="/how-to-contribute.html">How to Contribute</a></li>
- <li><a href="/contribute-code.html">Contribute Code</a></li>
- <li><a href="/contribute-documentation.html">Contribute Documentation</a></li>
- <li><a href="/improve-website.html">Improve the Website</a></li>
- </ul>
- </li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Project <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Project -->
- <li role="presentation" class="dropdown-header"><strong>Project</strong></li>
- <li><a href="/slides.html">Slides</a></li>
- <li><a href="/material.html">Material</a></li>
- <li><a href="https://twitter.com/apacheflink"><small><span class="glyphicon glyphicon-new-window"></span></small> Twitter</a></li>
- <li><a href="https://github.com/apache/flink"><small><span class="glyphicon glyphicon-new-window"></span></small> GitHub</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
- </ul>
- </div><!-- /.navbar-collapse -->
- </div><!-- /.container -->
- </nav>
-
-
- <!-- Main content. -->
- <div class="container">
-
-
-<div class="row">
- <div class="col-sm-8 col-sm-offset-2">
- <div class="row">
- <h1>Use Stratosphere with Amazon Elastic MapReduce</h1>
-
- <article>
- <p>18 Feb 2014 by Robert Metzger (<a href="https://twitter.com/rmetzger_">@rmetzger_</a>)</p>
-
-<div class="lead">Get started with Stratosphere within 10 minutes using Amazon Elastic MapReduce.</div>
-
-<p>This step-by-step tutorial will guide you through the setup of Stratosphere using Amazon Elastic MapReduce.</p>
-
-<h3 id="background">Background</h3>
-<p><a href="http://aws.amazon.com/elasticmapreduce/">Amazon Elastic MapReduce</a> (Amazon EMR) is part of Amazon Web services. EMR allows to create Hadoop clusters that analyze data stored in Amazon S3 (AWS’ cloud storage). Stratosphere runs on top of Hadoop using the <a href="http://hadoop.apache.org/docs/r2.2.0/hadoop-project-dist/hadoop-common/releasenotes.html">recently</a> released cluster resource manager <a href="http://hadoop.apache.org/docs/current2/hadoop-yarn/hadoop-yarn-site/YARN.html">YARN</a>. YARN allows to use many different data analysis tools in your cluster side by side. Tools that run with YARN are, for example <a href="https://giraph.apache.org/">Apache Giraph</a>, <a href="http://spark.incubator.apache.org/">Spark</a> or <a href="http://hortonworks.com/blog/introducing-hoya-hbase-on-yarn/">HBase</a>. Stratosphere also <a href="/docs/0.4/setup/yarn.html">runs on YARN</a> and that’s the approach for this tutorial.</p>
-
-<h3 id="step-login-to-aws-and-prepare-secure-access">1. Step: Login to AWS and prepare secure access</h3>
-
-<ul>
- <li>Log in to the <a href="https://console.aws.amazon.com/console/home">AWS Console</a></li>
-</ul>
-
-<p>You need to have SSH keys to access the Hadoop master node. If you do not have keys for your computer, generate them:</p>
-
-<div class="row" style="padding-top:15px">
- <div class="col-md-6">
-<a data-lightbox="example-1" href="/img/blog/emr-security.png"><img class="img-responsive" src="/img/blog/emr-security.png" /></a>
- </div>
- <div class="col-md-6">
- <ul>
- <li>Select <a href="https://console.aws.amazon.com/ec2/v2/home">EC2</a> and click on "Key Pairs" in the "NETWORK & SECURITY" section.</li>
- <li>Click on "Create Key Pair" and give it a name</li>
- <li>After pressing "Yes" it will download a .pem file.</li>
- <li>Change the permissions of the .pem file</li>
-
-<div class="highlight"><pre><code class="language-bash" data-lang="bash">chmod og-rwx ~/work-laptop.pem</code></pre></div>
-
- </ul>
- </div>
-</div>
-
-<h3 id="step-create-your-hadoop-cluster-in-the-cloud">2. Step: Create your Hadoop Cluster in the cloud</h3>
-
-<ul>
- <li>Select <a href="https://console.aws.amazon.com/elasticmapreduce/vnext/">Elastic MapReduce</a> from the AWS console</li>
- <li>Click the blue “Create cluster” button.</li>
-</ul>
-
-<div class="row" style="padding-top:15px">
- <div class="col-md-6">
-<a data-lightbox="example-1" href="/img/blog/emr-hadoopversion.png"><img class="img-responsive" src="/img/blog/emr-hadoopversion.png" /></a>
- </div>
- <div class="col-md-6">
- <ul>
- <li>Choose a Cluster name</li>
- <li>You can let the other settings remain unchanged (termination protection, logging, debugging)</li>
- <li>For the Hadoop distribution, it is very important to choose one with YARN support. We use <b>3.0.3 (Hadoop 2.2.0)</b> (the minor version might change over time)</li>
- <li>Remove all applications to be installed (unless you want to use them)</li>
- <li>Choose the instance types you want to start. Stratosphere runs fine with m1.large instances. Core and Task instances both run Stratosphere, but only core instances contain HDFS data nodes.</li>
- <li>Choose the <b>EC2 key pair</b> you've created in the previous step!</li>
- </ul>
- </div>
-</div>
-
-<ul>
- <li>Thats it! You can now press the “Create cluster” button at the end of the form to boot it!</li>
-</ul>
-
-<h3 id="step-launch-stratosphere">3. Step: Launch Stratosphere</h3>
-
-<p>You might need to wait a few minutes until Amazon started your cluster. (You can monitor the progress of the instances in EC2). Use the refresh button in the top right corner.</p>
-
-<p>You see that the master is up if the field <b>Master public DNS</b> contains a value (first line), connect to it using SSH.</p>
-
-<div class="highlight"><pre><code class="language-bash" data-lang="bash">ssh hadoop@<your master public DNS> -i <path to your .pem>
-<span class="c"># for my example, it looks like this:</span>
-ssh hadoop@ec2-54-213-61-105.us-west-2.compute.amazonaws.com -i ~/Downloads/work-laptop.pem</code></pre></div>
-
-<p>(Windows users have to follow <a href="http://docs.aws.amazon.com/ElasticMapReduce/latest/DeveloperGuide/emr-connect-master-node-ssh.html">these instructions</a> to SSH into the machine running the master.) </br></br>
-Once connected to the master, download and start Stratosphere for YARN: </p>
-<ul>
- <li>Download and extract Stratosphere-YARN</li>
-
-<div class="highlight"><pre><code class="language-bash" data-lang="bash">wget http://stratosphere-bin.s3-website-us-east-1.amazonaws.com/stratosphere-dist-0.5-SNAPSHOT-yarn.tar.gz
-<span class="c"># extract it</span>
-tar xvzf stratosphere-dist-0.5-SNAPSHOT-yarn.tar.gz</code></pre></div>
-
- <li>Start Stratosphere in the cluster using Hadoop YARN</li>
-
-
-<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="nb">cd </span>stratosphere-yarn-0.5-SNAPSHOT/
-./bin/yarn-session.sh -n <span class="m">4</span> -jm <span class="m">1024</span> -tm 3000</code></pre></div>
-
-
-The arguments have the following meaning
- <ul>
- <li><code>-n</code> number of TaskManagers (=workers). This number must not exeed the number of task instances</li>
- <li><code>-jm</code> memory (heapspace) for the JobManager</li>
- <li><code>-tm</code> memory for the TaskManagers</li>
- </ul>
-</ul>
-
-<p>Once the output has changed from </p>
-
-<div class="highlight"><pre><code class="language-bash" data-lang="bash">JobManager is now running on N/A:6123</code></pre></div>
-
-<p>to </p>
-
-<div class="highlight"><pre><code class="language-bash" data-lang="bash">JobManager is now running on ip-172-31-13-68.us-west-2.compute.internal:6123</code></pre></div>
-
-<p>Stratosphere has started the JobManager. It will take a few seconds until the TaskManagers (workers) have connected to the JobManager. To see how many TaskManagers connected, you have to access the JobManager’s web interface. Follow the steps below to do that …</p>
-
-<h3> 4. Step: Launch a Stratosphere Job</h3>
-
-<p>This step shows how to submit and monitor a Stratosphere Job in the Amazon Cloud.</p>
-
-<ul>
-<li> Open an additional terminal and connect again to the master of your cluster. </li>
-
-We recommend to create a SOCKS-proxy with your SSH that allows you to easily connect into the cluster. (If you've already a VPN setup with EC2, you can probably use that as well.)
-
-
-<div class="highlight"><pre><code class="language-bash" data-lang="bash">ssh -D localhost:2001 hadoop@<your master dns name> -i <your pem file></code></pre></div>
-
-
-Notice the <code>-D localhost:2001</code> argument: It opens a SOCKS proxy on your computer allowing any application to use it to communicate through the proxy via an SSH tunnel to the master node. This allows you to access all services in your EMR cluster, such as the HDFS NameNode or the YARN web interface.
-
-<li>Configure a browser to use the SOCKS proxy. Open a browser with SOCKS proxy support (such as Firefox). Ideally, do not use your primary browser for this, since ALL traffic will be routed through Amazon.</li>
-
-<div class="row" style="padding-top:15px">
- <div class="col-md-6">
-<a data-lightbox="example-1" href="/img/blog/emr-firefoxsettings.png"><img class="img-responsive" src="/img/blog/emr-firefoxsettings.png" /></a>
- </div>
- <div class="col-md-6">
- <ul>
- <li>To configure the SOCKS proxy with Firefox, click on "Edit", "Preferences", choose the "Advanced" tab and press the "Settings ..." button.</li>
- <li>Enter the details of the SOCKS proxy <b>localhost:2001</b>. Choose SOCKS v4.</li>
- <li>Close the settings, your browser is now talking to the master node of your cluster</li>
- </ul>
- </div>
-</div>
-
-</ul>
-
-<p>Since you’re connected to the master now, you can open several web interfaces: <br />
-<b>YARN Resource Manager</b>: <code>http://<masterIPAddress>:9026/</code> <br />
-<b>HDFS NameNode</b>: <code>http://<masterIPAddress>:9101/</code></p>
-
-<p>You find the <code>masterIPAddress</code> by entering <code>ifconfig</code> into the terminal:</p>
-
-<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="o">[</span>hadoop@ip-172-31-38-95 ~<span class="o">]</span><span class="nv">$ </span>ifconfig
-eth0 Link encap:Ethernet HWaddr 02:CF:8E:CB:28:B2
- inet addr:172.31.38.95 Bcast:172.31.47.255 Mask:255.255.240.0
- inet6 addr: fe80::cf:8eff:fecb:28b2/64 Scope:Link
- RX bytes:166314967 <span class="o">(</span>158.6 MiB<span class="o">)</span> TX bytes:89319246 <span class="o">(</span>85.1 MiB<span class="o">)</span></code></pre></div>
-
-<p><strong>Optional:</strong> If you want to use the hostnames within your Firefox (that also makes the NameNode links work), you have to enable DNS resolution over the SOCKS proxy. Open the Firefox config <code>about:config</code> and set <code>network.proxy.socks_remote_dns</code> to <code>true</code>.</p>
-
-<p>The YARN ResourceManager also allows you to connect to <b>Stratosphere’s JobManager web interface</b>. Click the <b>ApplicationMaster</b> link in the “Tracking UI” column.</p>
-
-<p>To run the Wordcount example, you have to upload some sample data.</p>
-
-<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="c"># download a text</span>
-wget http://www.gnu.org/licenses/gpl.txt
-<span class="c"># upload it to HDFS:</span>
-hadoop fs -copyFromLocal gpl.txt /input</code></pre></div>
-
-<p>To run a Job, enter the following command into the master’s command line:</p>
-
-<div class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="c"># optional: go to the extracted directory</span>
-<span class="nb">cd </span>stratosphere-yarn-0.5-SNAPSHOT/
-<span class="c"># run the wordcount example</span>
-./bin/stratosphere run -w -j examples/stratosphere-java-examples-0.5-SNAPSHOT-WordCount.jar -a <span class="m">16</span> hdfs:///input hdfs:///output</code></pre></div>
-
-<p>Make sure that the number of TaskManager’s have connected to the JobManager.</p>
-
-<p>Lets go through the command in detail:</p>
-
-<ul>
- <li><code>./bin/stratosphere</code> is the standard launcher for Stratosphere jobs from the command line</li>
- <li>The <code>-w</code> flag stands for “wait”. It is a very useful to track the progress of the job.</li>
- <li><code>-j examples/stratosphere-java-examples-0.5-SNAPSHOT-WordCount.jar</code> the <code>-j</code> command sets the jar file containing the job. If you have you own application, place your Jar-file here.</li>
- <li><code>-a 16 hdfs:///input hdfs:///output</code> the <code>-a</code> command specifies the Job-specific arguments. In this case, the wordcount expects the following input <code><numSubStasks> <input> <output></code>.</li>
-</ul>
-
-<p>You can monitor the progress of your job in the JobManager webinterface. Once the job has finished (which should be the case after less than 10 seconds), you can analyze it there.
-Inspect the result in HDFS using:</p>
-
-<div class="highlight"><pre><code class="language-bash" data-lang="bash">hadoop fs -tail /output</code></pre></div>
-
-<p>If you want to shut down the whole cluster in the cloud, use Amazon’s webinterface and click on “Terminate cluster”. If you just want to stop the YARN session, press CTRL+C in the terminal. The Stratosphere instances will be killed by YARN.</p>
-
- </article>
- </div>
-
- <div class="row">
- <div id="disqus_thread"></div>
- <script type="text/javascript">
- /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
- var disqus_shortname = 'stratosphere-eu'; // required: replace example with your forum shortname
-
- /* * * DON'T EDIT BELOW THIS LINE * * */
- (function() {
- var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
- dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js';
- (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
- })();
- </script>
- </div>
- </div>
-</div>
-
- <hr />
- <div class="footer text-center">
- <p>Copyright © 2014-2015 <a href="http://apache.org">The Apache Software Foundation</a>. All Rights Reserved.</p>
- <p>Apache Flink, Apache, and the Apache feather logo are trademarks of The Apache Software Foundation.</p>
- <p><a href="/privacy-policy.html">Privacy Policy</a> · <a href="/blog/feed.xml">RSS feed</a></p>
- </div>
-
- </div><!-- /.container -->
-
- <!-- Include all compiled plugins (below), or include individual files as needed -->
- <script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
- <script src="/js/codetabs.js"></script>
-
- <!-- Google Analytics -->
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-52545728-1', 'auto');
- ga('send', 'pageview');
- </script>
- </body>
-</html>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2014/02/24/stratosphere-google-summer-of-code-2014.html
----------------------------------------------------------------------
diff --git a/content/news/2014/02/24/stratosphere-google-summer-of-code-2014.html b/content/news/2014/02/24/stratosphere-google-summer-of-code-2014.html
deleted file mode 100644
index 142fe2e..0000000
--- a/content/news/2014/02/24/stratosphere-google-summer-of-code-2014.html
+++ /dev/null
@@ -1,217 +0,0 @@
-<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
- <title>Apache Flink: Stratosphere got accepted for Google Summer of Code 2014</title>
- <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
- <link rel="icon" href="/favicon.ico" type="image/x-icon">
-
- <!-- Bootstrap -->
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css">
- <link rel="stylesheet" href="/css/flink.css">
- <link rel="stylesheet" href="/css/syntax.css">
-
- <!-- Blog RSS feed -->
- <link href="/blog/feed.xml" rel="alternate" type="application/rss+xml" title="Apache Flink Blog: RSS feed" />
-
- <!-- jQuery (necessary for Bootstrap's JavaScript plugins) -->
- <!-- We need to load Jquery in the header for custom google analytics event tracking-->
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js"></script>
-
- <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
- <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
-
-
- <!-- Top navbar. -->
- <nav class="navbar navbar-default navbar-fixed-top">
- <div class="container">
- <!-- The logo. -->
- <div class="navbar-header">
- <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- <div class="navbar-logo">
- <a href="/">
- <img alt="Apache Flink" src="/img/navbar-brand-logo.jpg" width="78px" height="40px">
- </a>
- </div>
- </div><!-- /.navbar-header -->
-
- <!-- The navigation links. -->
- <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
- <ul class="nav navbar-nav">
-
- <!-- Overview -->
- <li><a href="/index.html">Overview</a></li>
-
- <!-- Features -->
- <li><a href="/features.html">Features</a></li>
-
- <!-- Downloads -->
- <li><a href="/downloads.html">Downloads</a></li>
-
- <!-- FAQ -->
- <li><a href="/faq.html">FAQ</a></li>
-
-
- <!-- Quickstart -->
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Quickstart <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html">Setup</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/run_example_quickstart.html">Example: Wikipedia Edit Stream</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html">Java API</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/scala_api_quickstart.html">Scala API</a></li>
- </ul>
- </li>
-
- <!-- Documentation -->
- <li class="dropdown">
- <a href="" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Documentation <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Latest stable release -->
- <li role="presentation" class="dropdown-header"><strong>Latest Release</strong> (Stable)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0">1.0 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/java" class="active">1.0 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/scala/index.html" class="active">1.0 ScalaDocs</a></li>
-
- <!-- Snapshot docs -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Snapshot</strong> (Development)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master">1.1 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/java" class="active">1.1 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/scala/index.html" class="active">1.1 ScalaDocs</a></li>
-
- <!-- Wiki -->
- <li class="divider"></li>
- <li><a href="/visualizer/"><small><span class="glyphicon glyphicon-new-window"></span></small> Plan Visualizer</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
-
- </ul>
-
- <ul class="nav navbar-nav navbar-right">
- <!-- Blog -->
- <li class=" active hidden-md hidden-sm"><a href="/blog/">Blog</a></li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Community <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Community -->
- <li role="presentation" class="dropdown-header"><strong>Community</strong></li>
- <li><a href="/community.html#mailing-lists">Mailing Lists</a></li>
- <li><a href="/community.html#irc">IRC</a></li>
- <li><a href="/community.html#stack-overflow">Stack Overflow</a></li>
- <li><a href="/community.html#issue-tracker">Issue Tracker</a></li>
- <li><a href="/community.html#third-party-packages">Third Party Packages</a></li>
- <li><a href="/community.html#source-code">Source Code</a></li>
- <li><a href="/community.html#people">People</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink"><small><span class="glyphicon glyphicon-new-window"></span></small> Powered by Flink</a></li>
-
- <!-- Contribute -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Contribute</strong></li>
- <li><a href="/how-to-contribute.html">How to Contribute</a></li>
- <li><a href="/contribute-code.html">Contribute Code</a></li>
- <li><a href="/contribute-documentation.html">Contribute Documentation</a></li>
- <li><a href="/improve-website.html">Improve the Website</a></li>
- </ul>
- </li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Project <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Project -->
- <li role="presentation" class="dropdown-header"><strong>Project</strong></li>
- <li><a href="/slides.html">Slides</a></li>
- <li><a href="/material.html">Material</a></li>
- <li><a href="https://twitter.com/apacheflink"><small><span class="glyphicon glyphicon-new-window"></span></small> Twitter</a></li>
- <li><a href="https://github.com/apache/flink"><small><span class="glyphicon glyphicon-new-window"></span></small> GitHub</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
- </ul>
- </div><!-- /.navbar-collapse -->
- </div><!-- /.container -->
- </nav>
-
-
- <!-- Main content. -->
- <div class="container">
-
-
-<div class="row">
- <div class="col-sm-8 col-sm-offset-2">
- <div class="row">
- <h1>Stratosphere got accepted for Google Summer of Code 2014</h1>
-
- <article>
- <p>24 Feb 2014</p>
-
-<div class="lead">Students: Apply now for exciting summer projects in the Big Data / Analytics field</div>
-
-<p>We are pleased to announce that Stratosphere got accepted to <a href="http://www.google-melange.com/gsoc/homepage/google/gsoc2014">Google Summer of Code 2014</a> as a mentoring organization. This means that we will host a bunch of students to conduct projects within Stratosphere over the summer. <a href="http://en.flossmanuals.net/GSoCStudentGuide/">Read more on the GSoC manual for students</a> and the <a href="http://www.google-melange.com/gsoc/document/show/gsoc_program/google/gsoc2014/help_page">official FAQ</a>. Students can improve their coding skills, learn to work with open-source projects, improve their CV and get a nice paycheck from Google.</p>
-
-<p>If you are an interested student, check out our <a href="https://github.com/stratosphere/stratosphere/wiki/Google-Summer-of-Code-2014">idea list</a> in the wiki. It contains different projects with varying ranges of difficulty and requirement profiles. Students can also suggest their own projects.</p>
-
-<p>We welcome students to sign up at our <a href="https://groups.google.com/forum/#!forum/stratosphere-dev">developer mailing list</a> to discuss their ideas.
-Applying students can use our wiki (create a new page) to create a project proposal. We are happy to have a look at it.</p>
-
-
- </article>
- </div>
-
- <div class="row">
- <div id="disqus_thread"></div>
- <script type="text/javascript">
- /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
- var disqus_shortname = 'stratosphere-eu'; // required: replace example with your forum shortname
-
- /* * * DON'T EDIT BELOW THIS LINE * * */
- (function() {
- var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
- dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js';
- (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
- })();
- </script>
- </div>
- </div>
-</div>
-
- <hr />
- <div class="footer text-center">
- <p>Copyright © 2014-2015 <a href="http://apache.org">The Apache Software Foundation</a>. All Rights Reserved.</p>
- <p>Apache Flink, Apache, and the Apache feather logo are trademarks of The Apache Software Foundation.</p>
- <p><a href="/privacy-policy.html">Privacy Policy</a> · <a href="/blog/feed.xml">RSS feed</a></p>
- </div>
-
- </div><!-- /.container -->
-
- <!-- Include all compiled plugins (below), or include individual files as needed -->
- <script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
- <script src="/js/codetabs.js"></script>
-
- <!-- Google Analytics -->
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-52545728-1', 'auto');
- ga('send', 'pageview');
- </script>
- </body>
-</html>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2014/04/16/stratosphere-goes-apache-incubator.html
----------------------------------------------------------------------
diff --git a/content/news/2014/04/16/stratosphere-goes-apache-incubator.html b/content/news/2014/04/16/stratosphere-goes-apache-incubator.html
deleted file mode 100644
index d844f2b..0000000
--- a/content/news/2014/04/16/stratosphere-goes-apache-incubator.html
+++ /dev/null
@@ -1,212 +0,0 @@
-<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
- <title>Apache Flink: Stratosphere accepted as Apache Incubator Project</title>
- <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
- <link rel="icon" href="/favicon.ico" type="image/x-icon">
-
- <!-- Bootstrap -->
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css">
- <link rel="stylesheet" href="/css/flink.css">
- <link rel="stylesheet" href="/css/syntax.css">
-
- <!-- Blog RSS feed -->
- <link href="/blog/feed.xml" rel="alternate" type="application/rss+xml" title="Apache Flink Blog: RSS feed" />
-
- <!-- jQuery (necessary for Bootstrap's JavaScript plugins) -->
- <!-- We need to load Jquery in the header for custom google analytics event tracking-->
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js"></script>
-
- <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
- <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
-
-
- <!-- Top navbar. -->
- <nav class="navbar navbar-default navbar-fixed-top">
- <div class="container">
- <!-- The logo. -->
- <div class="navbar-header">
- <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- <div class="navbar-logo">
- <a href="/">
- <img alt="Apache Flink" src="/img/navbar-brand-logo.jpg" width="78px" height="40px">
- </a>
- </div>
- </div><!-- /.navbar-header -->
-
- <!-- The navigation links. -->
- <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
- <ul class="nav navbar-nav">
-
- <!-- Overview -->
- <li><a href="/index.html">Overview</a></li>
-
- <!-- Features -->
- <li><a href="/features.html">Features</a></li>
-
- <!-- Downloads -->
- <li><a href="/downloads.html">Downloads</a></li>
-
- <!-- FAQ -->
- <li><a href="/faq.html">FAQ</a></li>
-
-
- <!-- Quickstart -->
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Quickstart <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html">Setup</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/run_example_quickstart.html">Example: Wikipedia Edit Stream</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html">Java API</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/scala_api_quickstart.html">Scala API</a></li>
- </ul>
- </li>
-
- <!-- Documentation -->
- <li class="dropdown">
- <a href="" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Documentation <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Latest stable release -->
- <li role="presentation" class="dropdown-header"><strong>Latest Release</strong> (Stable)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0">1.0 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/java" class="active">1.0 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/scala/index.html" class="active">1.0 ScalaDocs</a></li>
-
- <!-- Snapshot docs -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Snapshot</strong> (Development)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master">1.1 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/java" class="active">1.1 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/scala/index.html" class="active">1.1 ScalaDocs</a></li>
-
- <!-- Wiki -->
- <li class="divider"></li>
- <li><a href="/visualizer/"><small><span class="glyphicon glyphicon-new-window"></span></small> Plan Visualizer</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
-
- </ul>
-
- <ul class="nav navbar-nav navbar-right">
- <!-- Blog -->
- <li class=" active hidden-md hidden-sm"><a href="/blog/">Blog</a></li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Community <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Community -->
- <li role="presentation" class="dropdown-header"><strong>Community</strong></li>
- <li><a href="/community.html#mailing-lists">Mailing Lists</a></li>
- <li><a href="/community.html#irc">IRC</a></li>
- <li><a href="/community.html#stack-overflow">Stack Overflow</a></li>
- <li><a href="/community.html#issue-tracker">Issue Tracker</a></li>
- <li><a href="/community.html#third-party-packages">Third Party Packages</a></li>
- <li><a href="/community.html#source-code">Source Code</a></li>
- <li><a href="/community.html#people">People</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink"><small><span class="glyphicon glyphicon-new-window"></span></small> Powered by Flink</a></li>
-
- <!-- Contribute -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Contribute</strong></li>
- <li><a href="/how-to-contribute.html">How to Contribute</a></li>
- <li><a href="/contribute-code.html">Contribute Code</a></li>
- <li><a href="/contribute-documentation.html">Contribute Documentation</a></li>
- <li><a href="/improve-website.html">Improve the Website</a></li>
- </ul>
- </li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Project <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Project -->
- <li role="presentation" class="dropdown-header"><strong>Project</strong></li>
- <li><a href="/slides.html">Slides</a></li>
- <li><a href="/material.html">Material</a></li>
- <li><a href="https://twitter.com/apacheflink"><small><span class="glyphicon glyphicon-new-window"></span></small> Twitter</a></li>
- <li><a href="https://github.com/apache/flink"><small><span class="glyphicon glyphicon-new-window"></span></small> GitHub</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
- </ul>
- </div><!-- /.navbar-collapse -->
- </div><!-- /.container -->
- </nav>
-
-
- <!-- Main content. -->
- <div class="container">
-
-
-<div class="row">
- <div class="col-sm-8 col-sm-offset-2">
- <div class="row">
- <h1>Stratosphere accepted as Apache Incubator Project</h1>
-
- <article>
- <p>16 Apr 2014</p>
-
-<p>We are happy to announce that Stratosphere has been accepted as a project for the <a href="https://incubator.apache.org/">Apache Incubator</a>. The <a href="https://wiki.apache.org/incubator/StratosphereProposal">proposal</a> has been accepted by the Incubator PMC members earlier this week. The Apache Incubator is the first step in the process of giving a project to the <a href="http://apache.org">Apache Software Foundation</a>. While under incubation, the project will move to the Apache infrastructure and adopt the community-driven development principles of the Apache Foundation. Projects can graduate from incubation to become top-level projects if they show activity, a healthy community dynamic, and releases.</p>
-
-<p>We are glad to have Alan Gates as champion on board, as well as a set of great mentors, including Sean Owen, Ted Dunning, Owen O’Malley, Henry Saputra, and Ashutosh Chauhan. We are confident that we will make this a great open source effort.</p>
-
-
- </article>
- </div>
-
- <div class="row">
- <div id="disqus_thread"></div>
- <script type="text/javascript">
- /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
- var disqus_shortname = 'stratosphere-eu'; // required: replace example with your forum shortname
-
- /* * * DON'T EDIT BELOW THIS LINE * * */
- (function() {
- var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
- dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js';
- (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
- })();
- </script>
- </div>
- </div>
-</div>
-
- <hr />
- <div class="footer text-center">
- <p>Copyright © 2014-2015 <a href="http://apache.org">The Apache Software Foundation</a>. All Rights Reserved.</p>
- <p>Apache Flink, Apache, and the Apache feather logo are trademarks of The Apache Software Foundation.</p>
- <p><a href="/privacy-policy.html">Privacy Policy</a> · <a href="/blog/feed.xml">RSS feed</a></p>
- </div>
-
- </div><!-- /.container -->
-
- <!-- Include all compiled plugins (below), or include individual files as needed -->
- <script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
- <script src="/js/codetabs.js"></script>
-
- <!-- Google Analytics -->
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-52545728-1', 'auto');
- ga('send', 'pageview');
- </script>
- </body>
-</html>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2014/05/31/release-0.5.html
----------------------------------------------------------------------
diff --git a/content/news/2014/05/31/release-0.5.html b/content/news/2014/05/31/release-0.5.html
deleted file mode 100644
index 06cbc72..0000000
--- a/content/news/2014/05/31/release-0.5.html
+++ /dev/null
@@ -1,289 +0,0 @@
-<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
- <title>Apache Flink: Stratosphere version 0.5 available</title>
- <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
- <link rel="icon" href="/favicon.ico" type="image/x-icon">
-
- <!-- Bootstrap -->
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css">
- <link rel="stylesheet" href="/css/flink.css">
- <link rel="stylesheet" href="/css/syntax.css">
-
- <!-- Blog RSS feed -->
- <link href="/blog/feed.xml" rel="alternate" type="application/rss+xml" title="Apache Flink Blog: RSS feed" />
-
- <!-- jQuery (necessary for Bootstrap's JavaScript plugins) -->
- <!-- We need to load Jquery in the header for custom google analytics event tracking-->
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js"></script>
-
- <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
- <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
-
-
- <!-- Top navbar. -->
- <nav class="navbar navbar-default navbar-fixed-top">
- <div class="container">
- <!-- The logo. -->
- <div class="navbar-header">
- <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- <div class="navbar-logo">
- <a href="/">
- <img alt="Apache Flink" src="/img/navbar-brand-logo.jpg" width="78px" height="40px">
- </a>
- </div>
- </div><!-- /.navbar-header -->
-
- <!-- The navigation links. -->
- <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
- <ul class="nav navbar-nav">
-
- <!-- Overview -->
- <li><a href="/index.html">Overview</a></li>
-
- <!-- Features -->
- <li><a href="/features.html">Features</a></li>
-
- <!-- Downloads -->
- <li><a href="/downloads.html">Downloads</a></li>
-
- <!-- FAQ -->
- <li><a href="/faq.html">FAQ</a></li>
-
-
- <!-- Quickstart -->
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Quickstart <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html">Setup</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/run_example_quickstart.html">Example: Wikipedia Edit Stream</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html">Java API</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/scala_api_quickstart.html">Scala API</a></li>
- </ul>
- </li>
-
- <!-- Documentation -->
- <li class="dropdown">
- <a href="" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Documentation <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Latest stable release -->
- <li role="presentation" class="dropdown-header"><strong>Latest Release</strong> (Stable)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0">1.0 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/java" class="active">1.0 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/scala/index.html" class="active">1.0 ScalaDocs</a></li>
-
- <!-- Snapshot docs -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Snapshot</strong> (Development)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master">1.1 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/java" class="active">1.1 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/scala/index.html" class="active">1.1 ScalaDocs</a></li>
-
- <!-- Wiki -->
- <li class="divider"></li>
- <li><a href="/visualizer/"><small><span class="glyphicon glyphicon-new-window"></span></small> Plan Visualizer</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
-
- </ul>
-
- <ul class="nav navbar-nav navbar-right">
- <!-- Blog -->
- <li class=" active hidden-md hidden-sm"><a href="/blog/">Blog</a></li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Community <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Community -->
- <li role="presentation" class="dropdown-header"><strong>Community</strong></li>
- <li><a href="/community.html#mailing-lists">Mailing Lists</a></li>
- <li><a href="/community.html#irc">IRC</a></li>
- <li><a href="/community.html#stack-overflow">Stack Overflow</a></li>
- <li><a href="/community.html#issue-tracker">Issue Tracker</a></li>
- <li><a href="/community.html#third-party-packages">Third Party Packages</a></li>
- <li><a href="/community.html#source-code">Source Code</a></li>
- <li><a href="/community.html#people">People</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink"><small><span class="glyphicon glyphicon-new-window"></span></small> Powered by Flink</a></li>
-
- <!-- Contribute -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Contribute</strong></li>
- <li><a href="/how-to-contribute.html">How to Contribute</a></li>
- <li><a href="/contribute-code.html">Contribute Code</a></li>
- <li><a href="/contribute-documentation.html">Contribute Documentation</a></li>
- <li><a href="/improve-website.html">Improve the Website</a></li>
- </ul>
- </li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Project <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Project -->
- <li role="presentation" class="dropdown-header"><strong>Project</strong></li>
- <li><a href="/slides.html">Slides</a></li>
- <li><a href="/material.html">Material</a></li>
- <li><a href="https://twitter.com/apacheflink"><small><span class="glyphicon glyphicon-new-window"></span></small> Twitter</a></li>
- <li><a href="https://github.com/apache/flink"><small><span class="glyphicon glyphicon-new-window"></span></small> GitHub</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
- </ul>
- </div><!-- /.navbar-collapse -->
- </div><!-- /.container -->
- </nav>
-
-
- <!-- Main content. -->
- <div class="container">
-
-
-<div class="row">
- <div class="col-sm-8 col-sm-offset-2">
- <div class="row">
- <h1>Stratosphere version 0.5 available</h1>
-
- <article>
- <p>31 May 2014</p>
-
-<p>We are happy to announce a new major Stratosphere release, version 0.5. This release adds many new features and improves the interoperability, stability, and performance of the system. The major theme of the release is the completely new Java API that makes it easy to write powerful distributed programs.</p>
-
-<p>The release can be downloaded from the [Stratosphere website] (http://stratosphere.eu/downloads/) and from [GitHub] (https://github.com/stratosphere/stratosphere/releases/tag/release-0.5). All components are available as Apache Maven dependencies, making it simple to include Stratosphere in other projects. The website provides <a href="http://stratosphere.eu/docs/0.5/">extensive documentation</a> of the system and the new features.</p>
-
-<h2 id="shortlist-of-new-features">Shortlist of new Features</h2>
-
-<p>Below is a short list of the most important additions to the Stratosphere system.</p>
-
-<h4 id="new-java-api">New Java API</h4>
-<p>This release introduces a completely new <strong>data set-centric Java API</strong>. This programming model significantly eases the development of Stratosphere programs, supports flexible use of regular Java classes as data types, and adds many new built-in operators to simplify the writing of powerful programs. The result are programs that need less code, are more readable, interoperate better with existing code, and execute faster.</p>
-
-<p>Take a look at the <a href="http://stratosphere.eu/docs/0.5/programming_guides/examples_java.html">examples</a> to get a feel for the API.</p>
-
-<h4 id="general-api-improvements">General API Improvements</h4>
-<p><strong>Broadcast Variables:</strong> Publish a data set to all instances of another operator. This is handy if the your operator depends on the result of a computation, e.g., filter all values smaller than the average.</p>
-
-<p><strong>Distributed Cache:</strong> Make (local and HDFS) files locally available on each machine processing a task.</p>
-
-<p><strong>Iteration Termination Improvements</strong> Iterative algorithms can now terminate based on intermediate data sets, not only through aggregated statistics.</p>
-
-<p><strong>Collection data sources and sinks:</strong> Speed-up the development and testing of Stratosphere programs by reading data from regular Java collections and inserting back into them.</p>
-
-<p><strong>JDBC data sources and sinks:</strong> Read data from and write data to relational databases using a JDBC driver.</p>
-
-<p><strong>Hadoop input format and output format support:</strong> Read and write data with any Hadoop input or output format.</p>
-
-<p><strong>Support for Avro encoded data:</strong> Read data that has been materialized using Avro.</p>
-
-<p><strong>Deflate Files:</strong> Stratosphere now transparently reads <code>.deflate</code> compressed files.</p>
-
-<h4 id="runtime-and-optimizer-improvements">Runtime and Optimizer Improvements</h4>
-
-<p><strong>DAG Runtime Streaming:</strong> Detection and resolution of streaming data flow deadlocks in the data flow optimizer.</p>
-
-<p><strong>Intermediate results across iteration boundaries:</strong> Intermediate results computed outside iterative parts can be used inside iterative parts of the program.</p>
-
-<p><strong>Stability fixes:</strong> Various stability fixes in both optimizer and runtime.</p>
-
-<h4 id="setup--tooling">Setup & Tooling</h4>
-
-<p><strong>Improved YARN support:</strong> Many improvements based on user-feedback: Packaging, Permissions, Error handling.</p>
-
-<p><strong>Java 8 compatibility</strong></p>
-
-<h2 id="contributors">Contributors</h2>
-
-<p>In total, 26 people have contributed to Stratosphere since the last release. Thank you for making this project possible!</p>
-
-<ul>
- <li>Alexander Alexandrov</li>
- <li>Jesus Camacho</li>
- <li>Ufuk Celebi</li>
- <li>Mikhail Erofeev</li>
- <li>Stephan Ewen</li>
- <li>Alexandr Ferodov</li>
- <li>Filip Haase</li>
- <li>Jonathan Hasenberg</li>
- <li>Markus Holzemer</li>
- <li>Fabian Hueske</li>
- <li>Vasia Kalavri</li>
- <li>Aljoscha Krettek</li>
- <li>Rajika Kumarasiri</li>
- <li>Sebastian Kunert</li>
- <li>Aaron Lam</li>
- <li>Robert Metzger</li>
- <li>Faisal Moeen</li>
- <li>Martin Neumann</li>
- <li>Mingliang Qi</li>
- <li>Till Rohrmann</li>
- <li>Chesnay Schepler</li>
- <li>Vyachislav Soludev</li>
- <li>Tuan Trieu</li>
- <li>Artem Tsikiridis</li>
- <li>Timo Walther</li>
- <li>Robert Waury</li>
-</ul>
-
-<h2 id="stratosphere-is-going-apache">Stratosphere is going Apache</h2>
-
-<p>The Stratosphere project has been accepted to the Apache Incubator and will continue its work under the umbrella of the Apache Software Foundation. Due to a name conflict, we are switching the name of the project. We will make future releases of Stratosphere through the Apache foundation under a new name.</p>
-
-
- </article>
- </div>
-
- <div class="row">
- <div id="disqus_thread"></div>
- <script type="text/javascript">
- /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
- var disqus_shortname = 'stratosphere-eu'; // required: replace example with your forum shortname
-
- /* * * DON'T EDIT BELOW THIS LINE * * */
- (function() {
- var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
- dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js';
- (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
- })();
- </script>
- </div>
- </div>
-</div>
-
- <hr />
- <div class="footer text-center">
- <p>Copyright © 2014-2015 <a href="http://apache.org">The Apache Software Foundation</a>. All Rights Reserved.</p>
- <p>Apache Flink, Apache, and the Apache feather logo are trademarks of The Apache Software Foundation.</p>
- <p><a href="/privacy-policy.html">Privacy Policy</a> · <a href="/blog/feed.xml">RSS feed</a></p>
- </div>
-
- </div><!-- /.container -->
-
- <!-- Include all compiled plugins (below), or include individual files as needed -->
- <script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
- <script src="/js/codetabs.js"></script>
-
- <!-- Google Analytics -->
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-52545728-1', 'auto');
- ga('send', 'pageview');
- </script>
- </body>
-</html>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2014/11/18/hadoop-compatibility.html
----------------------------------------------------------------------
diff --git a/content/news/2014/11/18/hadoop-compatibility.html b/content/news/2014/11/18/hadoop-compatibility.html
index 2700d0f..beea975 100644
--- a/content/news/2014/11/18/hadoop-compatibility.html
+++ b/content/news/2014/11/18/hadoop-compatibility.html
@@ -197,25 +197,25 @@
<span class="c1">// Setup Hadoop’s TextInputFormat</span>
<span class="n">HadoopInputFormat</span><span class="o"><</span><span class="n">LongWritable</span><span class="o">,</span> <span class="n">Text</span><span class="o">></span> <span class="n">hadoopInputFormat</span> <span class="o">=</span>
<span class="k">new</span> <span class="n">HadoopInputFormat</span><span class="o"><</span><span class="n">LongWritable</span><span class="o">,</span> <span class="n">Text</span><span class="o">>(</span>
- <span class="k">new</span> <span class="nf">TextInputFormat</span><span class="o">(),</span> <span class="n">LongWritable</span><span class="o">.</span><span class="na">class</span><span class="o">,</span> <span class="n">Text</span><span class="o">.</span><span class="na">class</span><span class="o">,</span> <span class="k">new</span> <span class="nf">JobConf</span><span class="o">());</span>
- <span class="n">TextInputFormat</span><span class="o">.</span><span class="na">addInputPath</span><span class="o">(</span><span class="n">hadoopInputFormat</span><span class="o">.</span><span class="na">getJobConf</span><span class="o">(),</span> <span class="k">new</span> <span class="nf">Path</span><span class="o">(</span><span class="n">inputPath</span><span class="o">));</span>
+ <span class="k">new</span> <span class="n">TextInputFormat</span><span class="o">(),</span> <span class="n">LongWritable</span><span class="o">.</span><span class="na">class</span><span class="o">,</span> <span class="n">Text</span><span class="o">.</span><span class="na">class</span><span class="o">,</span> <span class="k">new</span> <span class="n">JobConf</span><span class="o">());</span>
+ <span class="n">TextInputFormat</span><span class="o">.</span><span class="na">addInputPath</span><span class="o">(</span><span class="n">hadoopInputFormat</span><span class="o">.</span><span class="na">getJobConf</span><span class="o">(),</span> <span class="k">new</span> <span class="n">Path</span><span class="o">(</span><span class="n">inputPath</span><span class="o">));</span>
<span class="c1">// Read a DataSet with the Hadoop InputFormat</span>
<span class="n">DataSet</span><span class="o"><</span><span class="n">Tuple2</span><span class="o"><</span><span class="n">LongWritable</span><span class="o">,</span> <span class="n">Text</span><span class="o">>></span> <span class="n">text</span> <span class="o">=</span> <span class="n">env</span><span class="o">.</span><span class="na">createInput</span><span class="o">(</span><span class="n">hadoopInputFormat</span><span class="o">);</span>
<span class="n">DataSet</span><span class="o"><</span><span class="n">Tuple2</span><span class="o"><</span><span class="n">Text</span><span class="o">,</span> <span class="n">LongWritable</span><span class="o">>></span> <span class="n">words</span> <span class="o">=</span> <span class="n">text</span>
<span class="c1">// Wrap Tokenizer Mapper function</span>
- <span class="o">.</span><span class="na">flatMap</span><span class="o">(</span><span class="k">new</span> <span class="n">HadoopMapFunction</span><span class="o"><</span><span class="n">LongWritable</span><span class="o">,</span> <span class="n">Text</span><span class="o">,</span> <span class="n">Text</span><span class="o">,</span> <span class="n">LongWritable</span><span class="o">>(</span><span class="k">new</span> <span class="nf">Tokenizer</span><span class="o">()))</span>
+ <span class="o">.</span><span class="na">flatMap</span><span class="o">(</span><span class="k">new</span> <span class="n">HadoopMapFunction</span><span class="o"><</span><span class="n">LongWritable</span><span class="o">,</span> <span class="n">Text</span><span class="o">,</span> <span class="n">Text</span><span class="o">,</span> <span class="n">LongWritable</span><span class="o">>(</span><span class="k">new</span> <span class="n">Tokenizer</span><span class="o">()))</span>
<span class="o">.</span><span class="na">groupBy</span><span class="o">(</span><span class="mi">0</span><span class="o">)</span>
<span class="c1">// Wrap Counter Reducer function (used as Reducer and Combiner)</span>
<span class="o">.</span><span class="na">reduceGroup</span><span class="o">(</span><span class="k">new</span> <span class="n">HadoopReduceCombineFunction</span><span class="o"><</span><span class="n">Text</span><span class="o">,</span> <span class="n">LongWritable</span><span class="o">,</span> <span class="n">Text</span><span class="o">,</span> <span class="n">LongWritable</span><span class="o">>(</span>
- <span class="k">new</span> <span class="nf">Counter</span><span class="o">(),</span> <span class="k">new</span> <span class="nf">Counter</span><span class="o">()));</span>
+ <span class="k">new</span> <span class="n">Counter</span><span class="o">(),</span> <span class="k">new</span> <span class="n">Counter</span><span class="o">()));</span>
<span class="c1">// Setup Hadoop’s TextOutputFormat</span>
<span class="n">HadoopOutputFormat</span><span class="o"><</span><span class="n">Text</span><span class="o">,</span> <span class="n">LongWritable</span><span class="o">></span> <span class="n">hadoopOutputFormat</span> <span class="o">=</span>
<span class="k">new</span> <span class="n">HadoopOutputFormat</span><span class="o"><</span><span class="n">Text</span><span class="o">,</span> <span class="n">LongWritable</span><span class="o">>(</span>
- <span class="k">new</span> <span class="n">TextOutputFormat</span><span class="o"><</span><span class="n">Text</span><span class="o">,</span> <span class="n">LongWritable</span><span class="o">>(),</span> <span class="k">new</span> <span class="nf">JobConf</span><span class="o">());</span>
+ <span class="k">new</span> <span class="n">TextOutputFormat</span><span class="o"><</span><span class="n">Text</span><span class="o">,</span> <span class="n">LongWritable</span><span class="o">>(),</span> <span class="k">new</span> <span class="n">JobConf</span><span class="o">());</span>
<span class="n">hadoopOutputFormat</span><span class="o">.</span><span class="na">getJobConf</span><span class="o">().</span><span class="na">set</span><span class="o">(</span><span class="s">"mapred.textoutputformat.separator"</span><span class="o">,</span> <span class="s">" "</span><span class="o">);</span>
- <span class="n">TextOutputFormat</span><span class="o">.</span><span class="na">setOutputPath</span><span class="o">(</span><span class="n">hadoopOutputFormat</span><span class="o">.</span><span class="na">getJobConf</span><span class="o">(),</span> <span class="k">new</span> <span class="nf">Path</span><span class="o">(</span><span class="n">outputPath</span><span class="o">));</span>
+ <span class="n">TextOutputFormat</span><span class="o">.</span><span class="na">setOutputPath</span><span class="o">(</span><span class="n">hadoopOutputFormat</span><span class="o">.</span><span class="na">getJobConf</span><span class="o">(),</span> <span class="k">new</span> <span class="n">Path</span><span class="o">(</span><span class="n">outputPath</span><span class="o">));</span>
<span class="c1">// Output & Execute</span>
<span class="n">words</span><span class="o">.</span><span class="na">output</span><span class="o">(</span><span class="n">hadoopOutputFormat</span><span class="o">);</span>
@@ -238,7 +238,7 @@
<p>Flink lets you reuse a lot of the code you wrote for Hadoop MapReduce, including all data types, all Input- and OutputFormats, and Mapper and Reducers of the mapred-API. Hadoop functions can be used within Flink programs and mixed with all other Flink functions. Due to Flink’s pipelined execution, Hadoop functions can arbitrarily be assembled without data exchange via HDFS. Moreover, the Flink community is currently working on a dedicated Hadoop Job operation to supporting the execution of Hadoop jobs as a whole.</p>
-<p>If you want to use Flink’s Hadoop compatibility package checkout our <a href="http://ci.apache.org/projects/flink/flink-docs-release-0.7/hadoop_compatibility.html">documentation</a>.</p>
+<p>If you want to use Flink’s Hadoop compatibility package checkout our <a href="https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/hadoop_compatibility.html">documentation</a>.</p>
</article>
</div>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2015/02/04/january-in-flink.html
----------------------------------------------------------------------
diff --git a/content/news/2015/02/04/january-in-flink.html b/content/news/2015/02/04/january-in-flink.html
index c3faa75..7febbcf 100644
--- a/content/news/2015/02/04/january-in-flink.html
+++ b/content/news/2015/02/04/january-in-flink.html
@@ -170,17 +170,13 @@
<p>The community has published a <a href="https://cwiki.apache.org/confluence/display/FLINK/Flink+Roadmap">roadmap for 2015</a> on the Flink wiki. Check it out to see what is coming up in Flink, and pick up an issue to contribute!</p>
-<h3 id="scaling-als">Scaling ALS</h3>
-
-<p>Flink committers employed at <a href="http://data-artisans.com">data Artisans</a> published a <a href="http://data-artisans.com/computing-recommendations-with-flink.html">blog post</a> on how they scaled matrix factorization with Flink and Google Compute Engine to matrices with 28 billion elements.</p>
-
<h3 id="articles-in-the-press">Articles in the press</h3>
<p>The Apache Software Foundation <a href="https://blogs.apache.org/foundation/entry/the_apache_software_foundation_announces69">announced</a> Flink as a Top-Level Project. The announcement was picked up by the media, e.g., <a href="http://sdtimes.com/inside-apache-software-foundations-newest-top-level-project-apache-flink/?utm_content=11232092&utm_medium=social&utm_source=twitter">here</a>, <a href="http://www.datanami.com/2015/01/12/apache-flink-takes-route-distributed-data-processing/">here</a>, and <a href="http://i-programmer.info/news/197-data-mining/8176-flink-reaches-top-level-status.html">here</a>.</p>
<h3 id="hadoop-summit">Hadoop Summit</h3>
-<p>A submitted abstract on Flink Streaming <a href="http://2015.hadoopsummit.org/amsterdam-blog/announcing-the-community-vote-session-winners-for-the-2015-hadoop-summit-europe/">won the community</a> vote at “The Future of Hadoop” track.</p>
+<p>A submitted abstract on Flink Streaming won the community vote at “The Future of Hadoop” track.</p>
<h3 id="meetups-and-talks">Meetups and talks</h3>
[4/8] flink-web git commit: rebuild web page
Posted by mj...@apache.org.
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2014/01/12/0.4-migration-guide.html
----------------------------------------------------------------------
diff --git a/content/news/2014/01/12/0.4-migration-guide.html b/content/news/2014/01/12/0.4-migration-guide.html
deleted file mode 100644
index 876d022..0000000
--- a/content/news/2014/01/12/0.4-migration-guide.html
+++ /dev/null
@@ -1,286 +0,0 @@
-<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
- <title>Apache Flink: Stratosphere Version 0.4 Migration Guide</title>
- <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
- <link rel="icon" href="/favicon.ico" type="image/x-icon">
-
- <!-- Bootstrap -->
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css">
- <link rel="stylesheet" href="/css/flink.css">
- <link rel="stylesheet" href="/css/syntax.css">
-
- <!-- Blog RSS feed -->
- <link href="/blog/feed.xml" rel="alternate" type="application/rss+xml" title="Apache Flink Blog: RSS feed" />
-
- <!-- jQuery (necessary for Bootstrap's JavaScript plugins) -->
- <!-- We need to load Jquery in the header for custom google analytics event tracking-->
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js"></script>
-
- <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
- <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
-
-
- <!-- Top navbar. -->
- <nav class="navbar navbar-default navbar-fixed-top">
- <div class="container">
- <!-- The logo. -->
- <div class="navbar-header">
- <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- <div class="navbar-logo">
- <a href="/">
- <img alt="Apache Flink" src="/img/navbar-brand-logo.jpg" width="78px" height="40px">
- </a>
- </div>
- </div><!-- /.navbar-header -->
-
- <!-- The navigation links. -->
- <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
- <ul class="nav navbar-nav">
-
- <!-- Overview -->
- <li><a href="/index.html">Overview</a></li>
-
- <!-- Features -->
- <li><a href="/features.html">Features</a></li>
-
- <!-- Downloads -->
- <li><a href="/downloads.html">Downloads</a></li>
-
- <!-- FAQ -->
- <li><a href="/faq.html">FAQ</a></li>
-
-
- <!-- Quickstart -->
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Quickstart <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html">Setup</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/run_example_quickstart.html">Example: Wikipedia Edit Stream</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html">Java API</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/scala_api_quickstart.html">Scala API</a></li>
- </ul>
- </li>
-
- <!-- Documentation -->
- <li class="dropdown">
- <a href="" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Documentation <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Latest stable release -->
- <li role="presentation" class="dropdown-header"><strong>Latest Release</strong> (Stable)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0">1.0 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/java" class="active">1.0 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/scala/index.html" class="active">1.0 ScalaDocs</a></li>
-
- <!-- Snapshot docs -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Snapshot</strong> (Development)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master">1.1 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/java" class="active">1.1 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/scala/index.html" class="active">1.1 ScalaDocs</a></li>
-
- <!-- Wiki -->
- <li class="divider"></li>
- <li><a href="/visualizer/"><small><span class="glyphicon glyphicon-new-window"></span></small> Plan Visualizer</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
-
- </ul>
-
- <ul class="nav navbar-nav navbar-right">
- <!-- Blog -->
- <li class=" active hidden-md hidden-sm"><a href="/blog/">Blog</a></li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Community <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Community -->
- <li role="presentation" class="dropdown-header"><strong>Community</strong></li>
- <li><a href="/community.html#mailing-lists">Mailing Lists</a></li>
- <li><a href="/community.html#irc">IRC</a></li>
- <li><a href="/community.html#stack-overflow">Stack Overflow</a></li>
- <li><a href="/community.html#issue-tracker">Issue Tracker</a></li>
- <li><a href="/community.html#third-party-packages">Third Party Packages</a></li>
- <li><a href="/community.html#source-code">Source Code</a></li>
- <li><a href="/community.html#people">People</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink"><small><span class="glyphicon glyphicon-new-window"></span></small> Powered by Flink</a></li>
-
- <!-- Contribute -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Contribute</strong></li>
- <li><a href="/how-to-contribute.html">How to Contribute</a></li>
- <li><a href="/contribute-code.html">Contribute Code</a></li>
- <li><a href="/contribute-documentation.html">Contribute Documentation</a></li>
- <li><a href="/improve-website.html">Improve the Website</a></li>
- </ul>
- </li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Project <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Project -->
- <li role="presentation" class="dropdown-header"><strong>Project</strong></li>
- <li><a href="/slides.html">Slides</a></li>
- <li><a href="/material.html">Material</a></li>
- <li><a href="https://twitter.com/apacheflink"><small><span class="glyphicon glyphicon-new-window"></span></small> Twitter</a></li>
- <li><a href="https://github.com/apache/flink"><small><span class="glyphicon glyphicon-new-window"></span></small> GitHub</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
- </ul>
- </div><!-- /.navbar-collapse -->
- </div><!-- /.container -->
- </nav>
-
-
- <!-- Main content. -->
- <div class="container">
-
-
-<div class="row">
- <div class="col-sm-8 col-sm-offset-2">
- <div class="row">
- <h1>Stratosphere Version 0.4 Migration Guide</h1>
-
- <article>
- <p>12 Jan 2014</p>
-
-<p>This guide is intended to help users of previous Stratosphere versions to migrate their programs to the new API of v0.4.</p>
-
-<p>Version <code>0.4-rc1</code>, <code>0.4</code> and all newer versions have the new API. If you want to have the most recent version before the code change, please set the version to <code>0.4-alpha.3-SNAPSHOT</code>. (Note that the <code>0.4-alpha</code> versions are only available in the snapshot repository).</p>
-
-<h4 id="maven-dependencies">Maven Dependencies</h4>
-<p>Since we also reorganized the Maven project structure, existing programs need to update the Maven dependencies to <code>stratosphere-java</code> (and <code>stratosphere-clients</code>, for examples and executors).</p>
-
-<p>The typical set of Maven dependencies for Stratosphere Java programs is:</p>
-
-<div class="highlight"><pre><code class="language-diff"> <groupId>eu.stratosphere</groupId>
-<span class="gd">- <artifactId>pact-common</artifactId></span>
-<span class="gd">- <version>0.4-SNAPSHOT</version></span>
-<span class="gi">+ <artifactId>stratosphere-java</artifactId></span>
-<span class="gi">+ <version>0.4</version></span>
-
-<span class="gd">- <artifactId>pact-clients</artifactId></span>
-<span class="gd">- <version>0.4-SNAPSHOT</version></span>
-<span class="gi">+ <artifactId>stratosphere-clients</artifactId></span>
-<span class="gi">+ <version>0.4</version></span></code></pre></div>
-
-<h4 id="renamed-classes">Renamed classes</h4>
-
-<p>We renamed many of the most commonly used classes to make their names more intuitive:</p>
-
-<table class="table table-striped">
- <thead>
- <tr>
- <th>Old Name (before <code>0.4</code>)</th>
- <th>New Name (<code>0.4</code> and after)</th>
- </tr>
- </thead>
- <tbody>
- <tr>
- <td>Contract</td>
- <td>Operator</td>
- </tr>
- <tr>
- <td>MatchContract</td>
- <td>JoinOperator</td>
- </tr>
-
- <tr>
- <td>[Map, Reduce, ...]Stub</td>
- <td>[Map, Reduce, ...]Function</td>
- </tr>
- <tr>
- <td>MatchStub</td>
- <td>JoinFunction</td>
- </tr>
- <tr>
- <td>Pact[Integer, Double, ...]</td>
- <td>IntValue, DoubleValue, ...</td>
- </tr>
- <tr>
- <td>PactRecord</td>
- <td>Record</td>
- </tr>
- <tr>
- <td>PlanAssembler</td>
- <td>Program</td>
- </tr>
- <tr>
- <td>PlanAssemblerDescription</td>
- <td>ProgramDescription</td>
- </tr>
- <tr>
- <td>RecordOutputFormat</td>
- <td>CsvOutputFormat</td>
- </tr>
- </tbody>
-</table>
-
-<p>Package names have been adapted as well.
-For a complete overview of the renamings, have a look at <a href="https://github.com/stratosphere/stratosphere/issues/257">issue #257 on GitHub</a>.</p>
-
-<p>We suggest for Eclipse user adjust the programs as follows: Delete all old Stratosphere imports, then rename the the classes (<code>PactRecord</code> to <code>Record</code> and so on). Finally, use the “Organize Imports” function (<code>CTRL+SHIFT+O</code>) to choose the right imports. The names should be unique so always pick the classes that are in the <code>eu.stratosphere</code> package.</p>
-
-<p>Please contact us in the comments below, on the mailing list or on GitHub if you have any issues migrating to the latest Stratosphere release.</p>
-
- </article>
- </div>
-
- <div class="row">
- <div id="disqus_thread"></div>
- <script type="text/javascript">
- /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
- var disqus_shortname = 'stratosphere-eu'; // required: replace example with your forum shortname
-
- /* * * DON'T EDIT BELOW THIS LINE * * */
- (function() {
- var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
- dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js';
- (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
- })();
- </script>
- </div>
- </div>
-</div>
-
- <hr />
- <div class="footer text-center">
- <p>Copyright © 2014-2015 <a href="http://apache.org">The Apache Software Foundation</a>. All Rights Reserved.</p>
- <p>Apache Flink, Apache, and the Apache feather logo are trademarks of The Apache Software Foundation.</p>
- <p><a href="/privacy-policy.html">Privacy Policy</a> · <a href="/blog/feed.xml">RSS feed</a></p>
- </div>
-
- </div><!-- /.container -->
-
- <!-- Include all compiled plugins (below), or include individual files as needed -->
- <script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
- <script src="/js/codetabs.js"></script>
-
- <!-- Google Analytics -->
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-52545728-1', 'auto');
- ga('send', 'pageview');
- </script>
- </body>
-</html>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2014/01/13/stratosphere-release-0.4.html
----------------------------------------------------------------------
diff --git a/content/news/2014/01/13/stratosphere-release-0.4.html b/content/news/2014/01/13/stratosphere-release-0.4.html
deleted file mode 100644
index 4021fcd..0000000
--- a/content/news/2014/01/13/stratosphere-release-0.4.html
+++ /dev/null
@@ -1,279 +0,0 @@
-<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
- <title>Apache Flink: Stratosphere 0.4 Released</title>
- <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
- <link rel="icon" href="/favicon.ico" type="image/x-icon">
-
- <!-- Bootstrap -->
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css">
- <link rel="stylesheet" href="/css/flink.css">
- <link rel="stylesheet" href="/css/syntax.css">
-
- <!-- Blog RSS feed -->
- <link href="/blog/feed.xml" rel="alternate" type="application/rss+xml" title="Apache Flink Blog: RSS feed" />
-
- <!-- jQuery (necessary for Bootstrap's JavaScript plugins) -->
- <!-- We need to load Jquery in the header for custom google analytics event tracking-->
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js"></script>
-
- <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
- <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
-
-
- <!-- Top navbar. -->
- <nav class="navbar navbar-default navbar-fixed-top">
- <div class="container">
- <!-- The logo. -->
- <div class="navbar-header">
- <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- <div class="navbar-logo">
- <a href="/">
- <img alt="Apache Flink" src="/img/navbar-brand-logo.jpg" width="78px" height="40px">
- </a>
- </div>
- </div><!-- /.navbar-header -->
-
- <!-- The navigation links. -->
- <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
- <ul class="nav navbar-nav">
-
- <!-- Overview -->
- <li><a href="/index.html">Overview</a></li>
-
- <!-- Features -->
- <li><a href="/features.html">Features</a></li>
-
- <!-- Downloads -->
- <li><a href="/downloads.html">Downloads</a></li>
-
- <!-- FAQ -->
- <li><a href="/faq.html">FAQ</a></li>
-
-
- <!-- Quickstart -->
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Quickstart <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html">Setup</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/run_example_quickstart.html">Example: Wikipedia Edit Stream</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html">Java API</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/scala_api_quickstart.html">Scala API</a></li>
- </ul>
- </li>
-
- <!-- Documentation -->
- <li class="dropdown">
- <a href="" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Documentation <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Latest stable release -->
- <li role="presentation" class="dropdown-header"><strong>Latest Release</strong> (Stable)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0">1.0 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/java" class="active">1.0 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/scala/index.html" class="active">1.0 ScalaDocs</a></li>
-
- <!-- Snapshot docs -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Snapshot</strong> (Development)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master">1.1 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/java" class="active">1.1 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/scala/index.html" class="active">1.1 ScalaDocs</a></li>
-
- <!-- Wiki -->
- <li class="divider"></li>
- <li><a href="/visualizer/"><small><span class="glyphicon glyphicon-new-window"></span></small> Plan Visualizer</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
-
- </ul>
-
- <ul class="nav navbar-nav navbar-right">
- <!-- Blog -->
- <li class=" active hidden-md hidden-sm"><a href="/blog/">Blog</a></li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Community <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Community -->
- <li role="presentation" class="dropdown-header"><strong>Community</strong></li>
- <li><a href="/community.html#mailing-lists">Mailing Lists</a></li>
- <li><a href="/community.html#irc">IRC</a></li>
- <li><a href="/community.html#stack-overflow">Stack Overflow</a></li>
- <li><a href="/community.html#issue-tracker">Issue Tracker</a></li>
- <li><a href="/community.html#third-party-packages">Third Party Packages</a></li>
- <li><a href="/community.html#source-code">Source Code</a></li>
- <li><a href="/community.html#people">People</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink"><small><span class="glyphicon glyphicon-new-window"></span></small> Powered by Flink</a></li>
-
- <!-- Contribute -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Contribute</strong></li>
- <li><a href="/how-to-contribute.html">How to Contribute</a></li>
- <li><a href="/contribute-code.html">Contribute Code</a></li>
- <li><a href="/contribute-documentation.html">Contribute Documentation</a></li>
- <li><a href="/improve-website.html">Improve the Website</a></li>
- </ul>
- </li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Project <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Project -->
- <li role="presentation" class="dropdown-header"><strong>Project</strong></li>
- <li><a href="/slides.html">Slides</a></li>
- <li><a href="/material.html">Material</a></li>
- <li><a href="https://twitter.com/apacheflink"><small><span class="glyphicon glyphicon-new-window"></span></small> Twitter</a></li>
- <li><a href="https://github.com/apache/flink"><small><span class="glyphicon glyphicon-new-window"></span></small> GitHub</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
- </ul>
- </div><!-- /.navbar-collapse -->
- </div><!-- /.container -->
- </nav>
-
-
- <!-- Main content. -->
- <div class="container">
-
-
-<div class="row">
- <div class="col-sm-8 col-sm-offset-2">
- <div class="row">
- <h1>Stratosphere 0.4 Released</h1>
-
- <article>
- <p>13 Jan 2014</p>
-
-<p>We are pleased to announce that version 0.4 of the Stratosphere system has been released. </p>
-
-<p>Our team has been working hard during the last few months to create an improved and stable Stratosphere version. The new version comes with many new features, usability and performance improvements in all levels, including a new Scala API for the concise specification of programs, a Pregel-like API, support for Yarn clusters, and major performance improvements. The system features now first-class support for iterative programs and thus covers traditional analytical use cases as well as data mining and graph processing use cases with great performance.</p>
-
-<p>In the course of the transition from v0.2 to v0.4 of the system, we have changed pre-existing APIs based on valuable user feedback. This means that, in the interest of easier programming, we have broken backwards compatibility and existing jobs must be adapted, as described in <a href="/blog/tutorial/2014/01/12/0.4-migration-guide.html">the migration guide</a>.</p>
-
-<p>This article will guide you through the feature list of the new release.</p>
-
-<h3 id="scala-programming-interface">Scala Programming Interface</h3>
-<p>The new Stratosphere version comes with a new programming API in Scala that supports very fluent and efficient programs that can be expressed with very few lines of code. The API uses Scala’s native type system (no special boxed data types) and supports grouping and joining on types beyond key/value pairs. We use code analysis and code generation to transform Scala’s data model to the Stratosphere runtime. Stratosphere Scala programs are optimized before execution by Stratosphere’s optimizer just like Stratosphere Java programs.</p>
-
-<p>Learn more about the Scala API at the <a href="/docs/0.4/programming_guides/scala.html">Scala Programming Guide</a></p>
-
-<h3 id="iterations">Iterations</h3>
-<p>Stratosphere v0.4 introduces deep support for iterative algorithms, required by a large class of advanced analysis algorithms. In contrast to most other systems, “looping over the data” is done inside the system’s runtime, rather than in the client. Individual iterations (supersteps) can be as fast as sub-second times. Loop-invariant data is automatically cached in memory.</p>
-
-<p>We support a special form of iterations called “delta iterations” that selectively modify only some elements of intermediate solution in each iteration. These are applicable to a variety of applications, e.g., use cases of Apache Giraph. We have observed speedups of 70x when using delta iterations instead of regular iterations.</p>
-
-<p>Read more about the new iteration feature in <a href="/docs/0.4/programming_guides/iterations.html">the documentation</a></p>
-
-<h3 id="hadoop-yarn-support">Hadoop YARN Support</h3>
-<p>YARN (Yet Another Resource Negotiator) is the major new feature of the recently announced <a href="http://hadoop.apache.org/docs/r2.2.0/">Hadoop 2.2</a>. It allows to share existing clusters with different runtimes. So you can run MapReduce alongside Storm and others. With the 0.4 release, Stratosphere supports YARN.
-Follow <a href="/docs/0.4/setup/yarn.html">our guide</a> on how to start a Stratosphere YARN session.</p>
-
-<h3 id="improved-scripting-language-meteor">Improved Scripting Language Meteor</h3>
-<p>The high-level language Meteor now natively serializes JSON trees for greater performance and offers additional operators and file formats. We greatly empowered the user to write crispier scripts by adding second-order functions, multi-output operators, and other syntactical sugar. For developers of Meteor packages, the API is much more comprehensive and allows to define custom data types that can be easily embedded in JSON trees through ad-hoc byte code generation.</p>
-
-<h3 id="spargel-pregel-inspired-graph-processing">Spargel: Pregel Inspired Graph Processing</h3>
-<p>Spargel is a vertex-centric API similar to the interface proposed in Google’s Pregel paper and implemented in Apache Giraph. Spargel is implemented in 500 lines of code (including comments) on top of Stratosphere’s delta iterations feature. This confirms the flexibility of Stratosphere’s architecture. </p>
-
-<h3 id="web-frontend">Web Frontend</h3>
-<p>Using the new web frontend, you can monitor the progress of Stratosphere jobs. For finished jobs, the frontend shows a breakdown of the execution times for each operator. The webclient also visualizes the execution strategies chosen by the optimizer.</p>
-
-<h3 id="accumulators">Accumulators</h3>
-<p>Stratosphere’s accumulators allow program developers to compute simple statistics, such as counts, sums, min/max values, or histograms, as a side effect of the processing functions. An example application would be to count the total number of records/tuples processed by a function. Stratosphere will not launch additional tasks (reducers), but will compute the number “on the fly” as a side-product of the functions application to the data. The concept is similar to Hadoop’s counters, but supports more types of aggregation.</p>
-
-<h3 id="refactored-apis">Refactored APIs</h3>
-<p>Based on valuable user feedback, we refactored the Java programming interface to make it more intuitive and easier to use. The basic concepts are still the same, however the naming of most interfaces changed and the structure of the code was adapted. When updating to the 0.4 release you will need to adapt your jobs and dependencies. A previous blog post has a guide to the necessary changes to adapt programs to Stratosphere 0.4.</p>
-
-<h3 id="local-debugging">Local Debugging</h3>
-<p>You can now test and debug Stratosphere jobs locally. The <a href="/docs/0.4/program_execution/local_executor.html">LocalExecutor</a> allows to execute Stratosphere Jobs from IDE’s. The same code that runs on clusters also runs in a single JVM multi-threaded. The mode supports full debugging capabilities known from regular applications (placing breakpoints and stepping through the program’s functions). An advanced mode supports simulating fully distributed operation locally.</p>
-
-<h3 id="miscellaneous">Miscellaneous</h3>
-
-<ul>
- <li>The configuration of Stratosphere has been changed to YAML</li>
- <li>HBase support</li>
- <li>JDBC Input format</li>
- <li>Improved Windows Compatibility: Batch-files to start Stratosphere on Windows and all unit tests passing on Windows.</li>
- <li>Stratosphere is available in Maven Central and Sonatype Snapshot Repository</li>
- <li>Improved build system that supports different Hadoop versions using Maven profiles</li>
- <li>Maven Archetypes for Stratosphere Jobs.</li>
- <li>Stability and Usability improvements with many bug fixes.</li>
-</ul>
-
-<h3 id="download-and-get-started-with-stratosphere-v04">Download and get started with Stratosphere v0.4</h3>
-<p>There are several options for getting started with Stratosphere. </p>
-
-<ul>
- <li>Download it on the <a href="/downloads">download page</a></li>
- <li>Start your program with the <a href="/quickstart/">Quick-start guides</a>.</li>
- <li>Complete <a href="/docs/0.4/">documentation and set-up guides</a></li>
-</ul>
-
-<h3 id="tell-us-what-you-think">Tell us what you think!</h3>
-<p>Are you using, or planning to use Stratosphere? Sign up in our <a href="https://groups.google.com/forum/#!forum/stratosphere-dev">mailing list</a> and drop us a line.</p>
-
-<p>Have you found a bug? <a href="https://github.com/stratosphere/stratosphere">Post an issue</a> on GitHub.</p>
-
-<p>Follow us on <a href="https://twitter.com/stratosphere_eu">Twitter</a> and <a href="https://github.com/stratosphere/stratosphere">GitHub</a> to stay in touch with the latest news!</p>
-
-
- </article>
- </div>
-
- <div class="row">
- <div id="disqus_thread"></div>
- <script type="text/javascript">
- /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
- var disqus_shortname = 'stratosphere-eu'; // required: replace example with your forum shortname
-
- /* * * DON'T EDIT BELOW THIS LINE * * */
- (function() {
- var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
- dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js';
- (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
- })();
- </script>
- </div>
- </div>
-</div>
-
- <hr />
- <div class="footer text-center">
- <p>Copyright © 2014-2015 <a href="http://apache.org">The Apache Software Foundation</a>. All Rights Reserved.</p>
- <p>Apache Flink, Apache, and the Apache feather logo are trademarks of The Apache Software Foundation.</p>
- <p><a href="/privacy-policy.html">Privacy Policy</a> · <a href="/blog/feed.xml">RSS feed</a></p>
- </div>
-
- </div><!-- /.container -->
-
- <!-- Include all compiled plugins (below), or include individual files as needed -->
- <script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
- <script src="/js/codetabs.js"></script>
-
- <!-- Google Analytics -->
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-52545728-1', 'auto');
- ga('send', 'pageview');
- </script>
- </body>
-</html>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2014/01/26/optimizer_plan_visualization_tool.html
----------------------------------------------------------------------
diff --git a/content/news/2014/01/26/optimizer_plan_visualization_tool.html b/content/news/2014/01/26/optimizer_plan_visualization_tool.html
deleted file mode 100644
index bb0003f..0000000
--- a/content/news/2014/01/26/optimizer_plan_visualization_tool.html
+++ /dev/null
@@ -1,228 +0,0 @@
-<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
- <title>Apache Flink: Optimizer Plan Visualization Tool</title>
- <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
- <link rel="icon" href="/favicon.ico" type="image/x-icon">
-
- <!-- Bootstrap -->
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css">
- <link rel="stylesheet" href="/css/flink.css">
- <link rel="stylesheet" href="/css/syntax.css">
-
- <!-- Blog RSS feed -->
- <link href="/blog/feed.xml" rel="alternate" type="application/rss+xml" title="Apache Flink Blog: RSS feed" />
-
- <!-- jQuery (necessary for Bootstrap's JavaScript plugins) -->
- <!-- We need to load Jquery in the header for custom google analytics event tracking-->
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js"></script>
-
- <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
- <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
-
-
- <!-- Top navbar. -->
- <nav class="navbar navbar-default navbar-fixed-top">
- <div class="container">
- <!-- The logo. -->
- <div class="navbar-header">
- <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- <div class="navbar-logo">
- <a href="/">
- <img alt="Apache Flink" src="/img/navbar-brand-logo.jpg" width="78px" height="40px">
- </a>
- </div>
- </div><!-- /.navbar-header -->
-
- <!-- The navigation links. -->
- <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
- <ul class="nav navbar-nav">
-
- <!-- Overview -->
- <li><a href="/index.html">Overview</a></li>
-
- <!-- Features -->
- <li><a href="/features.html">Features</a></li>
-
- <!-- Downloads -->
- <li><a href="/downloads.html">Downloads</a></li>
-
- <!-- FAQ -->
- <li><a href="/faq.html">FAQ</a></li>
-
-
- <!-- Quickstart -->
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Quickstart <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html">Setup</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/run_example_quickstart.html">Example: Wikipedia Edit Stream</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html">Java API</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/scala_api_quickstart.html">Scala API</a></li>
- </ul>
- </li>
-
- <!-- Documentation -->
- <li class="dropdown">
- <a href="" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Documentation <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Latest stable release -->
- <li role="presentation" class="dropdown-header"><strong>Latest Release</strong> (Stable)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0">1.0 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/java" class="active">1.0 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/scala/index.html" class="active">1.0 ScalaDocs</a></li>
-
- <!-- Snapshot docs -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Snapshot</strong> (Development)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master">1.1 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/java" class="active">1.1 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/scala/index.html" class="active">1.1 ScalaDocs</a></li>
-
- <!-- Wiki -->
- <li class="divider"></li>
- <li><a href="/visualizer/"><small><span class="glyphicon glyphicon-new-window"></span></small> Plan Visualizer</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
-
- </ul>
-
- <ul class="nav navbar-nav navbar-right">
- <!-- Blog -->
- <li class=" active hidden-md hidden-sm"><a href="/blog/">Blog</a></li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Community <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Community -->
- <li role="presentation" class="dropdown-header"><strong>Community</strong></li>
- <li><a href="/community.html#mailing-lists">Mailing Lists</a></li>
- <li><a href="/community.html#irc">IRC</a></li>
- <li><a href="/community.html#stack-overflow">Stack Overflow</a></li>
- <li><a href="/community.html#issue-tracker">Issue Tracker</a></li>
- <li><a href="/community.html#third-party-packages">Third Party Packages</a></li>
- <li><a href="/community.html#source-code">Source Code</a></li>
- <li><a href="/community.html#people">People</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink"><small><span class="glyphicon glyphicon-new-window"></span></small> Powered by Flink</a></li>
-
- <!-- Contribute -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Contribute</strong></li>
- <li><a href="/how-to-contribute.html">How to Contribute</a></li>
- <li><a href="/contribute-code.html">Contribute Code</a></li>
- <li><a href="/contribute-documentation.html">Contribute Documentation</a></li>
- <li><a href="/improve-website.html">Improve the Website</a></li>
- </ul>
- </li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Project <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Project -->
- <li role="presentation" class="dropdown-header"><strong>Project</strong></li>
- <li><a href="/slides.html">Slides</a></li>
- <li><a href="/material.html">Material</a></li>
- <li><a href="https://twitter.com/apacheflink"><small><span class="glyphicon glyphicon-new-window"></span></small> Twitter</a></li>
- <li><a href="https://github.com/apache/flink"><small><span class="glyphicon glyphicon-new-window"></span></small> GitHub</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
- </ul>
- </div><!-- /.navbar-collapse -->
- </div><!-- /.container -->
- </nav>
-
-
- <!-- Main content. -->
- <div class="container">
-
-
-<div class="row">
- <div class="col-sm-8 col-sm-offset-2">
- <div class="row">
- <h1>Optimizer Plan Visualization Tool</h1>
-
- <article>
- <p>26 Jan 2014</p>
-
-<p>Stratosphere’s hybrid approach combines <strong>MapReduce</strong> and <strong>MPP database</strong> techniques. One central part of this approach is to have a <strong>separation between the programming (API) and the way programs are executed</strong> <em>(execution plans)</em>. The <strong>compiler/optimizer</strong> decides the details concerning caching or when to partition/broadcast with a holistic view of the program. The same program may actually be executed differently in different scenarios (input data of different sizes, different number of machines).</p>
-
-<p><strong>If you want to know how exactly the system executes your program, you can find it out in two ways</strong>:</p>
-
-<ol>
- <li>
- <p>The <strong>browser-based webclient UI</strong>, which takes programs packaged into JARs and draws the execution plan as a visual data flow (check out the <a href="http://stratosphere.eu/docs/0.4/program_execution/web_interface.html">documentation</a> for details).</p>
- </li>
- <li>
- <p>For <strong>programs using the <a href="http://stratosphere.eu/docs/0.4/program_execution/local_executor.html">Local- </a> or [Remote Executor] (http://stratosphere.eu/docs/0.4/program_execution/remote_executor.html)</strong>, you can get the optimizer plan using the method <code>LocalExecutor.optimizerPlanAsJSON(plan)</code>. The <strong>resulting JSON</strong> string describes the execution strategies chosen by the optimizer. Naturally, you do not want to parse that yourself, especially for longer programs.</p>
- </li>
-</ol>
-
-<p>The builds <em>0.5-SNAPSHOT</em> and later come with a <strong>tool that visualizes the JSON</strong> string. It is a standalone version of the webclient’s visualization, packed as an html document <code>tools/planVisualizer.html</code>.</p>
-
-<p>If you open it in a browser (for example <code>chromium-browser tools/planVisualizer.html</code>) it shows a text area where you can paste the JSON string and it renders that string as a dataflow plan (assuming it was a valid JSON string and plan). The pictures below show how that looks for the <a href="https://github.com/stratosphere/stratosphere/blob/release-0.4/stratosphere-examples/stratosphere-java-examples/src/main/java/eu/stratosphere/example/java/record/connectedcomponents/WorksetConnectedComponents.java?source=cc">included sample program</a> that uses delta iterations to compute the connected components of a graph.</p>
-
-<p><img src="/img/blog/plan_visualizer1.png" style="width:100%;" /></p>
-
-<p><img src="/img/blog/plan_visualizer2.png" style="width:100%;" /></p>
-
- </article>
- </div>
-
- <div class="row">
- <div id="disqus_thread"></div>
- <script type="text/javascript">
- /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
- var disqus_shortname = 'stratosphere-eu'; // required: replace example with your forum shortname
-
- /* * * DON'T EDIT BELOW THIS LINE * * */
- (function() {
- var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
- dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js';
- (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
- })();
- </script>
- </div>
- </div>
-</div>
-
- <hr />
- <div class="footer text-center">
- <p>Copyright © 2014-2015 <a href="http://apache.org">The Apache Software Foundation</a>. All Rights Reserved.</p>
- <p>Apache Flink, Apache, and the Apache feather logo are trademarks of The Apache Software Foundation.</p>
- <p><a href="/privacy-policy.html">Privacy Policy</a> · <a href="/blog/feed.xml">RSS feed</a></p>
- </div>
-
- </div><!-- /.container -->
-
- <!-- Include all compiled plugins (below), or include individual files as needed -->
- <script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
- <script src="/js/codetabs.js"></script>
-
- <!-- Google Analytics -->
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-52545728-1', 'auto');
- ga('send', 'pageview');
- </script>
- </body>
-</html>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2014/01/28/querying_mongodb.html
----------------------------------------------------------------------
diff --git a/content/news/2014/01/28/querying_mongodb.html b/content/news/2014/01/28/querying_mongodb.html
deleted file mode 100644
index 19708b0..0000000
--- a/content/news/2014/01/28/querying_mongodb.html
+++ /dev/null
@@ -1,301 +0,0 @@
-<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
- <title>Apache Flink: Accessing Data Stored in MongoDB with Stratosphere</title>
- <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
- <link rel="icon" href="/favicon.ico" type="image/x-icon">
-
- <!-- Bootstrap -->
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css">
- <link rel="stylesheet" href="/css/flink.css">
- <link rel="stylesheet" href="/css/syntax.css">
-
- <!-- Blog RSS feed -->
- <link href="/blog/feed.xml" rel="alternate" type="application/rss+xml" title="Apache Flink Blog: RSS feed" />
-
- <!-- jQuery (necessary for Bootstrap's JavaScript plugins) -->
- <!-- We need to load Jquery in the header for custom google analytics event tracking-->
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js"></script>
-
- <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
- <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
-
-
- <!-- Top navbar. -->
- <nav class="navbar navbar-default navbar-fixed-top">
- <div class="container">
- <!-- The logo. -->
- <div class="navbar-header">
- <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- <div class="navbar-logo">
- <a href="/">
- <img alt="Apache Flink" src="/img/navbar-brand-logo.jpg" width="78px" height="40px">
- </a>
- </div>
- </div><!-- /.navbar-header -->
-
- <!-- The navigation links. -->
- <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
- <ul class="nav navbar-nav">
-
- <!-- Overview -->
- <li><a href="/index.html">Overview</a></li>
-
- <!-- Features -->
- <li><a href="/features.html">Features</a></li>
-
- <!-- Downloads -->
- <li><a href="/downloads.html">Downloads</a></li>
-
- <!-- FAQ -->
- <li><a href="/faq.html">FAQ</a></li>
-
-
- <!-- Quickstart -->
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Quickstart <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html">Setup</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/run_example_quickstart.html">Example: Wikipedia Edit Stream</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html">Java API</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/scala_api_quickstart.html">Scala API</a></li>
- </ul>
- </li>
-
- <!-- Documentation -->
- <li class="dropdown">
- <a href="" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Documentation <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Latest stable release -->
- <li role="presentation" class="dropdown-header"><strong>Latest Release</strong> (Stable)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0">1.0 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/java" class="active">1.0 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/scala/index.html" class="active">1.0 ScalaDocs</a></li>
-
- <!-- Snapshot docs -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Snapshot</strong> (Development)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master">1.1 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/java" class="active">1.1 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/scala/index.html" class="active">1.1 ScalaDocs</a></li>
-
- <!-- Wiki -->
- <li class="divider"></li>
- <li><a href="/visualizer/"><small><span class="glyphicon glyphicon-new-window"></span></small> Plan Visualizer</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
-
- </ul>
-
- <ul class="nav navbar-nav navbar-right">
- <!-- Blog -->
- <li class=" active hidden-md hidden-sm"><a href="/blog/">Blog</a></li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Community <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Community -->
- <li role="presentation" class="dropdown-header"><strong>Community</strong></li>
- <li><a href="/community.html#mailing-lists">Mailing Lists</a></li>
- <li><a href="/community.html#irc">IRC</a></li>
- <li><a href="/community.html#stack-overflow">Stack Overflow</a></li>
- <li><a href="/community.html#issue-tracker">Issue Tracker</a></li>
- <li><a href="/community.html#third-party-packages">Third Party Packages</a></li>
- <li><a href="/community.html#source-code">Source Code</a></li>
- <li><a href="/community.html#people">People</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink"><small><span class="glyphicon glyphicon-new-window"></span></small> Powered by Flink</a></li>
-
- <!-- Contribute -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Contribute</strong></li>
- <li><a href="/how-to-contribute.html">How to Contribute</a></li>
- <li><a href="/contribute-code.html">Contribute Code</a></li>
- <li><a href="/contribute-documentation.html">Contribute Documentation</a></li>
- <li><a href="/improve-website.html">Improve the Website</a></li>
- </ul>
- </li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Project <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Project -->
- <li role="presentation" class="dropdown-header"><strong>Project</strong></li>
- <li><a href="/slides.html">Slides</a></li>
- <li><a href="/material.html">Material</a></li>
- <li><a href="https://twitter.com/apacheflink"><small><span class="glyphicon glyphicon-new-window"></span></small> Twitter</a></li>
- <li><a href="https://github.com/apache/flink"><small><span class="glyphicon glyphicon-new-window"></span></small> GitHub</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
- </ul>
- </div><!-- /.navbar-collapse -->
- </div><!-- /.container -->
- </nav>
-
-
- <!-- Main content. -->
- <div class="container">
-
-
-<div class="row">
- <div class="col-sm-8 col-sm-offset-2">
- <div class="row">
- <h1>Accessing Data Stored in MongoDB with Stratosphere</h1>
-
- <article>
- <p>28 Jan 2014 by Robert Metzger (<a href="https://twitter.com/rmetzger_">@rmetzger_</a>)</p>
-
-<p>We recently merged a <a href="https://github.com/stratosphere/stratosphere/pull/437">pull request</a> that allows you to use any existing Hadoop <a href="http://developer.yahoo.com/hadoop/tutorial/module5.html#inputformat">InputFormat</a> with Stratosphere. So you can now (in the <code>0.5-SNAPSHOT</code> and upwards versions) define a Hadoop-based data source:</p>
-
-<div class="highlight"><pre><code class="language-java"><span class="n">HadoopDataSource</span> <span class="n">source</span> <span class="o">=</span> <span class="k">new</span> <span class="nf">HadoopDataSource</span><span class="o">(</span><span class="k">new</span> <span class="nf">TextInputFormat</span><span class="o">(),</span> <span class="k">new</span> <span class="nf">JobConf</span><span class="o">(),</span> <span class="s">"Input Lines"</span><span class="o">);</span>
-<span class="n">TextInputFormat</span><span class="o">.</span><span class="na">addInputPath</span><span class="o">(</span><span class="n">source</span><span class="o">.</span><span class="na">getJobConf</span><span class="o">(),</span> <span class="k">new</span> <span class="nf">Path</span><span class="o">(</span><span class="n">dataInput</span><span class="o">));</span></code></pre></div>
-
-<p>We describe in the following article how to access data stored in <a href="http://www.mongodb.org/">MongoDB</a> with Stratosphere. This allows users to join data from multiple sources (e.g. MonogDB and HDFS) or perform machine learning with the documents stored in MongoDB.</p>
-
-<p>The approach here is to use the <code>MongoInputFormat</code> that was developed for Apache Hadoop but now also runs with Stratosphere.</p>
-
-<div class="highlight"><pre><code class="language-java"><span class="n">JobConf</span> <span class="n">conf</span> <span class="o">=</span> <span class="k">new</span> <span class="nf">JobConf</span><span class="o">();</span>
-<span class="n">conf</span><span class="o">.</span><span class="na">set</span><span class="o">(</span><span class="s">"mongo.input.uri"</span><span class="o">,</span><span class="s">"mongodb://localhost:27017/enron_mail.messages"</span><span class="o">);</span>
-<span class="n">HadoopDataSource</span> <span class="n">src</span> <span class="o">=</span> <span class="k">new</span> <span class="nf">HadoopDataSource</span><span class="o">(</span><span class="k">new</span> <span class="nf">MongoInputFormat</span><span class="o">(),</span> <span class="n">conf</span><span class="o">,</span> <span class="s">"Read from Mongodb"</span><span class="o">,</span> <span class="k">new</span> <span class="nf">WritableWrapperConverter</span><span class="o">());</span></code></pre></div>
-
-<h3 id="example-program">Example Program</h3>
-<p>The example program reads data from the <a href="http://www.cs.cmu.edu/~enron/">enron dataset</a> that contains about 500k internal e-mails. The data is stored in MongoDB and the Stratosphere program counts the number of e-mails per day.</p>
-
-<p>The complete code of this sample program is available on <a href="https://github.com/stratosphere/stratosphere-mongodb-example">GitHub</a>.</p>
-
-<h4 id="prepare-mongodb-and-the-data">Prepare MongoDB and the Data</h4>
-
-<ul>
- <li>Install MongoDB</li>
- <li>Download the enron dataset from <a href="http://mongodb-enron-email.s3-website-us-east-1.amazonaws.com/">their website</a>.</li>
- <li>Unpack and load it</li>
-</ul>
-
-<p><code>bash
- bunzip2 enron_mongo.tar.bz2
- tar xvf enron_mongo.tar
- mongorestore dump/enron_mail/messages.bson
-</code></p>
-
-<p>We used <a href="http://robomongo.org/">Robomongo</a> to visually examine the dataset stored in MongoDB.</p>
-
-<p><img src="/img/blog/robomongo.png" style="width:90%;margin:15px" /></p>
-
-<h4 id="build-mongoinputformat">Build <code>MongoInputFormat</code></h4>
-
-<p>MongoDB offers an InputFormat for Hadoop on their <a href="https://github.com/mongodb/mongo-hadoop">GitHub page</a>. The code is not available in any Maven repository, so we have to build the jar file on our own.</p>
-
-<ul>
- <li>Check out the repository</li>
-</ul>
-
-<div class="highlight"><pre><code>git clone https://github.com/mongodb/mongo-hadoop.git
-cd mongo-hadoop
-</code></pre></div>
-
-<ul>
- <li>Set the appropriate Hadoop version in the <code>build.sbt</code>, we used <code>1.1</code>.</li>
-</ul>
-
-<div class="highlight"><pre><code class="language-bash">hadoopRelease in ThisBuild :<span class="o">=</span> <span class="s2">"1.1"</span></code></pre></div>
-<ul>
- <li>Build the input format</li>
-</ul>
-
-<div class="highlight"><pre><code class="language-bash">./sbt package</code></pre></div>
-
-<p>The jar-file is now located in <code>core/target</code>.</p>
-
-<h4 id="the-stratosphere-program">The Stratosphere Program</h4>
-
-<p>Now we have everything prepared to run the Stratosphere program. I only ran it on my local computer, out of Eclipse. To do that, check out the code …</p>
-
-<div class="highlight"><pre><code class="language-bash">git clone https://github.com/stratosphere/stratosphere-mongodb-example.git</code></pre></div>
-
-<p>… and import it as a Maven project into your Eclipse. You have to manually add the previously built mongo-hadoop jar-file as a dependency.
-You can now press the “Run” button and see how Stratosphere executes the little program. It was running for about 8 seconds on the 1.5 GB dataset.</p>
-
-<p>The result (located in <code>/tmp/enronCountByDay</code>) now looks like this.</p>
-
-<div class="highlight"><pre><code>11,Fri Sep 26 10:00:00 CEST 1997
-154,Tue Jun 29 10:56:00 CEST 1999
-292,Tue Aug 10 12:11:00 CEST 1999
-185,Thu Aug 12 18:35:00 CEST 1999
-26,Fri Mar 19 12:33:00 CET 1999
-</code></pre></div>
-
-<p>There is one thing left I want to point out here. MongoDB represents objects stored in the database as JSON-documents. Since Stratosphere’s standard types do not support JSON documents, I was using the <code>WritableWrapper</code> here. This wrapper allows to use any Hadoop datatype with Stratosphere.</p>
-
-<p>The following code example shows how the JSON-documents are accessed in Stratosphere.</p>
-
-<div class="highlight"><pre><code class="language-java"><span class="kd">public</span> <span class="kt">void</span> <span class="nf">map</span><span class="o">(</span><span class="n">Record</span> <span class="n">record</span><span class="o">,</span> <span class="n">Collector</span><span class="o"><</span><span class="n">Record</span><span class="o">></span> <span class="n">out</span><span class="o">)</span> <span class="kd">throws</span> <span class="n">Exception</span> <span class="o">{</span>
- <span class="n">Writable</span> <span class="n">valWr</span> <span class="o">=</span> <span class="n">record</span><span class="o">.</span><span class="na">getField</span><span class="o">(</span><span class="mi">1</span><span class="o">,</span> <span class="n">WritableWrapper</span><span class="o">.</span><span class="na">class</span><span class="o">).</span><span class="na">value</span><span class="o">();</span>
- <span class="n">BSONWritable</span> <span class="n">value</span> <span class="o">=</span> <span class="o">(</span><span class="n">BSONWritable</span><span class="o">)</span> <span class="n">valWr</span><span class="o">;</span>
- <span class="n">Object</span> <span class="n">headers</span> <span class="o">=</span> <span class="n">value</span><span class="o">.</span><span class="na">getDoc</span><span class="o">().</span><span class="na">get</span><span class="o">(</span><span class="s">"headers"</span><span class="o">);</span>
- <span class="n">BasicDBObject</span> <span class="n">headerOb</span> <span class="o">=</span> <span class="o">(</span><span class="n">BasicDBObject</span><span class="o">)</span> <span class="n">headers</span><span class="o">;</span>
- <span class="n">String</span> <span class="n">date</span> <span class="o">=</span> <span class="o">(</span><span class="n">String</span><span class="o">)</span> <span class="n">headerOb</span><span class="o">.</span><span class="na">get</span><span class="o">(</span><span class="s">"Date"</span><span class="o">);</span>
- <span class="c1">// further date processing</span>
-<span class="o">}</span></code></pre></div>
-
-<p>Please use the comments if you have questions or if you want to showcase your own MongoDB-Stratosphere integration.</p>
-
- </article>
- </div>
-
- <div class="row">
- <div id="disqus_thread"></div>
- <script type="text/javascript">
- /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
- var disqus_shortname = 'stratosphere-eu'; // required: replace example with your forum shortname
-
- /* * * DON'T EDIT BELOW THIS LINE * * */
- (function() {
- var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
- dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js';
- (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
- })();
- </script>
- </div>
- </div>
-</div>
-
- <hr />
- <div class="footer text-center">
- <p>Copyright © 2014-2015 <a href="http://apache.org">The Apache Software Foundation</a>. All Rights Reserved.</p>
- <p>Apache Flink, Apache, and the Apache feather logo are trademarks of The Apache Software Foundation.</p>
- <p><a href="/privacy-policy.html">Privacy Policy</a> · <a href="/blog/feed.xml">RSS feed</a></p>
- </div>
-
- </div><!-- /.container -->
-
- <!-- Include all compiled plugins (below), or include individual files as needed -->
- <script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
- <script src="/js/codetabs.js"></script>
-
- <!-- Google Analytics -->
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-52545728-1', 'auto');
- ga('send', 'pageview');
- </script>
- </body>
-</html>
[8/8] flink-web git commit: rebuild web page
Posted by mj...@apache.org.
rebuild web page
Project: http://git-wip-us.apache.org/repos/asf/flink-web/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink-web/commit/24f3ba5a
Tree: http://git-wip-us.apache.org/repos/asf/flink-web/tree/24f3ba5a
Diff: http://git-wip-us.apache.org/repos/asf/flink-web/diff/24f3ba5a
Branch: refs/heads/asf-site
Commit: 24f3ba5a1b8e309dd60c4611f568dc7f06ff56b7
Parents: 52d8fe1
Author: mjsax <mj...@apache.org>
Authored: Sun Apr 10 14:31:24 2016 +0200
Committer: mjsax <mj...@apache.org>
Committed: Sun Apr 10 14:31:57 2016 +0200
----------------------------------------------------------------------
content/blog/feed.xml | 940 ++-----------------
content/blog/index.html | 172 +---
content/blog/page2/index.html | 174 +---
content/blog/page3/index.html | 187 +---
content/blog/page4/index.html | 828 ----------------
content/blog/page5/index.html | 786 ----------------
content/news/2012/08/21/release02.html | 217 -----
content/news/2012/10/15/icde2013.html | 218 -----
content/news/2012/11/12/btw2013demo.html | 216 -----
content/news/2012/11/21/previewICDE2013.html | 211 -----
content/news/2013/03/27/www-demo-paper.html | 215 -----
content/news/2013/10/21/cikm2013-paper.html | 249 -----
.../2013/12/13/humboldt-innovation-award.html | 220 -----
.../2014/01/10/stratosphere-hadoop-summit.html | 210 -----
.../news/2014/01/12/0.4-migration-guide.html | 286 ------
.../2014/01/13/stratosphere-release-0.4.html | 279 ------
.../26/optimizer_plan_visualization_tool.html | 228 -----
content/news/2014/01/28/querying_mongodb.html | 301 ------
.../18/amazon-elastic-mapreduce-cloud-yarn.html | 390 --------
...stratosphere-google-summer-of-code-2014.html | 217 -----
.../16/stratosphere-goes-apache-incubator.html | 212 -----
content/news/2014/05/31/release-0.5.html | 289 ------
.../news/2014/11/18/hadoop-compatibility.html | 14 +-
content/news/2015/02/04/january-in-flink.html | 6 +-
content/news/2015/02/09/streaming-example.html | 48 +-
.../news/2015/03/02/february-2015-in-flink.html | 6 +-
.../peeking-into-Apache-Flinks-Engine-Room.html | 6 +-
content/news/2015/04/07/march-in-flink.html | 21 +-
.../2015/04/13/release-0.9.0-milestone1.html | 6 +-
.../news/2015/05/14/Community-update-April.html | 12 +-
.../2015/08/24/introducing-flink-gelly.html | 20 +-
content/news/2015/09/03/flink-forward.html | 11 +-
content/news/2015/09/16/off-heap-memory.html | 2 +-
.../news/2015/12/11/storm-compatibility.html | 22 +-
content/news/2015/12/18/a-year-in-review.html | 4 +-
content/news/2016/04/06/cep-monitoring.html | 4 +-
36 files changed, 181 insertions(+), 7046 deletions(-)
----------------------------------------------------------------------
[2/8] flink-web git commit: rebuild web page
Posted by mj...@apache.org.
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2015/02/09/streaming-example.html
----------------------------------------------------------------------
diff --git a/content/news/2015/02/09/streaming-example.html b/content/news/2015/02/09/streaming-example.html
index 691ec3c..77e6d27 100644
--- a/content/news/2015/02/09/streaming-example.html
+++ b/content/news/2015/02/09/streaming-example.html
@@ -169,7 +169,7 @@ and offers a new API including definition of flexible windows.</p>
<p>In this post, we go through an example that uses the Flink Streaming
API to compute statistics on stock market data that arrive
continuously and combine the stock market data with Twitter streams.
-See the <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html">Streaming Programming
+See the <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/index.html">Streaming Programming
Guide</a> for a
detailed presentation of the Streaming API.</p>
@@ -246,16 +246,16 @@ found <a href="https://github.com/mbalassi/flink/blob/stockprices/flink-staging/
<span class="nd">@Override</span>
<span class="kd">public</span> <span class="n">StockPrice</span> <span class="nf">map</span><span class="o">(</span><span class="n">String</span> <span class="n">value</span><span class="o">)</span> <span class="kd">throws</span> <span class="n">Exception</span> <span class="o">{</span>
<span class="n">tokens</span> <span class="o">=</span> <span class="n">value</span><span class="o">.</span><span class="na">split</span><span class="o">(</span><span class="s">","</span><span class="o">);</span>
- <span class="k">return</span> <span class="k">new</span> <span class="nf">StockPrice</span><span class="o">(</span><span class="n">tokens</span><span class="o">[</span><span class="mi">0</span><span class="o">],</span>
+ <span class="k">return</span> <span class="k">new</span> <span class="n">StockPrice</span><span class="o">(</span><span class="n">tokens</span><span class="o">[</span><span class="mi">0</span><span class="o">],</span>
<span class="n">Double</span><span class="o">.</span><span class="na">parseDouble</span><span class="o">(</span><span class="n">tokens</span><span class="o">[</span><span class="mi">1</span><span class="o">]));</span>
<span class="o">}</span>
<span class="o">});</span>
<span class="c1">//Generate other stock streams</span>
- <span class="n">DataStream</span><span class="o"><</span><span class="n">StockPrice</span><span class="o">></span> <span class="n">SPX_stream</span> <span class="o">=</span> <span class="n">env</span><span class="o">.</span><span class="na">addSource</span><span class="o">(</span><span class="k">new</span> <span class="nf">StockSource</span><span class="o">(</span><span class="s">"SPX"</span><span class="o">,</span> <span class="mi">10</span><span class="o">));</span>
- <span class="n">DataStream</span><span class="o"><</span><span class="n">StockPrice</span><span class="o">></span> <span class="n">FTSE_stream</span> <span class="o">=</span> <span class="n">env</span><span class="o">.</span><span class="na">addSource</span><span class="o">(</span><span class="k">new</span> <span class="nf">StockSource</span><span class="o">(</span><span class="s">"FTSE"</span><span class="o">,</span> <span class="mi">20</span><span class="o">));</span>
- <span class="n">DataStream</span><span class="o"><</span><span class="n">StockPrice</span><span class="o">></span> <span class="n">DJI_stream</span> <span class="o">=</span> <span class="n">env</span><span class="o">.</span><span class="na">addSource</span><span class="o">(</span><span class="k">new</span> <span class="nf">StockSource</span><span class="o">(</span><span class="s">"DJI"</span><span class="o">,</span> <span class="mi">30</span><span class="o">));</span>
- <span class="n">DataStream</span><span class="o"><</span><span class="n">StockPrice</span><span class="o">></span> <span class="n">BUX_stream</span> <span class="o">=</span> <span class="n">env</span><span class="o">.</span><span class="na">addSource</span><span class="o">(</span><span class="k">new</span> <span class="nf">StockSource</span><span class="o">(</span><span class="s">"BUX"</span><span class="o">,</span> <span class="mi">40</span><span class="o">));</span>
+ <span class="n">DataStream</span><span class="o"><</span><span class="n">StockPrice</span><span class="o">></span> <span class="n">SPX_stream</span> <span class="o">=</span> <span class="n">env</span><span class="o">.</span><span class="na">addSource</span><span class="o">(</span><span class="k">new</span> <span class="n">StockSource</span><span class="o">(</span><span class="s">"SPX"</span><span class="o">,</span> <span class="mi">10</span><span class="o">));</span>
+ <span class="n">DataStream</span><span class="o"><</span><span class="n">StockPrice</span><span class="o">></span> <span class="n">FTSE_stream</span> <span class="o">=</span> <span class="n">env</span><span class="o">.</span><span class="na">addSource</span><span class="o">(</span><span class="k">new</span> <span class="n">StockSource</span><span class="o">(</span><span class="s">"FTSE"</span><span class="o">,</span> <span class="mi">20</span><span class="o">));</span>
+ <span class="n">DataStream</span><span class="o"><</span><span class="n">StockPrice</span><span class="o">></span> <span class="n">DJI_stream</span> <span class="o">=</span> <span class="n">env</span><span class="o">.</span><span class="na">addSource</span><span class="o">(</span><span class="k">new</span> <span class="n">StockSource</span><span class="o">(</span><span class="s">"DJI"</span><span class="o">,</span> <span class="mi">30</span><span class="o">));</span>
+ <span class="n">DataStream</span><span class="o"><</span><span class="n">StockPrice</span><span class="o">></span> <span class="n">BUX_stream</span> <span class="o">=</span> <span class="n">env</span><span class="o">.</span><span class="na">addSource</span><span class="o">(</span><span class="k">new</span> <span class="n">StockSource</span><span class="o">(</span><span class="s">"BUX"</span><span class="o">,</span> <span class="mi">40</span><span class="o">));</span>
<span class="c1">//Merge all stock streams together</span>
<span class="n">DataStream</span><span class="o"><</span><span class="n">StockPrice</span><span class="o">></span> <span class="n">stockStream</span> <span class="o">=</span> <span class="n">socketStockStream</span>
@@ -269,10 +269,10 @@ found <a href="https://github.com/mbalassi/flink/blob/stockprices/flink-staging/
</div>
<p>See
-<a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html#sources">here</a>
+<a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/index.html#data-sources">here</a>
on how you can create streaming sources for Flink Streaming
programs. Flink, of course, has support for reading in streams from
-<a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html#stream-connectors">external
+<a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/connectors/index.html">external
sources</a>
such as Apache Kafka, Apache Flume, RabbitMQ, and others. For the sake
of this example, the data streams are simply generated using the
@@ -336,11 +336,11 @@ of this example, the data streams are simply generated using the
<span class="nd">@Override</span>
<span class="kd">public</span> <span class="kt">void</span> <span class="nf">invoke</span><span class="o">(</span><span class="n">Collector</span><span class="o"><</span><span class="n">StockPrice</span><span class="o">></span> <span class="n">collector</span><span class="o">)</span> <span class="kd">throws</span> <span class="n">Exception</span> <span class="o">{</span>
<span class="n">price</span> <span class="o">=</span> <span class="n">DEFAULT_PRICE</span><span class="o">;</span>
- <span class="n">Random</span> <span class="n">random</span> <span class="o">=</span> <span class="k">new</span> <span class="nf">Random</span><span class="o">();</span>
+ <span class="n">Random</span> <span class="n">random</span> <span class="o">=</span> <span class="k">new</span> <span class="n">Random</span><span class="o">();</span>
<span class="k">while</span> <span class="o">(</span><span class="kc">true</span><span class="o">)</span> <span class="o">{</span>
<span class="n">price</span> <span class="o">=</span> <span class="n">price</span> <span class="o">+</span> <span class="n">random</span><span class="o">.</span><span class="na">nextGaussian</span><span class="o">()</span> <span class="o">*</span> <span class="n">sigma</span><span class="o">;</span>
- <span class="n">collector</span><span class="o">.</span><span class="na">collect</span><span class="o">(</span><span class="k">new</span> <span class="nf">StockPrice</span><span class="o">(</span><span class="n">symbol</span><span class="o">,</span> <span class="n">price</span><span class="o">));</span>
+ <span class="n">collector</span><span class="o">.</span><span class="na">collect</span><span class="o">(</span><span class="k">new</span> <span class="n">StockPrice</span><span class="o">(</span><span class="n">symbol</span><span class="o">,</span> <span class="n">price</span><span class="o">));</span>
<span class="n">Thread</span><span class="o">.</span><span class="na">sleep</span><span class="o">(</span><span class="n">random</span><span class="o">.</span><span class="na">nextInt</span><span class="o">(</span><span class="mi">200</span><span class="o">));</span>
<span class="o">}</span>
<span class="o">}</span>
@@ -380,7 +380,7 @@ INFO Custom Source(1/1) switched to DEPLOYING
<h2 id="window-aggregations">Window aggregations</h2>
<p>We first compute aggregations on time-based windows of the
-data. Flink provides <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html#window-operators">flexible windowing semantics</a> where windows can
+data. Flink provides <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/windows.html">flexible windowing semantics</a> where windows can
also be defined based on count of records or any custom user defined
logic.</p>
@@ -427,7 +427,7 @@ performed on named fields of POJOs, making the code more readable.</p>
<span class="n">DataStream</span><span class="o"><</span><span class="n">StockPrice</span><span class="o">></span> <span class="n">maxByStock</span> <span class="o">=</span> <span class="n">windowedStream</span><span class="o">.</span><span class="na">groupBy</span><span class="o">(</span><span class="s">"symbol"</span><span class="o">)</span>
<span class="o">.</span><span class="na">maxBy</span><span class="o">(</span><span class="s">"price"</span><span class="o">).</span><span class="na">flatten</span><span class="o">();</span>
<span class="n">DataStream</span><span class="o"><</span><span class="n">StockPrice</span><span class="o">></span> <span class="n">rollingMean</span> <span class="o">=</span> <span class="n">windowedStream</span><span class="o">.</span><span class="na">groupBy</span><span class="o">(</span><span class="s">"symbol"</span><span class="o">)</span>
- <span class="o">.</span><span class="na">mapWindow</span><span class="o">(</span><span class="k">new</span> <span class="nf">WindowMean</span><span class="o">()).</span><span class="na">flatten</span><span class="o">();</span>
+ <span class="o">.</span><span class="na">mapWindow</span><span class="o">(</span><span class="k">new</span> <span class="n">WindowMean</span><span class="o">()).</span><span class="na">flatten</span><span class="o">();</span>
<span class="c1">//Compute the mean of a window</span>
<span class="kd">public</span> <span class="kd">final</span> <span class="kd">static</span> <span class="kd">class</span> <span class="nc">WindowMean</span> <span class="kd">implements</span>
@@ -447,7 +447,7 @@ performed on named fields of POJOs, making the code more readable.</p>
<span class="n">symbol</span> <span class="o">=</span> <span class="n">sp</span><span class="o">.</span><span class="na">symbol</span><span class="o">;</span>
<span class="n">count</span><span class="o">++;</span>
<span class="o">}</span>
- <span class="n">out</span><span class="o">.</span><span class="na">collect</span><span class="o">(</span><span class="k">new</span> <span class="nf">StockPrice</span><span class="o">(</span><span class="n">symbol</span><span class="o">,</span> <span class="n">sum</span> <span class="o">/</span> <span class="n">count</span><span class="o">));</span>
+ <span class="n">out</span><span class="o">.</span><span class="na">collect</span><span class="o">(</span><span class="k">new</span> <span class="n">StockPrice</span><span class="o">(</span><span class="n">symbol</span><span class="o">,</span> <span class="n">sum</span> <span class="o">/</span> <span class="n">count</span><span class="o">));</span>
<span class="o">}</span>
<span class="o">}</span>
<span class="o">}</span></code></pre></div>
@@ -507,7 +507,7 @@ every 30 seconds.</p>
<div data-lang="java7">
<div class="highlight"><pre><code class="language-java" data-lang="java"><span class="kd">private</span> <span class="kd">static</span> <span class="kd">final</span> <span class="n">Double</span> <span class="n">DEFAULT_PRICE</span> <span class="o">=</span> <span class="mi">1000</span><span class="o">.;</span>
-<span class="kd">private</span> <span class="kd">static</span> <span class="kd">final</span> <span class="n">StockPrice</span> <span class="n">DEFAULT_STOCK_PRICE</span> <span class="o">=</span> <span class="k">new</span> <span class="nf">StockPrice</span><span class="o">(</span><span class="s">""</span><span class="o">,</span> <span class="n">DEFAULT_PRICE</span><span class="o">);</span>
+<span class="kd">private</span> <span class="kd">static</span> <span class="kd">final</span> <span class="n">StockPrice</span> <span class="n">DEFAULT_STOCK_PRICE</span> <span class="o">=</span> <span class="k">new</span> <span class="n">StockPrice</span><span class="o">(</span><span class="s">""</span><span class="o">,</span> <span class="n">DEFAULT_PRICE</span><span class="o">);</span>
<span class="c1">//Use delta policy to create price change warnings</span>
<span class="n">DataStream</span><span class="o"><</span><span class="n">String</span><span class="o">></span> <span class="n">priceWarnings</span> <span class="o">=</span> <span class="n">stockStream</span><span class="o">.</span><span class="na">groupBy</span><span class="o">(</span><span class="s">"symbol"</span><span class="o">)</span>
@@ -517,13 +517,13 @@ every 30 seconds.</p>
<span class="k">return</span> <span class="n">Math</span><span class="o">.</span><span class="na">abs</span><span class="o">(</span><span class="n">oldDataPoint</span><span class="o">.</span><span class="na">price</span> <span class="o">-</span> <span class="n">newDataPoint</span><span class="o">.</span><span class="na">price</span><span class="o">);</span>
<span class="o">}</span>
<span class="o">},</span> <span class="n">DEFAULT_STOCK_PRICE</span><span class="o">))</span>
-<span class="o">.</span><span class="na">mapWindow</span><span class="o">(</span><span class="k">new</span> <span class="nf">SendWarning</span><span class="o">()).</span><span class="na">flatten</span><span class="o">();</span>
+<span class="o">.</span><span class="na">mapWindow</span><span class="o">(</span><span class="k">new</span> <span class="n">SendWarning</span><span class="o">()).</span><span class="na">flatten</span><span class="o">();</span>
<span class="c1">//Count the number of warnings every half a minute</span>
<span class="n">DataStream</span><span class="o"><</span><span class="n">Count</span><span class="o">></span> <span class="n">warningsPerStock</span> <span class="o">=</span> <span class="n">priceWarnings</span><span class="o">.</span><span class="na">map</span><span class="o">(</span><span class="k">new</span> <span class="n">MapFunction</span><span class="o"><</span><span class="n">String</span><span class="o">,</span> <span class="n">Count</span><span class="o">>()</span> <span class="o">{</span>
<span class="nd">@Override</span>
<span class="kd">public</span> <span class="n">Count</span> <span class="nf">map</span><span class="o">(</span><span class="n">String</span> <span class="n">value</span><span class="o">)</span> <span class="kd">throws</span> <span class="n">Exception</span> <span class="o">{</span>
- <span class="k">return</span> <span class="k">new</span> <span class="nf">Count</span><span class="o">(</span><span class="n">value</span><span class="o">,</span> <span class="mi">1</span><span class="o">);</span>
+ <span class="k">return</span> <span class="k">new</span> <span class="n">Count</span><span class="o">(</span><span class="n">value</span><span class="o">,</span> <span class="mi">1</span><span class="o">);</span>
<span class="o">}</span>
<span class="o">}).</span><span class="na">groupBy</span><span class="o">(</span><span class="s">"symbol"</span><span class="o">).</span><span class="na">window</span><span class="o">(</span><span class="n">Time</span><span class="o">.</span><span class="na">of</span><span class="o">(</span><span class="mi">30</span><span class="o">,</span> <span class="n">TimeUnit</span><span class="o">.</span><span class="na">SECONDS</span><span class="o">)).</span><span class="na">sum</span><span class="o">(</span><span class="s">"count"</span><span class="o">).</span><span class="na">flatten</span><span class="o">();</span>
@@ -568,8 +568,8 @@ every 30 seconds.</p>
<h2 id="combining-with-a-twitter-stream">Combining with a Twitter stream</h2>
<p>Next, we will read a Twitter stream and correlate it with our stock
-price stream. Flink has support for connecting to <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html#twitter-streaming-api">Twitter’s
-API</a>,
+price stream. Flink has support for connecting to <a href="https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/connectors/twitter.html">Twitter’s
+API</a>
but for the sake of this example we generate dummy tweet data.</p>
<p><img alt="Social media analytics" src="/img/blog/blog_social_media.png" width="100%" class="img-responsive center-block" /></p>
@@ -605,7 +605,7 @@ but for the sake of this example we generate dummy tweet data.</p>
<div data-lang="java7">
<div class="highlight"><pre><code class="language-java" data-lang="java"><span class="c1">//Read a stream of tweets</span>
-<span class="n">DataStream</span><span class="o"><</span><span class="n">String</span><span class="o">></span> <span class="n">tweetStream</span> <span class="o">=</span> <span class="n">env</span><span class="o">.</span><span class="na">addSource</span><span class="o">(</span><span class="k">new</span> <span class="nf">TweetSource</span><span class="o">());</span>
+<span class="n">DataStream</span><span class="o"><</span><span class="n">String</span><span class="o">></span> <span class="n">tweetStream</span> <span class="o">=</span> <span class="n">env</span><span class="o">.</span><span class="na">addSource</span><span class="o">(</span><span class="k">new</span> <span class="n">TweetSource</span><span class="o">());</span>
<span class="c1">//Extract the stock symbols</span>
<span class="n">DataStream</span><span class="o"><</span><span class="n">String</span><span class="o">></span> <span class="n">mentionedSymbols</span> <span class="o">=</span> <span class="n">tweetStream</span><span class="o">.</span><span class="na">flatMap</span><span class="o">(</span>
@@ -628,7 +628,7 @@ but for the sake of this example we generate dummy tweet data.</p>
<span class="n">DataStream</span><span class="o"><</span><span class="n">Count</span><span class="o">></span> <span class="n">tweetsPerStock</span> <span class="o">=</span> <span class="n">mentionedSymbols</span><span class="o">.</span><span class="na">map</span><span class="o">(</span><span class="k">new</span> <span class="n">MapFunction</span><span class="o"><</span><span class="n">String</span><span class="o">,</span> <span class="n">Count</span><span class="o">>()</span> <span class="o">{</span>
<span class="nd">@Override</span>
<span class="kd">public</span> <span class="n">Count</span> <span class="nf">map</span><span class="o">(</span><span class="n">String</span> <span class="n">value</span><span class="o">)</span> <span class="kd">throws</span> <span class="n">Exception</span> <span class="o">{</span>
- <span class="k">return</span> <span class="k">new</span> <span class="nf">Count</span><span class="o">(</span><span class="n">value</span><span class="o">,</span> <span class="mi">1</span><span class="o">);</span>
+ <span class="k">return</span> <span class="k">new</span> <span class="n">Count</span><span class="o">(</span><span class="n">value</span><span class="o">,</span> <span class="mi">1</span><span class="o">);</span>
<span class="o">}</span>
<span class="o">}).</span><span class="na">groupBy</span><span class="o">(</span><span class="s">"symbol"</span><span class="o">).</span><span class="na">window</span><span class="o">(</span><span class="n">Time</span><span class="o">.</span><span class="na">of</span><span class="o">(</span><span class="mi">30</span><span class="o">,</span> <span class="n">TimeUnit</span><span class="o">.</span><span class="na">SECONDS</span><span class="o">)).</span><span class="na">sum</span><span class="o">(</span><span class="s">"count"</span><span class="o">).</span><span class="na">flatten</span><span class="o">();</span>
@@ -638,8 +638,8 @@ but for the sake of this example we generate dummy tweet data.</p>
<span class="nd">@Override</span>
<span class="kd">public</span> <span class="kt">void</span> <span class="nf">invoke</span><span class="o">(</span><span class="n">Collector</span><span class="o"><</span><span class="n">String</span><span class="o">></span> <span class="n">collector</span><span class="o">)</span> <span class="kd">throws</span> <span class="n">Exception</span> <span class="o">{</span>
- <span class="n">random</span> <span class="o">=</span> <span class="k">new</span> <span class="nf">Random</span><span class="o">();</span>
- <span class="n">stringBuilder</span> <span class="o">=</span> <span class="k">new</span> <span class="nf">StringBuilder</span><span class="o">();</span>
+ <span class="n">random</span> <span class="o">=</span> <span class="k">new</span> <span class="n">Random</span><span class="o">();</span>
+ <span class="n">stringBuilder</span> <span class="o">=</span> <span class="k">new</span> <span class="n">StringBuilder</span><span class="o">();</span>
<span class="k">while</span> <span class="o">(</span><span class="kc">true</span><span class="o">)</span> <span class="o">{</span>
<span class="n">stringBuilder</span><span class="o">.</span><span class="na">setLength</span><span class="o">(</span><span class="mi">0</span><span class="o">);</span>
@@ -721,7 +721,7 @@ these data streams are potentially infinite, we apply the join on a
<span class="c1">//Compute rolling correlation</span>
<span class="n">DataStream</span><span class="o"><</span><span class="n">Double</span><span class="o">></span> <span class="n">rollingCorrelation</span> <span class="o">=</span> <span class="n">tweetsAndWarning</span>
<span class="o">.</span><span class="na">window</span><span class="o">(</span><span class="n">Time</span><span class="o">.</span><span class="na">of</span><span class="o">(</span><span class="mi">30</span><span class="o">,</span> <span class="n">TimeUnit</span><span class="o">.</span><span class="na">SECONDS</span><span class="o">))</span>
- <span class="o">.</span><span class="na">mapWindow</span><span class="o">(</span><span class="k">new</span> <span class="nf">WindowCorrelation</span><span class="o">());</span>
+ <span class="o">.</span><span class="na">mapWindow</span><span class="o">(</span><span class="k">new</span> <span class="n">WindowCorrelation</span><span class="o">());</span>
<span class="n">rollingCorrelation</span><span class="o">.</span><span class="na">print</span><span class="o">();</span>
@@ -785,7 +785,7 @@ these data streams are potentially infinite, we apply the join on a
<h2 id="other-things-to-try">Other things to try</h2>
-<p>For a full feature overview please check the <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html">Streaming Guide</a>, which describes all the available API features.
+<p>For a full feature overview please check the <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/index.html">Streaming Guide</a>, which describes all the available API features.
You are very welcome to try out our features for different use-cases we are looking forward to your experiences. Feel free to <a href="http://flink.apache.org/community.html#mailing-lists">contact us</a>.</p>
<h2 id="upcoming-for-streaming">Upcoming for streaming</h2>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2015/03/02/february-2015-in-flink.html
----------------------------------------------------------------------
diff --git a/content/news/2015/03/02/february-2015-in-flink.html b/content/news/2015/03/02/february-2015-in-flink.html
index 5b3e5c4..607fbe6 100644
--- a/content/news/2015/03/02/february-2015-in-flink.html
+++ b/content/news/2015/03/02/february-2015-in-flink.html
@@ -230,12 +230,12 @@ graph:</p>
<span class="n">maxIterations</span><span class="o">)).</span><span class="na">getVertices</span><span class="o">();</span></code></pre></div>
<p>See more Gelly examples
-<a href="https://github.com/apache/flink/tree/master/flink-staging/flink-gelly/src/main/java/org/apache/flink/graph/example">here</a>.</p>
+<a href="https://github.com/apache/flink/tree/master/flink-libraries/flink-gelly-examples">here</a>.</p>
<h3 id="flink-expressions">Flink Expressions</h3>
<p>The newly merged
-<a href="https://github.com/apache/flink/tree/master/flink-staging/flink-table">flink-table</a>
+<a href="https://github.com/apache/flink/tree/master/flink-libraries/flink-table">flink-table</a>
module is the first step in Flink’s roadmap towards logical queries
and SQL support. Here’s a preview on how you can read two CSV file,
assign a logical schema to, and apply transformations like filters and
@@ -256,7 +256,7 @@ joins using logical attributes rather than physical data types.</p>
<h3 id="access-to-hcatalog-tables">Access to HCatalog tables</h3>
-<p>With the <a href="https://github.com/apache/flink/tree/master/flink-staging/flink-hcatalog">flink-hcatalog
+<p>With the <a href="https://github.com/apache/flink/tree/master/flink-batch-connectors/flink-hcatalog">flink-hcatalog
module</a>,
you can now conveniently access HCatalog/Hive tables. The module
supports projection (selection and order of fields) and partition
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2015/03/13/peeking-into-Apache-Flinks-Engine-Room.html
----------------------------------------------------------------------
diff --git a/content/news/2015/03/13/peeking-into-Apache-Flinks-Engine-Room.html b/content/news/2015/03/13/peeking-into-Apache-Flinks-Engine-Room.html
index 49fdcbb..23a6e63 100644
--- a/content/news/2015/03/13/peeking-into-Apache-Flinks-Engine-Room.html
+++ b/content/news/2015/03/13/peeking-into-Apache-Flinks-Engine-Room.html
@@ -280,7 +280,7 @@
<p>Ship and local strategies do not depend on each other and can be independently chosen. Therefore, Flink can execute a join of two data sets R and S in nine different ways by combining any of the three ship strategies (RR, BF with R being broadcasted, BF with S being broadcasted) with any of the three local strategies (SM, HH with R being build-side, HH with S being build-side). Each of these strategy combinations results in different execution performance depending on the data sizes and the available amount of working memory. In case of a small data set R and a much larger data set S, broadcasting R and using it as build-side input of a Hybrid-Hash-Join is usually a good choice because the much larger data set S is not shipped and not materialized (given that the hash table completely fits into memory). If both data sets are rather large or the join is performed on many parallel instances, repartitioning both inputs is a robust choice.</p>
-<p>Flink features a cost-based optimizer which automatically chooses the execution strategies for all operators including joins. Without going into the details of cost-based optimization, this is done by computing cost estimates for execution plans with different strategies and picking the plan with the least estimated costs. Thereby, the optimizer estimates the amount of data which is shipped over the the network and written to disk. If no reliable size estimates for the input data can be obtained, the optimizer falls back to robust default choices. A key feature of the optimizer is to reason about existing data properties. For example, if the data of one input is already partitioned in a suitable way, the generated candidate plans will not repartition this input. Hence, the choice of a RR ship strategy becomes more likely. The same applies for previously sorted data and the Sort-Merge-Join strategy. Flink programs can help the optimizer to reason about existing data properties by
providing semantic information about user-defined functions <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/programming_guide.html#semantic-annotations">[4]</a>. While the optimizer is a killer feature of Flink, it can happen that a user knows better than the optimizer how to execute a specific join. Similar to relational database systems, Flink offers optimizer hints to tell the optimizer which join strategies to pick <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/dataset_transformations.html#join-algorithm-hints">[5]</a>.</p>
+<p>Flink features a cost-based optimizer which automatically chooses the execution strategies for all operators including joins. Without going into the details of cost-based optimization, this is done by computing cost estimates for execution plans with different strategies and picking the plan with the least estimated costs. Thereby, the optimizer estimates the amount of data which is shipped over the the network and written to disk. If no reliable size estimates for the input data can be obtained, the optimizer falls back to robust default choices. A key feature of the optimizer is to reason about existing data properties. For example, if the data of one input is already partitioned in a suitable way, the generated candidate plans will not repartition this input. Hence, the choice of a RR ship strategy becomes more likely. The same applies for previously sorted data and the Sort-Merge-Join strategy. Flink programs can help the optimizer to reason about existing data properties by
providing semantic information about user-defined functions <a href="https://ci.apache.org/projects/flink/flink-docs-release-1.0/apis/batch/index.html#semantic-annotations">[4]</a>. While the optimizer is a killer feature of Flink, it can happen that a user knows better than the optimizer how to execute a specific join. Similar to relational database systems, Flink offers optimizer hints to tell the optimizer which join strategies to pick <a href="https://ci.apache.org/projects/flink/flink-docs-release-1.0/apis/batch/dataset_transformations.html#join-algorithm-hints">[5]</a>.</p>
<h3 id="how-is-flinks-join-performance">How is Flink’s join performance?</h3>
@@ -337,8 +337,8 @@
<p>[1] <a href="">“MapReduce: Simplified data processing on large clusters”</a>, Dean, Ghemawat, 2004 <br />
[2] <a href="http://ci.apache.org/projects/flink/flink-docs-release-0.8/dataset_transformations.html">Flink 0.8.1 documentation: Data Transformations</a> <br />
[3] <a href="http://ci.apache.org/projects/flink/flink-docs-release-0.8/dataset_transformations.html#join">Flink 0.8.1 documentation: Joins</a> <br />
-[4] <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/programming_guide.html#semantic-annotations">Flink 0.9-SNAPSHOT documentation: Semantic annotations</a> <br />
-[5] <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/dataset_transformations.html#join-algorithm-hints">Flink 0.9-SNAPSHOT documentation: Optimizer join hints</a> <br /></p>
+[4] <a href="https://ci.apache.org/projects/flink/flink-docs-release-1.0/apis/batch/index.html#semantic-annotations">Flink 1.0 documentation: Semantic annotations</a> <br />
+[5] <a href="https://ci.apache.org/projects/flink/flink-docs-release-1.0/apis/batch/dataset_transformations.html#join-algorithm-hints">Flink 1.0 documentation: Optimizer join hints</a> <br /></p>
</article>
</div>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2015/04/07/march-in-flink.html
----------------------------------------------------------------------
diff --git a/content/news/2015/04/07/march-in-flink.html b/content/news/2015/04/07/march-in-flink.html
index 5417571..ad7c641 100644
--- a/content/news/2015/04/07/march-in-flink.html
+++ b/content/news/2015/04/07/march-in-flink.html
@@ -162,15 +162,9 @@
<p>March has been a busy month in the Flink community.</p>
-<h3 id="flink-runner-for-google-cloud-dataflow">Flink runner for Google Cloud Dataflow</h3>
+<h3 id="scaling-als">Scaling ALS</h3>
-<p>A Flink runner for Google Cloud Dataflow was announced. See the blog
-posts by <a href="http://data-artisans.com/dataflow.html">data Artisans</a> and
-the <a href="http://googlecloudplatform.blogspot.de/2015/03/announcing-Google-Cloud-Dataflow-runner-for-Apache-Flink.html">Google Cloud Platform Blog</a>.
-Google Cloud Dataflow programs can be written using and open-source
-SDK and run in multiple backends, either as a managed service inside
-Google’s infrastructure, or leveraging open source runners,
-including Apache Flink.</p>
+<p>Flink committers employed at <a href="http://data-artisans.com">data Artisans</a> published a <a href="http://data-artisans.com/how-to-factorize-a-700-gb-matrix-with-apache-flink/">blog post</a> on how they scaled matrix factorization with Flink and Google Compute Engine to matrices with 28 billion elements.</p>
<h3 id="learn-about-the-internals-of-flink">Learn about the internals of Flink</h3>
@@ -202,14 +196,14 @@ future of Flink. The talk is available on
<h3 id="table-api-in-scala-and-java">Table API in Scala and Java</h3>
-<p>The new <a href="https://github.com/apache/flink/tree/master/flink-staging/flink-table">Table
+<p>The new <a href="https://github.com/apache/flink/tree/master/flink-libraries/flink-table">Table
API</a>
in Flink is now available in both Java and Scala. Check out the
-examples <a href="https://github.com/apache/flink/blob/master/flink-staging/flink-table/src/main/java/org/apache/flink/examples/java/JavaTableExample.java">here (Java)</a> and <a href="https://github.com/apache/flink/tree/master/flink-staging/flink-table/src/main/scala/org/apache/flink/examples/scala">here (Scala)</a>.</p>
+examples <a href="https://github.com/apache/flink/blob/master/flink-libraries/flink-table/src/main/java/org/apache/flink/examples/java/JavaTableExample.java">here (Java)</a> and <a href="https://github.com/apache/flink/tree/master/flink-libraries/flink-table/src/main/scala/org/apache/flink/examples/scala">here (Scala)</a>.</p>
<h3 id="additions-to-the-machine-learning-library">Additions to the Machine Learning library</h3>
-<p>Flink’s <a href="https://github.com/apache/flink/tree/master/flink-staging/flink-ml">Machine Learning
+<p>Flink’s <a href="https://github.com/apache/flink/tree/master/flink-libraries/flink-ml">Machine Learning
library</a>
is seeing quite a bit of traction. Recent additions include the <a href="http://arxiv.org/abs/1409.1458">CoCoA
algorithm</a> for distributed
@@ -225,11 +219,6 @@ checkpoints at failure recovery. This functionality is currently
limited in that it does not yet handle large state and iterative
programs.</p>
-<h3 id="flink-on-tez">Flink on Tez</h3>
-
-<p>A new execution environment enables non-iterative Flink jobs to use
-Tez as an execution backend instead of Flink’s own network stack. Learn more
-<a href="http://ci.apache.org/projects/flink/flink-docs-master/setup/flink_on_tez.html">here</a>.</p>
</article>
</div>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2015/04/13/release-0.9.0-milestone1.html
----------------------------------------------------------------------
diff --git a/content/news/2015/04/13/release-0.9.0-milestone1.html b/content/news/2015/04/13/release-0.9.0-milestone1.html
index 33de1d2..c522a03 100644
--- a/content/news/2015/04/13/release-0.9.0-milestone1.html
+++ b/content/news/2015/04/13/release-0.9.0-milestone1.html
@@ -198,7 +198,7 @@ for Flink programs. Tables are available for both static and streaming
data sources (DataSet and DataStream APIs).</p>
<p>Check out the Table guide for Java and Scala
-<a href="http://ci.apache.org/projects/flink/flink-docs-master/libs/table.html">here</a>.</p>
+<a href="https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/libs/table.html">here</a>.</p>
<h3 id="gelly-graph-processing-api">Gelly Graph Processing API</h3>
@@ -212,14 +212,14 @@ vertex-centric graph processing, as well as a library of common graph
algorithms, including PageRank, SSSP, label propagation, and community
detection.</p>
-<p>Gelly internally builds on top of Flink’s <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/iterations.html">delta
+<p>Gelly internally builds on top of Flink’s <a href="https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/iterations.html">delta
iterations</a>. Iterative
graph algorithms are executed leveraging mutable state, achieving
similar performance with specialized graph processing systems.</p>
<p>Gelly will eventually subsume Spargel, Flink’s Pregel-like API. Check
out the Gelly guide
-<a href="http://ci.apache.org/projects/flink/flink-docs-master/libs/gelly_guide.html">here</a>.</p>
+<a href="https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/libs/gelly.html">here</a>.</p>
<h3 id="flink-machine-learning-library">Flink Machine Learning Library</h3>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2015/05/14/Community-update-April.html
----------------------------------------------------------------------
diff --git a/content/news/2015/05/14/Community-update-April.html b/content/news/2015/05/14/Community-update-April.html
index 6338b77..9be75a3 100644
--- a/content/news/2015/05/14/Community-update-April.html
+++ b/content/news/2015/05/14/Community-update-April.html
@@ -162,6 +162,16 @@
<p>April was an packed month for Apache Flink. </p>
+<h3 id="flink-runner-for-google-cloud-dataflow">Flink runner for Google Cloud Dataflow</h3>
+
+<p>A Flink runner for Google Cloud Dataflow was announced. See the blog
+posts by <a href="http://data-artisans.com/announcing-google-cloud-dataflow-on-flink-and-easy-flink-deployment-on-google-cloud/">data Artisans</a> and
+the <a href="http://googlecloudplatform.blogspot.de/2015/03/announcing-Google-Cloud-Dataflow-runner-for-Apache-Flink.html">Google Cloud Platform Blog</a>.
+Google Cloud Dataflow programs can be written using and open-source
+SDK and run in multiple backends, either as a managed service inside
+Google’s infrastructure, or leveraging open source runners,
+including Apache Flink.</p>
+
<h2 id="flink-090-milestone1-release">Flink 0.9.0-milestone1 release</h2>
<p>The highlight of April was of course the availability of <a href="/news/2015/04/13/release-0.9.0-milestone1.html">Flink 0.9-milestone1</a>. This was a release packed with new features, including, a Python DataSet API, the new SQL-like Table API, FlinkML, a machine learning library on Flink, Gelly, FLink’s Graph API, as well as a mode to run Flink on YARN leveraging Tez. In case you missed it, check out the <a href="/news/2015/04/13/release-0.9.0-milestone1.html">release announcement blog post</a> for details</p>
@@ -180,7 +190,7 @@
<h2 id="upcoming-events">Upcoming events</h2>
-<p>Stay tuned for a wealth of upcoming events! Two Flink talsk will be presented at <a href="http://berlinbuzzwords.de/15/sessions">Berlin Buzzwords</a>, Flink will be presented at the <a href="http://2015.hadoopsummit.org/san-jose/">Hadoop Summit in San Jose</a>. A <a href="http://www.meetup.com/Apache-Flink-Meetup/events/220557545/">training workshop on Apache Flink</a> is being organized in Berlin. Finally, <a href="http://flink-forward.org">Flink Forward</a>, the first conference to bring together the whole Flink community is taking place in Berlin in October 2015.</p>
+<p>Stay tuned for a wealth of upcoming events! Two Flink talsk will be presented at <a href="http://berlinbuzzwords.de/15/sessions">Berlin Buzzwords</a>, Flink will be presented at the <a href="http://2015.hadoopsummit.org/san-jose/">Hadoop Summit in San Jose</a>. A <a href="http://www.meetup.com/Apache-Flink-Meetup/events/220557545/">training workshop on Apache Flink</a> is being organized in Berlin. Finally, <a href="http://2015.flink-forward.org/">Flink Forward</a>, the first conference to bring together the whole Flink community is taking place in Berlin in October 2015.</p>
</article>
</div>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2015/08/24/introducing-flink-gelly.html
----------------------------------------------------------------------
diff --git a/content/news/2015/08/24/introducing-flink-gelly.html b/content/news/2015/08/24/introducing-flink-gelly.html
index 726f15a..355ac32 100644
--- a/content/news/2015/08/24/introducing-flink-gelly.html
+++ b/content/news/2015/08/24/introducing-flink-gelly.html
@@ -233,7 +233,7 @@ of vertices, edges and the node degrees. </p>
the ones provided by the batch processing API. These transformations can be applied one after the
other, yielding a new Graph after each step, in a fashion similar to operators on DataSets: </p>
-<div class="highlight"><pre><code class="language-java"><span class="n">inputGraph</span><span class="o">.</span><span class="na">getUndirected</span><span class="o">().</span><span class="na">mapEdges</span><span class="o">(</span><span class="k">new</span> <span class="nf">CustomEdgeMapper</span><span class="o">());</span></code></pre></div>
+<div class="highlight"><pre><code class="language-java"><span class="n">inputGraph</span><span class="o">.</span><span class="na">getUndirected</span><span class="o">().</span><span class="na">mapEdges</span><span class="o">(</span><span class="k">new</span> <span class="n">CustomEdgeMapper</span><span class="o">());</span></code></pre></div>
<p>Transformations can be applied on:</p>
@@ -269,7 +269,7 @@ one or more values per vertex, the more general <code>groupReduceOnEdges()</cod
<p>Assume you would want to compute the sum of the values of all incoming neighbors for each vertex.
We will call the <code>reduceOnNeighbors()</code> aggregation method since the sum is an associative and commutative operation and the neighbors’ values are needed:</p>
-<div class="highlight"><pre><code class="language-java"><span class="n">graph</span><span class="o">.</span><span class="na">reduceOnNeighbors</span><span class="o">(</span><span class="k">new</span> <span class="nf">SumValues</span><span class="o">(),</span> <span class="n">EdgeDirection</span><span class="o">.</span><span class="na">IN</span><span class="o">);</span></code></pre></div>
+<div class="highlight"><pre><code class="language-java"><span class="n">graph</span><span class="o">.</span><span class="na">reduceOnNeighbors</span><span class="o">(</span><span class="k">new</span> <span class="n">SumValues</span><span class="o">(),</span> <span class="n">EdgeDirection</span><span class="o">.</span><span class="na">IN</span><span class="o">);</span></code></pre></div>
<p>The vertex with id 1 is the only node that has no incoming edges. The result is therefore:</p>
@@ -455,7 +455,7 @@ playlist, we use a coGroup function to filter out the mismatches.</p>
<span class="c1">// read the mismatches dataset and extract the songIDs</span>
<span class="n">DataSet</span><span class="o"><</span><span class="n">Tuple3</span><span class="o"><</span><span class="n">String</span><span class="o">,</span> <span class="n">String</span><span class="o">,</span> <span class="n">Integer</span><span class="o">>></span> <span class="n">validTriplets</span> <span class="o">=</span> <span class="n">triplets</span>
<span class="o">.</span><span class="na">coGroup</span><span class="o">(</span><span class="n">mismatches</span><span class="o">).</span><span class="na">where</span><span class="o">(</span><span class="mi">1</span><span class="o">).</span><span class="na">equalTo</span><span class="o">(</span><span class="mi">0</span><span class="o">)</span>
- <span class="o">.</span><span class="na">with</span><span class="o">(</span><span class="k">new</span> <span class="nf">CoGroupFunction</span><span class="o">()</span> <span class="o">{</span>
+ <span class="o">.</span><span class="na">with</span><span class="o">(</span><span class="k">new</span> <span class="n">CoGroupFunction</span><span class="o">()</span> <span class="o">{</span>
<span class="kt">void</span> <span class="nf">coGroup</span><span class="o">(</span><span class="n">Iterable</span> <span class="n">triplets</span><span class="o">,</span> <span class="n">Iterable</span> <span class="n">invalidSongs</span><span class="o">,</span> <span class="n">Collector</span> <span class="n">out</span><span class="o">)</span> <span class="o">{</span>
<span class="k">if</span> <span class="o">(!</span><span class="n">invalidSongs</span><span class="o">.</span><span class="na">iterator</span><span class="o">().</span><span class="na">hasNext</span><span class="o">())</span> <span class="o">{</span>
<span class="k">for</span> <span class="o">(</span><span class="n">Tuple3</span> <span class="n">triplet</span> <span class="o">:</span> <span class="n">triplets</span><span class="o">)</span> <span class="o">{</span> <span class="c1">// valid triplet</span>
@@ -493,7 +493,7 @@ basically iterate through the edge value and collect the target (song) of the ma
<div class="highlight"><pre><code class="language-java"><span class="c1">//get the top track (most listened to) for each user</span>
<span class="n">DataSet</span><span class="o"><</span><span class="n">Tuple2</span><span class="o">></span> <span class="n">usersWithTopTrack</span> <span class="o">=</span> <span class="n">userSongGraph</span>
- <span class="o">.</span><span class="na">groupReduceOnEdges</span><span class="o">(</span><span class="k">new</span> <span class="nf">GetTopSongPerUser</span><span class="o">(),</span> <span class="n">EdgeDirection</span><span class="o">.</span><span class="na">OUT</span><span class="o">);</span>
+ <span class="o">.</span><span class="na">groupReduceOnEdges</span><span class="o">(</span><span class="k">new</span> <span class="n">GetTopSongPerUser</span><span class="o">(),</span> <span class="n">EdgeDirection</span><span class="o">.</span><span class="na">OUT</span><span class="o">);</span>
<span class="kd">class</span> <span class="nc">GetTopSongPerUser</span> <span class="kd">implements</span> <span class="n">EdgesFunctionWithVertexValue</span> <span class="o">{</span>
<span class="kt">void</span> <span class="nf">iterateEdges</span><span class="o">(</span><span class="n">Vertex</span> <span class="n">vertex</span><span class="o">,</span> <span class="n">Iterable</span><span class="o"><</span><span class="n">Edge</span><span class="o">></span> <span class="n">edges</span><span class="o">)</span> <span class="o">{</span>
@@ -506,7 +506,7 @@ basically iterate through the edge value and collect the target (song) of the ma
<span class="n">topSong</span> <span class="o">=</span> <span class="n">edge</span><span class="o">.</span><span class="na">getTarget</span><span class="o">();</span>
<span class="o">}</span>
<span class="o">}</span>
- <span class="k">return</span> <span class="k">new</span> <span class="nf">Tuple2</span><span class="o">(</span><span class="n">vertex</span><span class="o">.</span><span class="na">getId</span><span class="o">(),</span> <span class="n">topSong</span><span class="o">);</span>
+ <span class="k">return</span> <span class="k">new</span> <span class="n">Tuple2</span><span class="o">(</span><span class="n">vertex</span><span class="o">.</span><span class="na">getId</span><span class="o">(),</span> <span class="n">topSong</span><span class="o">);</span>
<span class="o">}</span>
<span class="o">}</span></code></pre></div>
@@ -542,14 +542,14 @@ straightforward as a call to the <code>Graph.fromDataSet()</code> method.</p>
<span class="o">}</span>
<span class="o">})</span>
<span class="o">.</span><span class="na">groupBy</span><span class="o">(</span><span class="mi">1</span><span class="o">)</span>
- <span class="o">.</span><span class="na">reduceGroup</span><span class="o">(</span><span class="k">new</span> <span class="nf">GroupReduceFunction</span><span class="o">()</span> <span class="o">{</span>
+ <span class="o">.</span><span class="na">reduceGroup</span><span class="o">(</span><span class="k">new</span> <span class="n">GroupReduceFunction</span><span class="o">()</span> <span class="o">{</span>
<span class="kt">void</span> <span class="nf">reduce</span><span class="o">(</span><span class="n">Iterable</span><span class="o"><</span><span class="n">Edge</span><span class="o">></span> <span class="n">edges</span><span class="o">,</span> <span class="n">Collector</span><span class="o"><</span><span class="n">Edge</span><span class="o">></span> <span class="n">out</span><span class="o">)</span> <span class="o">{</span>
- <span class="n">List</span> <span class="n">users</span> <span class="o">=</span> <span class="k">new</span> <span class="nf">ArrayList</span><span class="o">();</span>
+ <span class="n">List</span> <span class="n">users</span> <span class="o">=</span> <span class="k">new</span> <span class="n">ArrayList</span><span class="o">();</span>
<span class="k">for</span> <span class="o">(</span><span class="n">Edge</span> <span class="n">edge</span> <span class="o">:</span> <span class="n">edges</span><span class="o">)</span> <span class="o">{</span>
<span class="n">users</span><span class="o">.</span><span class="na">add</span><span class="o">(</span><span class="n">edge</span><span class="o">.</span><span class="na">getSource</span><span class="o">());</span>
<span class="k">for</span> <span class="o">(</span><span class="kt">int</span> <span class="n">i</span> <span class="o">=</span> <span class="mi">0</span><span class="o">;</span> <span class="n">i</span> <span class="o"><</span> <span class="n">users</span><span class="o">.</span><span class="na">size</span><span class="o">()</span> <span class="o">-</span> <span class="mi">1</span><span class="o">;</span> <span class="n">i</span><span class="o">++)</span> <span class="o">{</span>
<span class="k">for</span> <span class="o">(</span><span class="kt">int</span> <span class="n">j</span> <span class="o">=</span> <span class="n">i</span><span class="o">+</span><span class="mi">1</span><span class="o">;</span> <span class="n">j</span> <span class="o"><</span> <span class="n">users</span><span class="o">.</span><span class="na">size</span><span class="o">()</span> <span class="o">-</span> <span class="mi">1</span><span class="o">;</span> <span class="n">j</span><span class="o">++)</span> <span class="o">{</span>
- <span class="n">out</span><span class="o">.</span><span class="na">collect</span><span class="o">(</span><span class="k">new</span> <span class="nf">Edge</span><span class="o">(</span><span class="n">users</span><span class="o">.</span><span class="na">get</span><span class="o">(</span><span class="n">i</span><span class="o">),</span> <span class="n">users</span><span class="o">.</span><span class="na">get</span><span class="o">(</span><span class="n">j</span><span class="o">)));</span>
+ <span class="n">out</span><span class="o">.</span><span class="na">collect</span><span class="o">(</span><span class="k">new</span> <span class="n">Edge</span><span class="o">(</span><span class="n">users</span><span class="o">.</span><span class="na">get</span><span class="o">(</span><span class="n">i</span><span class="o">),</span> <span class="n">users</span><span class="o">.</span><span class="na">get</span><span class="o">(</span><span class="n">j</span><span class="o">)));</span>
<span class="o">}</span>
<span class="o">}</span>
<span class="o">}</span>
@@ -580,12 +580,12 @@ among their neighbors. </p>
<span class="c1">// update the vertex values and run the label propagation algorithm</span>
<span class="n">DataSet</span><span class="o"><</span><span class="n">Vertex</span><span class="o">></span> <span class="n">verticesWithCommunity</span> <span class="o">=</span> <span class="n">similarUsersGraph</span>
- <span class="o">.</span><span class="na">joinWithVertices</span><span class="o">(</span><span class="n">idsWithlLabels</span><span class="o">,</span> <span class="k">new</span> <span class="nf">MapFunction</span><span class="o">()</span> <span class="o">{</span>
+ <span class="o">.</span><span class="na">joinWithVertices</span><span class="o">(</span><span class="n">idsWithlLabels</span><span class="o">,</span> <span class="k">new</span> <span class="n">MapFunction</span><span class="o">()</span> <span class="o">{</span>
<span class="kd">public</span> <span class="n">Long</span> <span class="nf">map</span><span class="o">(</span><span class="n">Tuple2</span> <span class="n">idWithLabel</span><span class="o">)</span> <span class="o">{</span>
<span class="k">return</span> <span class="n">idWithLabel</span><span class="o">.</span><span class="na">f1</span><span class="o">;</span>
<span class="o">}</span>
<span class="o">})</span>
- <span class="o">.</span><span class="na">run</span><span class="o">(</span><span class="k">new</span> <span class="nf">LabelPropagation</span><span class="o">(</span><span class="n">numIterations</span><span class="o">))</span>
+ <span class="o">.</span><span class="na">run</span><span class="o">(</span><span class="k">new</span> <span class="n">LabelPropagation</span><span class="o">(</span><span class="n">numIterations</span><span class="o">))</span>
<span class="o">.</span><span class="na">getVertices</span><span class="o">();</span></code></pre></div>
<p><a href="#top">Back to top</a></p>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2015/09/03/flink-forward.html
----------------------------------------------------------------------
diff --git a/content/news/2015/09/03/flink-forward.html b/content/news/2015/09/03/flink-forward.html
index 107468b..9440c4a 100644
--- a/content/news/2015/09/03/flink-forward.html
+++ b/content/news/2015/09/03/flink-forward.html
@@ -160,7 +160,7 @@
<article>
<p>03 Sep 2015</p>
-<p><a href="http://flink-forward.org/">Flink Forward 2015</a> is the first
+<p><a href="http://2015.flink-forward.org/">Flink Forward 2015</a> is the first
conference with Flink at its center that aims to bring together the
Apache Flink community in a single place. The organizers are starting
this conference in October 12 and 13 from Berlin, the place where
@@ -170,7 +170,7 @@ Apache Flink started.</p>
<img src="/img/blog/flink-forward-banner.png" style="width:80%;margin:15px" />
</center>
-<p>The <a href="http://flink-forward.org/?post_type=day">conference program</a> has
+<p>The <a href="http://2015.flink-forward.org/?post_type=day">conference program</a> has
been announced by the organizers and a program committee consisting of
Flink PMC members. The agenda contains talks from industry and
academia as well as a dedicated session on hands-on Flink training.</p>
@@ -179,7 +179,7 @@ academia as well as a dedicated session on hands-on Flink training.</p>
<ul>
<li>
- <p>A keynote by <a href="http://flink-forward.org/?speaker=william-vambenepe">William
+ <p>A keynote by <a href="http://2015.flink-forward.org/?speaker=william-vambenepe">William
Vambenepe</a>,
lead of the product management team responsible for Big Data
services on Google Cloud Platform (BigQuery, Dataflow, etc…) on
@@ -201,9 +201,8 @@ fault tolerance, the internal runtime architecture, and others.</p>
</li>
</ul>
-<p>Check out the <a href="http://flink-forward.org/?post_type=day">schedule</a> and
-<a href="http://flink-forward.org/?page_id=96">register</a> for the
-conference.</p>
+<p>Check out the <a href="http://2015.flink-forward.org/?post_type=day">schedule</a> and
+register for the conference.</p>
</article>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2015/09/16/off-heap-memory.html
----------------------------------------------------------------------
diff --git a/content/news/2015/09/16/off-heap-memory.html b/content/news/2015/09/16/off-heap-memory.html
index 4383cc1..317e596 100644
--- a/content/news/2015/09/16/off-heap-memory.html
+++ b/content/news/2015/09/16/off-heap-memory.html
@@ -328,7 +328,7 @@ Either <code>0 + absolutePointer</code> or <code>objectRefAddress + offset</code
<h2 id="appendix-detailed-micro-benchmarks">Appendix: Detailed Micro Benchmarks</h2>
-<p>These microbenchmarks test the performance of the different memory segment implementations on various operation. The code is available <a href="https://github.com/apache/flink/blob/master/flink-core/src/test/java/org/apache/flink/core/memory/benchmarks/MemorySegmentSpeedBenchmark.java">as part of the Flink project</a></p>
+<p>These microbenchmarks test the performance of the different memory segment implementations on various operation.</p>
<p>Each experiments tests the different implementations multiple times in different orders, to balance the advantage/disadvantage of the JIT compiler specializing towards certain code paths. All experiments were run 5x, discarding the fastest and slowest run, and then averaged. This compensated for delay before the JIT kicks in.</p>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2015/12/11/storm-compatibility.html
----------------------------------------------------------------------
diff --git a/content/news/2015/12/11/storm-compatibility.html b/content/news/2015/12/11/storm-compatibility.html
index a7fd3d9..95b4303 100644
--- a/content/news/2015/12/11/storm-compatibility.html
+++ b/content/news/2015/12/11/storm-compatibility.html
@@ -199,13 +199,13 @@ For this, you only need to replace the dependency <code>storm-core</code> by <co
First, the program is assembled the Storm way without any code change to Spouts, Bolts, or the topology itself.</p>
<div class="highlight"><pre><code class="language-java"><span class="c1">// assemble topology, the Storm way</span>
-<span class="n">TopologyBuilder</span> <span class="n">builder</span> <span class="o">=</span> <span class="k">new</span> <span class="nf">TopologyBuilder</span><span class="o">();</span>
-<span class="n">builder</span><span class="o">.</span><span class="na">setSpout</span><span class="o">(</span><span class="s">"source"</span><span class="o">,</span> <span class="k">new</span> <span class="nf">StormFileSpout</span><span class="o">(</span><span class="n">inputFilePath</span><span class="o">));</span>
-<span class="n">builder</span><span class="o">.</span><span class="na">setBolt</span><span class="o">(</span><span class="s">"tokenizer"</span><span class="o">,</span> <span class="k">new</span> <span class="nf">StormBoltTokenizer</span><span class="o">())</span>
+<span class="n">TopologyBuilder</span> <span class="n">builder</span> <span class="o">=</span> <span class="k">new</span> <span class="n">TopologyBuilder</span><span class="o">();</span>
+<span class="n">builder</span><span class="o">.</span><span class="na">setSpout</span><span class="o">(</span><span class="s">"source"</span><span class="o">,</span> <span class="k">new</span> <span class="n">StormFileSpout</span><span class="o">(</span><span class="n">inputFilePath</span><span class="o">));</span>
+<span class="n">builder</span><span class="o">.</span><span class="na">setBolt</span><span class="o">(</span><span class="s">"tokenizer"</span><span class="o">,</span> <span class="k">new</span> <span class="n">StormBoltTokenizer</span><span class="o">())</span>
<span class="o">.</span><span class="na">shuffleGrouping</span><span class="o">(</span><span class="s">"source"</span><span class="o">);</span>
-<span class="n">builder</span><span class="o">.</span><span class="na">setBolt</span><span class="o">(</span><span class="s">"counter"</span><span class="o">,</span> <span class="k">new</span> <span class="nf">StormBoltCounter</span><span class="o">())</span>
- <span class="o">.</span><span class="na">fieldsGrouping</span><span class="o">(</span><span class="s">"tokenizer"</span><span class="o">,</span> <span class="k">new</span> <span class="nf">Fields</span><span class="o">(</span><span class="s">"word"</span><span class="o">));</span>
-<span class="n">builder</span><span class="o">.</span><span class="na">setBolt</span><span class="o">(</span><span class="s">"sink"</span><span class="o">,</span> <span class="k">new</span> <span class="nf">StormBoltFileSink</span><span class="o">(</span><span class="n">outputFilePath</span><span class="o">))</span>
+<span class="n">builder</span><span class="o">.</span><span class="na">setBolt</span><span class="o">(</span><span class="s">"counter"</span><span class="o">,</span> <span class="k">new</span> <span class="n">StormBoltCounter</span><span class="o">())</span>
+ <span class="o">.</span><span class="na">fieldsGrouping</span><span class="o">(</span><span class="s">"tokenizer"</span><span class="o">,</span> <span class="k">new</span> <span class="n">Fields</span><span class="o">(</span><span class="s">"word"</span><span class="o">));</span>
+<span class="n">builder</span><span class="o">.</span><span class="na">setBolt</span><span class="o">(</span><span class="s">"sink"</span><span class="o">,</span> <span class="k">new</span> <span class="n">StormBoltFileSink</span><span class="o">(</span><span class="n">outputFilePath</span><span class="o">))</span>
<span class="o">.</span><span class="na">shuffleGrouping</span><span class="o">(</span><span class="s">"counter"</span><span class="o">);</span></code></pre></div>
<p>In order to execute the topology, we need to translate it to a <code>FlinkTopology</code> and submit it to a local or remote Flink cluster, very similar to submitting the application to a Storm cluster.<sup><a href="#fn1" id="ref1">1</a></sup></p>
@@ -214,7 +214,7 @@ First, the program is assembled the Storm way without any code change to Spouts,
<span class="c1">// replaces: StormTopology topology = builder.createTopology();</span>
<span class="n">FlinkTopology</span> <span class="n">topology</span> <span class="o">=</span> <span class="n">FlinkTopology</span><span class="o">.</span><span class="na">createTopology</span><span class="o">(</span><span class="n">builder</span><span class="o">);</span>
-<span class="n">Config</span> <span class="n">conf</span> <span class="o">=</span> <span class="k">new</span> <span class="nf">Config</span><span class="o">();</span>
+<span class="n">Config</span> <span class="n">conf</span> <span class="o">=</span> <span class="k">new</span> <span class="n">Config</span><span class="o">();</span>
<span class="k">if</span><span class="o">(</span><span class="n">runLocal</span><span class="o">)</span> <span class="o">{</span>
<span class="c1">// use FlinkLocalCluster instead of LocalCluster</span>
<span class="n">FlinkLocalCluster</span> <span class="n">cluster</span> <span class="o">=</span> <span class="n">FlinkLocalCluster</span><span class="o">.</span><span class="na">getLocalCluster</span><span class="o">();</span>
@@ -254,14 +254,14 @@ As Storm is type agnostic, it is required to specify the output type of embedded
<span class="c1">// use Spout as source</span>
<span class="n">DataStream</span><span class="o"><</span><span class="n">Tuple1</span><span class="o"><</span><span class="n">String</span><span class="o">>></span> <span class="n">source</span> <span class="o">=</span>
<span class="n">env</span><span class="o">.</span><span class="na">addSource</span><span class="o">(</span><span class="c1">// Flink provided wrapper including original Spout</span>
- <span class="k">new</span> <span class="n">SpoutWrapper</span><span class="o"><</span><span class="n">String</span><span class="o">>(</span><span class="k">new</span> <span class="nf">FileSpout</span><span class="o">(</span><span class="n">localFilePath</span><span class="o">)),</span>
+ <span class="k">new</span> <span class="n">SpoutWrapper</span><span class="o"><</span><span class="n">String</span><span class="o">>(</span><span class="k">new</span> <span class="n">FileSpout</span><span class="o">(</span><span class="n">localFilePath</span><span class="o">)),</span>
<span class="c1">// specify output type manually</span>
<span class="n">TypeExtractor</span><span class="o">.</span><span class="na">getForObject</span><span class="o">(</span><span class="k">new</span> <span class="n">Tuple1</span><span class="o"><</span><span class="n">String</span><span class="o">>(</span><span class="s">""</span><span class="o">)));</span>
<span class="c1">// FileSpout cannot be parallelized</span>
<span class="n">DataStream</span><span class="o"><</span><span class="n">Tuple1</span><span class="o"><</span><span class="n">String</span><span class="o">>></span> <span class="n">text</span> <span class="o">=</span> <span class="n">source</span><span class="o">.</span><span class="na">setParallelism</span><span class="o">(</span><span class="mi">1</span><span class="o">);</span>
<span class="c1">// further processing with Flink</span>
-<span class="n">DataStream</span><span class="o"><</span><span class="n">Tuple2</span><span class="o"><</span><span class="n">String</span><span class="o">,</span><span class="n">Integer</span><span class="o">></span> <span class="n">tokens</span> <span class="o">=</span> <span class="n">text</span><span class="o">.</span><span class="na">flatMap</span><span class="o">(</span><span class="k">new</span> <span class="nf">Tokenizer</span><span class="o">()).</span><span class="na">keyBy</span><span class="o">(</span><span class="mi">0</span><span class="o">);</span>
+<span class="n">DataStream</span><span class="o"><</span><span class="n">Tuple2</span><span class="o"><</span><span class="n">String</span><span class="o">,</span><span class="n">Integer</span><span class="o">></span> <span class="n">tokens</span> <span class="o">=</span> <span class="n">text</span><span class="o">.</span><span class="na">flatMap</span><span class="o">(</span><span class="k">new</span> <span class="n">Tokenizer</span><span class="o">()).</span><span class="na">keyBy</span><span class="o">(</span><span class="mi">0</span><span class="o">);</span>
<span class="c1">// use Bolt for counting</span>
<span class="n">DataStream</span><span class="o"><</span><span class="n">Tuple2</span><span class="o"><</span><span class="n">String</span><span class="o">,</span><span class="n">Integer</span><span class="o">></span> <span class="n">counts</span> <span class="o">=</span>
@@ -269,7 +269,7 @@ As Storm is type agnostic, it is required to specify the output type of embedded
<span class="c1">// specify output type manually</span>
<span class="n">TypeExtractor</span><span class="o">.</span><span class="na">getForObject</span><span class="o">(</span><span class="k">new</span> <span class="n">Tuple2</span><span class="o"><</span><span class="n">String</span><span class="o">,</span><span class="n">Integer</span><span class="o">>(</span><span class="s">""</span><span class="o">,</span><span class="mi">0</span><span class="o">))</span>
<span class="c1">// Flink provided wrapper including original Bolt</span>
- <span class="k">new</span> <span class="n">BoltWrapper</span><span class="o"><</span><span class="n">String</span><span class="o">,</span><span class="n">Tuple2</span><span class="o"><</span><span class="n">String</span><span class="o">,</span><span class="n">Integer</span><span class="o">>>(</span><span class="k">new</span> <span class="nf">BoltCounter</span><span class="o">()));</span>
+ <span class="k">new</span> <span class="n">BoltWrapper</span><span class="o"><</span><span class="n">String</span><span class="o">,</span><span class="n">Tuple2</span><span class="o"><</span><span class="n">String</span><span class="o">,</span><span class="n">Integer</span><span class="o">>>(</span><span class="k">new</span> <span class="n">BoltCounter</span><span class="o">()));</span>
<span class="c1">// write result to file via Flink sink</span>
<span class="n">counts</span><span class="o">.</span><span class="na">writeAsText</span><span class="o">(</span><span class="n">outputPath</span><span class="o">);</span>
@@ -293,7 +293,7 @@ We are also investigating the integration of Storm’s higher-level programming
This enables you to even embed third-party Spouts and Bolts where the source code is not available.
While you can embed Spouts/Bolts in a Flink program and mix-and-match them with Flink operators, running whole topologies is the easiest way to get started and can be achieved with almost no code changes.</p>
-<p>If you want to try out Flink’s Storm compatibility package checkout our <a href="https://ci.apache.org/projects/flink/flink-docs-master/apis/storm_compatibility.html">Documentation</a>.</p>
+<p>If you want to try out Flink’s Storm compatibility package checkout our <a href="https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/storm_compatibility.html">Documentation</a>.</p>
<hr />
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2015/12/18/a-year-in-review.html
----------------------------------------------------------------------
diff --git a/content/news/2015/12/18/a-year-in-review.html b/content/news/2015/12/18/a-year-in-review.html
index 502c9a2..20a2597 100644
--- a/content/news/2015/12/18/a-year-in-review.html
+++ b/content/news/2015/12/18/a-year-in-review.html
@@ -198,7 +198,7 @@ meetups around the globe</a>:</p>
<h1 id="flink-forward-2015">Flink Forward 2015</h1>
-<p>One of the highlights of the year for Flink was undoubtedly the <a href="http://flink-forward.org/">Flink
+<p>One of the highlights of the year for Flink was undoubtedly the <a href="http://2015.flink-forward.org/">Flink
Forward</a> conference, the first conference
on Apache Flink that was held in October in Berlin. More than 250
participants (roughly half based outside Germany where the conference
@@ -206,7 +206,7 @@ was held) attended more than 33 technical talks from organizations
including Google, MongoDB, Bouygues Telecom, NFLabs, Euranova, RedHat,
IBM, Huawei, Intel, Ericsson, Capital One, Zalando, Amadeus, the Otto
Group, and ResearchGate. If you have not yet watched their talks,
-check out the <a href="http://flink-forward.org/?post_type=day">slides</a> and
+check out the <a href="http://2015.flink-forward.org/?post_type=day">slides</a> and
<a href="https://www.youtube.com/playlist?list=PLDX4T_cnKjD31JeWR1aMOi9LXPRQ6nyHO">videos</a>
from Flink Forward.</p>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2016/04/06/cep-monitoring.html
----------------------------------------------------------------------
diff --git a/content/news/2016/04/06/cep-monitoring.html b/content/news/2016/04/06/cep-monitoring.html
index 1be1758..f545a47 100644
--- a/content/news/2016/04/06/cep-monitoring.html
+++ b/content/news/2016/04/06/cep-monitoring.html
@@ -280,7 +280,7 @@ Our pattern select function generates for each matching pattern a <code>Temperat
<span class="n">TemperatureEvent</span> <span class="n">first</span> <span class="o">=</span> <span class="o">(</span><span class="n">TemperatureEvent</span><span class="o">)</span> <span class="n">pattern</span><span class="o">.</span><span class="na">get</span><span class="o">(</span><span class="s">"First Event"</span><span class="o">);</span>
<span class="n">TemperatureEvent</span> <span class="n">second</span> <span class="o">=</span> <span class="o">(</span><span class="n">TemperatureEvent</span><span class="o">)</span> <span class="n">pattern</span><span class="o">.</span><span class="na">get</span><span class="o">(</span><span class="s">"Second Event"</span><span class="o">);</span>
- <span class="k">return</span> <span class="k">new</span> <span class="nf">TemperatureWarning</span><span class="o">(</span>
+ <span class="k">return</span> <span class="k">new</span> <span class="n">TemperatureWarning</span><span class="o">(</span>
<span class="n">first</span><span class="o">.</span><span class="na">getRackID</span><span class="o">(),</span>
<span class="o">(</span><span class="n">first</span><span class="o">.</span><span class="na">getTemperature</span><span class="o">()</span> <span class="o">+</span> <span class="n">second</span><span class="o">.</span><span class="na">getTemperature</span><span class="o">())</span> <span class="o">/</span> <span class="mi">2</span><span class="o">);</span>
<span class="o">}</span>
@@ -322,7 +322,7 @@ Thus, we will only generate a <code>TemperatureAlert</code> if and only if the t
<span class="n">TemperatureWarning</span> <span class="n">second</span> <span class="o">=</span> <span class="n">pattern</span><span class="o">.</span><span class="na">get</span><span class="o">(</span><span class="s">"Second Event"</span><span class="o">);</span>
<span class="k">if</span> <span class="o">(</span><span class="n">first</span><span class="o">.</span><span class="na">getAverageTemperature</span><span class="o">()</span> <span class="o"><</span> <span class="n">second</span><span class="o">.</span><span class="na">getAverageTemperature</span><span class="o">())</span> <span class="o">{</span>
- <span class="n">out</span><span class="o">.</span><span class="na">collect</span><span class="o">(</span><span class="k">new</span> <span class="nf">TemperatureAlert</span><span class="o">(</span><span class="n">first</span><span class="o">.</span><span class="na">getRackID</span><span class="o">()));</span>
+ <span class="n">out</span><span class="o">.</span><span class="na">collect</span><span class="o">(</span><span class="k">new</span> <span class="n">TemperatureAlert</span><span class="o">(</span><span class="n">first</span><span class="o">.</span><span class="na">getRackID</span><span class="o">()));</span>
<span class="o">}</span>
<span class="o">});</span></code></pre></div>
[7/8] flink-web git commit: rebuild web page
Posted by mj...@apache.org.
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/blog/feed.xml
----------------------------------------------------------------------
diff --git a/content/blog/feed.xml b/content/blog/feed.xml
index 2c4b25f..ef1a75c 100644
--- a/content/blog/feed.xml
+++ b/content/blog/feed.xml
@@ -128,7 +128,7 @@ Our pattern select function generates for each matching pattern a <code>Te
<span class="n">TemperatureEvent</span> <span class="n">first</span> <span class="o">=</span> <span class="o">(</span><span class="n">TemperatureEvent</span><span class="o">)</span> <span class="n">pattern</span><span class="o">.</span><span class="na">get</span><span class="o">(</span><span class="s">&quot;First Event&quot;</span><span class="o">);</span>
<span class="n">TemperatureEvent</span> <span class="n">second</span> <span class="o">=</span> <span class="o">(</span><span class="n">TemperatureEvent</span><span class="o">)</span> <span class="n">pattern</span><span class="o">.</span><span class="na">get</span><span class="o">(</span><span class="s">&quot;Second Event&quot;</span><span class="o">);</span>
- <span class="k">return</span> <span class="k">new</span> <span class="nf">TemperatureWarning</span><span class="o">(</span>
+ <span class="k">return</span> <span class="k">new</span> <span class="n">TemperatureWarning</span><span class="o">(</span>
<span class="n">first</span><span class="o">.</span><span class="na">getRackID</span><span class="o">(),</span>
<span class="o">(</span><span class="n">first</span><span class="o">.</span><span class="na">getTemperature</span><span class="o">()</span> <span class="o">+</span> <span class="n">second</span><span class="o">.</span><span class="na">getTemperature</span><span class="o">())</span> <span class="o">/</span> <span class="mi">2</span><span class="o">);</span>
<span class="o">}</span>
@@ -170,7 +170,7 @@ Thus, we will only generate a <code>TemperatureAlert</code> if and o
<span class="n">TemperatureWarning</span> <span class="n">second</span> <span class="o">=</span> <span class="n">pattern</span><span class="o">.</span><span class="na">get</span><span class="o">(</span><span class="s">&quot;Second Event&quot;</span><span class="o">);</span>
<span class="k">if</span> <span class="o">(</span><span class="n">first</span><span class="o">.</span><span class="na">getAverageTemperature</span><span class="o">()</span> <span class="o">&lt;</span> <span class="n">second</span><span class="o">.</span><span class="na">getAverageTemperature</span><span class="o">())</span> <span class="o">{</span>
- <span class="n">out</span><span class="o">.</span><span class="na">collect</span><span class="o">(</span><span class="k">new</span> <span class="nf">TemperatureAlert</span><span class="o">(</span><span class="n">first</span><span class="o">.</span><span class="na">getRackID</span><span class="o">()));</span>
+ <span class="n">out</span><span class="o">.</span><span class="na">collect</span><span class="o">(</span><span class="k">new</span> <span class="n">TemperatureAlert</span><span class="o">(</span><span class="n">first</span><span class="o">.</span><span class="na">getRackID</span><span class="o">()));</span>
<span class="o">}</span>
<span class="o">});</span></code></pre></div>
@@ -474,7 +474,7 @@ meetups around the globe</a>:</p>
<h1 id="flink-forward-2015">Flink Forward 2015</h1>
-<p>One of the highlights of the year for Flink was undoubtedly the <a href="http://flink-forward.org/">Flink
+<p>One of the highlights of the year for Flink was undoubtedly the <a href="http://2015.flink-forward.org/">Flink
Forward</a> conference, the first conference
on Apache Flink that was held in October in Berlin. More than 250
participants (roughly half based outside Germany where the conference
@@ -482,7 +482,7 @@ was held) attended more than 33 technical talks from organizations
including Google, MongoDB, Bouygues Telecom, NFLabs, Euranova, RedHat,
IBM, Huawei, Intel, Ericsson, Capital One, Zalando, Amadeus, the Otto
Group, and ResearchGate. If you have not yet watched their talks,
-check out the <a href="http://flink-forward.org/?post_type=day">slides</a> and
+check out the <a href="http://2015.flink-forward.org/?post_type=day">slides</a> and
<a href="https://www.youtube.com/playlist?list=PLDX4T_cnKjD31JeWR1aMOi9LXPRQ6nyHO">videos</a>
from Flink Forward.</p>
@@ -699,13 +699,13 @@ For this, you only need to replace the dependency <code>storm-core</cod
First, the program is assembled the Storm way without any code change to Spouts, Bolts, or the topology itself.</p>
<div class="highlight"><pre><code class="language-java"><span class="c1">// assemble topology, the Storm way</span>
-<span class="n">TopologyBuilder</span> <span class="n">builder</span> <span class="o">=</span> <span class="k">new</span> <span class="nf">TopologyBuilder</span><span class="o">();</span>
-<span class="n">builder</span><span class="o">.</span><span class="na">setSpout</span><span class="o">(</span><span class="s">&quot;source&quot;</span><span class="o">,</span> <span class="k">new</span> <span class="nf">StormFileSpout</span><span class="o">(</span><span class="n">inputFilePath</span><span class="o">));</span>
-<span class="n">builder</span><span class="o">.</span><span class="na">setBolt</span><span class="o">(</span><span class="s">&quot;tokenizer&quot;</span><span class="o">,</span> <span class="k">new</span> <span class="nf">StormBoltTokenizer</span><span class="o">())</span>
+<span class="n">TopologyBuilder</span> <span class="n">builder</span> <span class="o">=</span> <span class="k">new</span> <span class="n">TopologyBuilder</span><span class="o">();</span>
+<span class="n">builder</span><span class="o">.</span><span class="na">setSpout</span><span class="o">(</span><span class="s">&quot;source&quot;</span><span class="o">,</span> <span class="k">new</span> <span class="n">StormFileSpout</span><span class="o">(</span><span class="n">inputFilePath</span><span class="o">));</span>
+<span class="n">builder</span><span class="o">.</span><span class="na">setBolt</span><span class="o">(</span><span class="s">&quot;tokenizer&quot;</span><span class="o">,</span> <span class="k">new</span> <span class="n">StormBoltTokenizer</span><span class="o">())</span>
<span class="o">.</span><span class="na">shuffleGrouping</span><span class="o">(</span><span class="s">&quot;source&quot;</span><span class="o">);</span>
-<span class="n">builder</span><span class="o">.</span><span class="na">setBolt</span><span class="o">(</span><span class="s">&quot;counter&quot;</span><span class="o">,</span> <span class="k">new</span> <span class="nf">StormBoltCounter</span><span class="o">())</span>
- <span class="o">.</span><span class="na">fieldsGrouping</span><span class="o">(</span><span class="s">&quot;tokenizer&quot;</span><span class="o">,</span> <span class="k">new</span> <span class="nf">Fields</span><span class="o">(</span><span class="s">&quot;word&quot;</span><span class="o">));</span>
-<span class="n">builder</span><span class="o">.</span><span class="na">setBolt</span><span class="o">(</span><span class="s">&quot;sink&quot;</span><span class="o">,</span> <span class="k">new</span> <span class="nf">StormBoltFileSink</span><span class="o">(</span><span class="n">outputFilePath</span><span class="o">))</span>
+<span class="n">builder</span><span class="o">.</span><span class="na">setBolt</span><span class="o">(</span><span class="s">&quot;counter&quot;</span><span class="o">,</span> <span class="k">new</span> <span class="n">StormBoltCounter</span><span class="o">())</span>
+ <span class="o">.</span><span class="na">fieldsGrouping</span><span class="o">(</span><span class="s">&quot;tokenizer&quot;</span><span class="o">,</span> <span class="k">new</span> <span class="n">Fields</span><span class="o">(</span><span class="s">&quot;word&quot;</span><span class="o">));</span>
+<span class="n">builder</span><span class="o">.</span><span class="na">setBolt</span><span class="o">(</span><span class="s">&quot;sink&quot;</span><span class="o">,</span> <span class="k">new</span> <span class="n">StormBoltFileSink</span><span class="o">(</span><span class="n">outputFilePath</span><span class="o">))</span>
<span class="o">.</span><span class="na">shuffleGrouping</span><span class="o">(</span><span class="s">&quot;counter&quot;</span><span class="o">);</span></code></pre></div>
<p>In order to execute the topology, we need to translate it to a <code>FlinkTopology</code> and submit it to a local or remote Flink cluster, very similar to submitting the application to a Storm cluster.<sup><a href="#fn1" id="ref1">1</a></sup></p>
@@ -714,7 +714,7 @@ First, the program is assembled the Storm way without any code change to Spouts,
<span class="c1">// replaces: StormTopology topology = builder.createTopology();</span>
<span class="n">FlinkTopology</span> <span class="n">topology</span> <span class="o">=</span> <span class="n">FlinkTopology</span><span class="o">.</span><span class="na">createTopology</span><span class="o">(</span><span class="n">builder</span><span class="o">);</span>
-<span class="n">Config</span> <span class="n">conf</span> <span class="o">=</span> <span class="k">new</span> <span class="nf">Config</span><span class="o">();</span>
+<span class="n">Config</span> <span class="n">conf</span> <span class="o">=</span> <span class="k">new</span> <span class="n">Config</span><span class="o">();</span>
<span class="k">if</span><span class="o">(</span><span class="n">runLocal</span><span class="o">)</span> <span class="o">{</span>
<span class="c1">// use FlinkLocalCluster instead of LocalCluster</span>
<span class="n">FlinkLocalCluster</span> <span class="n">cluster</span> <span class="o">=</span> <span class="n">FlinkLocalCluster</span><span class="o">.</span><span class="na">getLocalCluster</span><span class="o">();</span>
@@ -754,14 +754,14 @@ As Storm is type agnostic, it is required to specify the output type of embedded
<span class="c1">// use Spout as source</span>
<span class="n">DataStream</span><span class="o">&lt;</span><span class="n">Tuple1</span><span class="o">&lt;</span><span class="n">String</span><span class="o">&gt;&gt;</span> <span class="n">source</span> <span class="o">=</span>
<span class="n">env</span><span class="o">.</span><span class="na">addSource</span><span class="o">(</span><span class="c1">// Flink provided wrapper including original Spout</span>
- <span class="k">new</span> <span class="n">SpoutWrapper</span><span class="o">&lt;</span><span class="n">String</span><span class="o">&gt;(</span><span class="k">new</span> <span class="nf">FileSpout</span><span class="o">(</span><span class="n">localFilePath</span><span class="o">)),</span>
+ <span class="k">new</span> <span class="n">SpoutWrapper</span><span class="o">&lt;</span><span class="n">String</span><span class="o">&gt;(</span><span class="k">new</span> <span class="n">FileSpout</span><span class="o">(</span><span class="n">localFilePath</span><span class="o">)),</span>
<span class="c1">// specify output type manually</span>
<span class="n">TypeExtractor</span><span class="o">.</span><span class="na">getForObject</span><span class="o">(</span><span class="k">new</span> <span class="n">Tuple1</span><span class="o">&lt;</span><span class="n">String</span><span class="o">&gt;(</span><span class="s">&quot;&quot;</span><span class="o">)));</span>
<span class="c1">// FileSpout cannot be parallelized</span>
<span class="n">DataStream</span><span class="o">&lt;</span><span class="n">Tuple1</span><span class="o">&lt;</span><span class="n">String</span><span class="o">&gt;&gt;</span> <span class="n">text</span> <span class="o">=</span> <span class="n">source</span><span class="o">.</span><span class="na">setParallelism</span><span class="o">(</span><span class="mi">1</span><span class="o">);</span>
<span class="c1">// further processing with Flink</span>
-<span class="n">DataStream</span><span class="o">&lt;</span><span class="n">Tuple2</span><span class="o">&lt;</span><span class="n">String</span><span class="o">,</span><span class="n">Integer</span><span class="o">&gt;</span> <span class="n">tokens</span> <span class="o">=</span> <span class="n">text</span><span class="o">.</span><span class="na">flatMap</span><span class="o">(</span><span class="k">new</span> <span class="nf">Tokenizer</span><span class="o">()).</span><span class="na">keyBy</span><span class="o">(</span><span class="mi">0</
span><span class="o">);</span>
+<span class="n">DataStream</span><span class="o">&lt;</span><span class="n">Tuple2</span><span class="o">&lt;</span><span class="n">String</span><span class="o">,</span><span class="n">Integer</span><span class="o">&gt;</span> <span class="n">tokens</span> <span class="o">=</span> <span class="n">text</span><span class="o">.</span><span class="na">flatMap</span><span class="o">(</span><span class="k">new</span> <span class="n">Tokenizer</span><span class="o">()).</span><span class="na">keyBy</span><span class="o">(</span><span class="mi">0</s
pan><span class="o">);</span>
<span class="c1">// use Bolt for counting</span>
<span class="n">DataStream</span><span class="o">&lt;</span><span class="n">Tuple2</span><span class="o">&lt;</span><span class="n">String</span><span class="o">,</span><span class="n">Integer</span><span class="o">&gt;</span> <span class="n">counts</span> <span class="o">=</span>
@@ -769,7 +769,7 @@ As Storm is type agnostic, it is required to specify the output type of embedded
<span class="c1">// specify output type manually</span>
<span class="n">TypeExtractor</span><span class="o">.</span><span class="na">getForObject</span><span class="o">(</span><span class="k">new</span> <span class="n">Tuple2</span><span class="o">&lt;</span><span class="n">String</span><span class="o">,</span><span class="n">Integer</span><span class="o">&gt;(</span><span class="s">&quot;&quot;</span><span class="o">,</span><span class="mi">0</span><span class="o">))</span>
<span class="c1">// Flink provided wrapper including original Bolt</span>
- <span class="k">new</span> <span class="n">BoltWrapper</span><span class="o">&lt;</span><span class="n">String</span><span class="o">,</span><span class="n">Tuple2</span><span class="o">&lt;</span><span class="n">String</span><span class="o">,</span><span class="n">Integer</span><span class="o">&gt;&gt;(</span><span class="k">new</span> <span class="nf">BoltCounter</span><span class="o">()));</span>
+ <span class="k">new</span> <span class="n">BoltWrapper</span><span class="o">&lt;</span><span class="n">String</span><span class="o">,</span><span class="n">Tuple2</span><span class="o">&lt;</span><span class="n">String</span><span class="o">,</span><span class="n">Integer</span><span class="o">&gt;&gt;(</span><span class="k">new</span> <span class="n">BoltCounter</span><span class="o">()));</span>
<span class="c1">// write result to file via Flink sink</span>
<span class="n">counts</span><span class="o">.</span><span class="na">writeAsText</span><span class="o">(</span><span class="n">outputPath</span><span class="o">);</span>
@@ -793,7 +793,7 @@ We are also investigating the integration of Storm’s higher-level programming
This enables you to even embed third-party Spouts and Bolts where the source code is not available.
While you can embed Spouts/Bolts in a Flink program and mix-and-match them with Flink operators, running whole topologies is the easiest way to get started and can be achieved with almost no code changes.</p>
-<p>If you want to try out Flink’s Storm compatibility package checkout our <a href="https://ci.apache.org/projects/flink/flink-docs-master/apis/storm_compatibility.html">Documentation</a>.</p>
+<p>If you want to try out Flink’s Storm compatibility package checkout our <a href="https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/storm_compatibility.html">Documentation</a>.</p>
<hr />
@@ -1366,7 +1366,7 @@ Either <code>0 + absolutePointer</code> or <code>objectRefAddr
<h2 id="appendix-detailed-micro-benchmarks">Appendix: Detailed Micro Benchmarks</h2>
-<p>These microbenchmarks test the performance of the different memory segment implementations on various operation. The code is available <a href="https://github.com/apache/flink/blob/master/flink-core/src/test/java/org/apache/flink/core/memory/benchmarks/MemorySegmentSpeedBenchmark.java">as part of the Flink project</a></p>
+<p>These microbenchmarks test the performance of the different memory segment implementations on various operation.</p>
<p>Each experiments tests the different implementations multiple times in different orders, to balance the advantage/disadvantage of the JIT compiler specializing towards certain code paths. All experiments were run 5x, discarding the fastest and slowest run, and then averaged. This compensated for delay before the JIT kicks in.</p>
@@ -2089,7 +2089,7 @@ Either <code>0 + absolutePointer</code> or <code>objectRefAddr
<item>
<title>Announcing Flink Forward 2015</title>
-<description><p><a href="http://flink-forward.org/">Flink Forward 2015</a> is the first
+<description><p><a href="http://2015.flink-forward.org/">Flink Forward 2015</a> is the first
conference with Flink at its center that aims to bring together the
Apache Flink community in a single place. The organizers are starting
this conference in October 12 and 13 from Berlin, the place where
@@ -2099,7 +2099,7 @@ Apache Flink started.</p>
<img src="/img/blog/flink-forward-banner.png" style="width:80%;margin:15px" />
</center>
-<p>The <a href="http://flink-forward.org/?post_type=day">conference program</a> has
+<p>The <a href="http://2015.flink-forward.org/?post_type=day">conference program</a> has
been announced by the organizers and a program committee consisting of
Flink PMC members. The agenda contains talks from industry and
academia as well as a dedicated session on hands-on Flink training.</p>
@@ -2108,7 +2108,7 @@ academia as well as a dedicated session on hands-on Flink training.</p>
<ul>
<li>
- <p>A keynote by <a href="http://flink-forward.org/?speaker=william-vambenepe">William
+ <p>A keynote by <a href="http://2015.flink-forward.org/?speaker=william-vambenepe">William
Vambenepe</a>,
lead of the product management team responsible for Big Data
services on Google Cloud Platform (BigQuery, Dataflow, etc…) on
@@ -2130,9 +2130,8 @@ fault tolerance, the internal runtime architecture, and others.</p>
</li>
</ul>
-<p>Check out the <a href="http://flink-forward.org/?post_type=day">schedule</a> and
-<a href="http://flink-forward.org/?page_id=96">register</a> for the
-conference.</p>
+<p>Check out the <a href="http://2015.flink-forward.org/?post_type=day">schedule</a> and
+register for the conference.</p>
</description>
<pubDate>Thu, 03 Sep 2015 10:00:00 +0200</pubDate>
@@ -2276,7 +2275,7 @@ of vertices, edges and the node degrees. </p>
the ones provided by the batch processing API. These transformations can be applied one after the
other, yielding a new Graph after each step, in a fashion similar to operators on DataSets: </p>
-<div class="highlight"><pre><code class="language-java"><span class="n">inputGraph</span><span class="o">.</span><span class="na">getUndirected</span><span class="o">().</span><span class="na">mapEdges</span><span class="o">(</span><span class="k">new</span> <span class="nf">CustomEdgeMapper</span><span class="o">());</span></code></pre></div>
+<div class="highlight"><pre><code class="language-java"><span class="n">inputGraph</span><span class="o">.</span><span class="na">getUndirected</span><span class="o">().</span><span class="na">mapEdges</span><span class="o">(</span><span class="k">new</span> <span class="n">CustomEdgeMapper</span><span class="o">());</span></code></pre></div>
<p>Transformations can be applied on:</p>
@@ -2312,7 +2311,7 @@ one or more values per vertex, the more general <code>groupReduceOnEdges(
<p>Assume you would want to compute the sum of the values of all incoming neighbors for each vertex.
We will call the <code>reduceOnNeighbors()</code> aggregation method since the sum is an associative and commutative operation and the neighbors’ values are needed:</p>
-<div class="highlight"><pre><code class="language-java"><span class="n">graph</span><span class="o">.</span><span class="na">reduceOnNeighbors</span><span class="o">(</span><span class="k">new</span> <span class="nf">SumValues</span><span class="o">(),</span> <span class="n">EdgeDirection</span><span class="o">.</span><span class="na">IN</span><span class="o">);</span></code></pre></div>
+<div class="highlight"><pre><code class="language-java"><span class="n">graph</span><span class="o">.</span><span class="na">reduceOnNeighbors</span><span class="o">(</span><span class="k">new</span> <span class="n">SumValues</span><span class="o">(),</span> <span class="n">EdgeDirection</span><span class="o">.</span><span class="na">IN</span><span class="o">);</span></code></pre></div>
<p>The vertex with id 1 is the only node that has no incoming edges. The result is therefore:</p>
@@ -2498,7 +2497,7 @@ playlist, we use a coGroup function to filter out the mismatches.</p>
<span class="c1">// read the mismatches dataset and extract the songIDs</span>
<span class="n">DataSet</span><span class="o">&lt;</span><span class="n">Tuple3</span><span class="o">&lt;</span><span class="n">String</span><span class="o">,</span> <span class="n">String</span><span class="o">,</span> <span class="n">Integer</span><span class="o">&gt;&gt;</span> <span class="n">validTriplets</span> <span class="o">=</span> <span class="n">triplets</span>
<span class="o">.</span><span class="na">coGroup</span><span class="o">(</span><span class="n">mismatches</span><span class="o">).</span><span class="na">where</span><span class="o">(</span><span class="mi">1</span><span class="o">).</span><span class="na">equalTo</span><span class="o">(</span><span class="mi">0</span><span class="o">)</span>
- <span class="o">.</span><span class="na">with</span><span class="o">(</span><span class="k">new</span> <span class="nf">CoGroupFunction</span><span class="o">()</span> <span class="o">{</span>
+ <span class="o">.</span><span class="na">with</span><span class="o">(</span><span class="k">new</span> <span class="n">CoGroupFunction</span><span class="o">()</span> <span class="o">{</span>
<span class="kt">void</span> <span class="nf">coGroup</span><span class="o">(</span><span class="n">Iterable</span> <span class="n">triplets</span><span class="o">,</span> <span class="n">Iterable</span> <span class="n">invalidSongs</span><span class="o">,</span> <span class="n">Collector</span> <span class="n">out</span><span class="o">)</span> <span class="o">{</span>
<span class="k">if</span> <span class="o">(!</span><span class="n">invalidSongs</span><span class="o">.</span><span class="na">iterator</span><span class="o">().</span><span class="na">hasNext</span><span class="o">())</span> <span class="o">{</span>
<span class="k">for</span> <span class="o">(</span><span class="n">Tuple3</span> <span class="n">triplet</span> <span class="o">:</span> <span class="n">triplets</span><span class="o">)</span> <span class="o">{</span> <span class="c1">// valid triplet</span>
@@ -2536,7 +2535,7 @@ basically iterate through the edge value and collect the target (song) of the ma
<div class="highlight"><pre><code class="language-java"><span class="c1">//get the top track (most listened to) for each user</span>
<span class="n">DataSet</span><span class="o">&lt;</span><span class="n">Tuple2</span><span class="o">&gt;</span> <span class="n">usersWithTopTrack</span> <span class="o">=</span> <span class="n">userSongGraph</span>
- <span class="o">.</span><span class="na">groupReduceOnEdges</span><span class="o">(</span><span class="k">new</span> <span class="nf">GetTopSongPerUser</span><span class="o">(),</span> <span class="n">EdgeDirection</span><span class="o">.</span><span class="na">OUT</span><span class="o">);</span>
+ <span class="o">.</span><span class="na">groupReduceOnEdges</span><span class="o">(</span><span class="k">new</span> <span class="n">GetTopSongPerUser</span><span class="o">(),</span> <span class="n">EdgeDirection</span><span class="o">.</span><span class="na">OUT</span><span class="o">);</span>
<span class="kd">class</span> <span class="nc">GetTopSongPerUser</span> <span class="kd">implements</span> <span class="n">EdgesFunctionWithVertexValue</span> <span class="o">{</span>
<span class="kt">void</span> <span class="nf">iterateEdges</span><span class="o">(</span><span class="n">Vertex</span> <span class="n">vertex</span><span class="o">,</span> <span class="n">Iterable</span><span class="o">&lt;</span><span class="n">Edge</span><span class="o">&gt;</span> <span class="n">edges</span><span class="o">)</span> <span class="o">{</span>
@@ -2549,7 +2548,7 @@ basically iterate through the edge value and collect the target (song) of the ma
<span class="n">topSong</span> <span class="o">=</span> <span class="n">edge</span><span class="o">.</span><span class="na">getTarget</span><span class="o">();</span>
<span class="o">}</span>
<span class="o">}</span>
- <span class="k">return</span> <span class="k">new</span> <span class="nf">Tuple2</span><span class="o">(</span><span class="n">vertex</span><span class="o">.</span><span class="na">getId</span><span class="o">(),</span> <span class="n">topSong</span><span class="o">);</span>
+ <span class="k">return</span> <span class="k">new</span> <span class="n">Tuple2</span><span class="o">(</span><span class="n">vertex</span><span class="o">.</span><span class="na">getId</span><span class="o">(),</span> <span class="n">topSong</span><span class="o">);</span>
<span class="o">}</span>
<span class="o">}</span></code></pre></div>
@@ -2585,14 +2584,14 @@ straightforward as a call to the <code>Graph.fromDataSet()</code> me
<span class="o">}</span>
<span class="o">})</span>
<span class="o">.</span><span class="na">groupBy</span><span class="o">(</span><span class="mi">1</span><span class="o">)</span>
- <span class="o">.</span><span class="na">reduceGroup</span><span class="o">(</span><span class="k">new</span> <span class="nf">GroupReduceFunction</span><span class="o">()</span> <span class="o">{</span>
+ <span class="o">.</span><span class="na">reduceGroup</span><span class="o">(</span><span class="k">new</span> <span class="n">GroupReduceFunction</span><span class="o">()</span> <span class="o">{</span>
<span class="kt">void</span> <span class="nf">reduce</span><span class="o">(</span><span class="n">Iterable</span><span class="o">&lt;</span><span class="n">Edge</span><span class="o">&gt;</span> <span class="n">edges</span><span class="o">,</span> <span class="n">Collector</span><span class="o">&lt;</span><span class="n">Edge</span><span class="o">&gt;</span> <span class="n">out</span><span class="o">)</span> <span class="o">{</span>
- <span class="n">List</span> <span class="n">users</span> <span class="o">=</span> <span class="k">new</span> <span class="nf">ArrayList</span><span class="o">();</span>
+ <span class="n">List</span> <span class="n">users</span> <span class="o">=</span> <span class="k">new</span> <span class="n">ArrayList</span><span class="o">();</span>
<span class="k">for</span> <span class="o">(</span><span class="n">Edge</span> <span class="n">edge</span> <span class="o">:</span> <span class="n">edges</span><span class="o">)</span> <span class="o">{</span>
<span class="n">users</span><span class="o">.</span><span class="na">add</span><span class="o">(</span><span class="n">edge</span><span class="o">.</span><span class="na">getSource</span><span class="o">());</span>
<span class="k">for</span> <span class="o">(</span><span class="kt">int</span> <span class="n">i</span> <span class="o">=</span> <span class="mi">0</span><span class="o">;</span> <span class="n">i</span> <span class="o">&lt;</span> <span class="n">users</span><span class="o">.</span><span class="na">size</span><span class="o">()</span> <span class="o">-</span> <span class="mi">1</span><span class="o">;</span> <span class="n">i</span><span class="o">++)</span> <span class="o">{</span>
<span class="k">for</span> <span class="o">(</span><span class="kt">int</span> <span class="n">j</span> <span class="o">=</span> <span class="n">i</span><span class="o">+</span><span class="mi">1</span><span class="o">;</span> <span class="n">j</span> <span class="o">&lt;</span> <span class="n">users</span><span class="o">.</span><span class="na">size</span><span class="o">()</span> <span class="o">-</span> <span class="mi">1</span><span class="o">;</span> <span class="n">j</span><span class="o">++)</span> <span clas
s="o">{</span>
- <span class="n">out</span><span class="o">.</span><span class="na">collect</span><span class="o">(</span><span class="k">new</span> <span class="nf">Edge</span><span class="o">(</span><span class="n">users</span><span class="o">.</span><span class="na">get</span><span class="o">(</span><span class="n">i</span><span class="o">),</span> <span class="n">users</span><span class="o">.</span><span class="na">get</span><span class="o">(</span><span class="n">j</span><span class="o">)));</span>
+ <span class="n">out</span><span class="o">.</span><span class="na">collect</span><span class="o">(</span><span class="k">new</span> <span class="n">Edge</span><span class="o">(</span><span class="n">users</span><span class="o">.</span><span class="na">get</span><span class="o">(</span><span class="n">i</span><span class="o">),</span> <span class="n">users</span><span class="o">.</span><span class="na">get</span><span class="o">(</span><span class="n">j</span><span class="o">)));</span>
<span class="o">}</span>
<span class="o">}</span>
<span class="o">}</span>
@@ -2623,12 +2622,12 @@ among their neighbors. </p>
<span class="c1">// update the vertex values and run the label propagation algorithm</span>
<span class="n">DataSet</span><span class="o">&lt;</span><span class="n">Vertex</span><span class="o">&gt;</span> <span class="n">verticesWithCommunity</span> <span class="o">=</span> <span class="n">similarUsersGraph</span>
- <span class="o">.</span><span class="na">joinWithVertices</span><span class="o">(</span><span class="n">idsWithlLabels</span><span class="o">,</span> <span class="k">new</span> <span class="nf">MapFunction</span><span class="o">()</span> <span class="o">{</span>
+ <span class="o">.</span><span class="na">joinWithVertices</span><span class="o">(</span><span class="n">idsWithlLabels</span><span class="o">,</span> <span class="k">new</span> <span class="n">MapFunction</span><span class="o">()</span> <span class="o">{</span>
<span class="kd">public</span> <span class="n">Long</span> <span class="nf">map</span><span class="o">(</span><span class="n">Tuple2</span> <span class="n">idWithLabel</span><span class="o">)</span> <span class="o">{</span>
<span class="k">return</span> <span class="n">idWithLabel</span><span class="o">.</span><span class="na">f1</span><span class="o">;</span>
<span class="o">}</span>
<span class="o">})</span>
- <span class="o">.</span><span class="na">run</span><span class="o">(</span><span class="k">new</span> <span class="nf">LabelPropagation</span><span class="o">(</span><span class="n">numIterations</span><span class="o">))</span>
+ <span class="o">.</span><span class="na">run</span><span class="o">(</span><span class="k">new</span> <span class="n">LabelPropagation</span><span class="o">(</span><span class="n">numIterations</span><span class="o">))</span>
<span class="o">.</span><span class="na">getVertices</span><span class="o">();</span></code></pre></div>
<p><a href="#top">Back to top</a></p>
@@ -2901,6 +2900,16 @@ tools, graph database systems and sampling techniques.</p>
<title>April 2015 in the Flink community</title>
<description><p>April was an packed month for Apache Flink. </p>
+<h3 id="flink-runner-for-google-cloud-dataflow">Flink runner for Google Cloud Dataflow</h3>
+
+<p>A Flink runner for Google Cloud Dataflow was announced. See the blog
+posts by <a href="http://data-artisans.com/announcing-google-cloud-dataflow-on-flink-and-easy-flink-deployment-on-google-cloud/">data Artisans</a> and
+the <a href="http://googlecloudplatform.blogspot.de/2015/03/announcing-Google-Cloud-Dataflow-runner-for-Apache-Flink.html">Google Cloud Platform Blog</a>.
+Google Cloud Dataflow programs can be written using and open-source
+SDK and run in multiple backends, either as a managed service inside
+Google’s infrastructure, or leveraging open source runners,
+including Apache Flink.</p>
+
<h2 id="flink-090-milestone1-release">Flink 0.9.0-milestone1 release</h2>
<p>The highlight of April was of course the availability of <a href="/news/2015/04/13/release-0.9.0-milestone1.html">Flink 0.9-milestone1</a>. This was a release packed with new features, including, a Python DataSet API, the new SQL-like Table API, FlinkML, a machine learning library on Flink, Gelly, FLink’s Graph API, as well as a mode to run Flink on YARN leveraging Tez. In case you missed it, check out the <a href="/news/2015/04/13/release-0.9.0-milestone1.html">release announcement blog post</a> for details</p>
@@ -2919,7 +2928,7 @@ tools, graph database systems and sampling techniques.</p>
<h2 id="upcoming-events">Upcoming events</h2>
-<p>Stay tuned for a wealth of upcoming events! Two Flink talsk will be presented at <a href="http://berlinbuzzwords.de/15/sessions">Berlin Buzzwords</a>, Flink will be presented at the <a href="http://2015.hadoopsummit.org/san-jose/">Hadoop Summit in San Jose</a>. A <a href="http://www.meetup.com/Apache-Flink-Meetup/events/220557545/">training workshop on Apache Flink</a> is being organized in Berlin. Finally, <a href="http://flink-forward.org">Flink Forward</a>, the first conference to bring together the whole Flink community is taking place in Berlin in October 2015.</p>
+<p>Stay tuned for a wealth of upcoming events! Two Flink talsk will be presented at <a href="http://berlinbuzzwords.de/15/sessions">Berlin Buzzwords</a>, Flink will be presented at the <a href="http://2015.hadoopsummit.org/san-jose/">Hadoop Summit in San Jose</a>. A <a href="http://www.meetup.com/Apache-Flink-Meetup/events/220557545/">training workshop on Apache Flink</a> is being organized in Berlin. Finally, <a href="http://2015.flink-forward.org/">Flink Forward</a>, the first conference to bring together the whole Flink community is taking place in Berlin in October 2015.</p>
</description>
<pubDate>Thu, 14 May 2015 12:00:00 +0200</pubDate>
<link>http://flink.apache.org/news/2015/05/14/Community-update-April.html</link>
@@ -3157,7 +3166,7 @@ for Flink programs. Tables are available for both static and streaming
data sources (DataSet and DataStream APIs).</p>
<p>Check out the Table guide for Java and Scala
-<a href="http://ci.apache.org/projects/flink/flink-docs-master/libs/table.html">here</a>.</p>
+<a href="https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/libs/table.html">here</a>.</p>
<h3 id="gelly-graph-processing-api">Gelly Graph Processing API</h3>
@@ -3171,14 +3180,14 @@ vertex-centric graph processing, as well as a library of common graph
algorithms, including PageRank, SSSP, label propagation, and community
detection.</p>
-<p>Gelly internally builds on top of Flink’s <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/iterations.html">delta
+<p>Gelly internally builds on top of Flink’s <a href="https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/iterations.html">delta
iterations</a>. Iterative
graph algorithms are executed leveraging mutable state, achieving
similar performance with specialized graph processing systems.</p>
<p>Gelly will eventually subsume Spargel, Flink’s Pregel-like API. Check
out the Gelly guide
-<a href="http://ci.apache.org/projects/flink/flink-docs-master/libs/gelly_guide.html">here</a>.</p>
+<a href="https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/libs/gelly.html">here</a>.</p>
<h3 id="flink-machine-learning-library">Flink Machine Learning Library</h3>
@@ -3373,15 +3382,9 @@ Improve usability of command line interface</p>
<title>March 2015 in the Flink community</title>
<description><p>March has been a busy month in the Flink community.</p>
-<h3 id="flink-runner-for-google-cloud-dataflow">Flink runner for Google Cloud Dataflow</h3>
+<h3 id="scaling-als">Scaling ALS</h3>
-<p>A Flink runner for Google Cloud Dataflow was announced. See the blog
-posts by <a href="http://data-artisans.com/dataflow.html">data Artisans</a> and
-the <a href="http://googlecloudplatform.blogspot.de/2015/03/announcing-Google-Cloud-Dataflow-runner-for-Apache-Flink.html">Google Cloud Platform Blog</a>.
-Google Cloud Dataflow programs can be written using and open-source
-SDK and run in multiple backends, either as a managed service inside
-Google’s infrastructure, or leveraging open source runners,
-including Apache Flink.</p>
+<p>Flink committers employed at <a href="http://data-artisans.com">data Artisans</a> published a <a href="http://data-artisans.com/how-to-factorize-a-700-gb-matrix-with-apache-flink/">blog post</a> on how they scaled matrix factorization with Flink and Google Compute Engine to matrices with 28 billion elements.</p>
<h3 id="learn-about-the-internals-of-flink">Learn about the internals of Flink</h3>
@@ -3413,14 +3416,14 @@ future of Flink. The talk is available on
<h3 id="table-api-in-scala-and-java">Table API in Scala and Java</h3>
-<p>The new <a href="https://github.com/apache/flink/tree/master/flink-staging/flink-table">Table
+<p>The new <a href="https://github.com/apache/flink/tree/master/flink-libraries/flink-table">Table
API</a>
in Flink is now available in both Java and Scala. Check out the
-examples <a href="https://github.com/apache/flink/blob/master/flink-staging/flink-table/src/main/java/org/apache/flink/examples/java/JavaTableExample.java">here (Java)</a> and <a href="https://github.com/apache/flink/tree/master/flink-staging/flink-table/src/main/scala/org/apache/flink/examples/scala">here (Scala)</a>.</p>
+examples <a href="https://github.com/apache/flink/blob/master/flink-libraries/flink-table/src/main/java/org/apache/flink/examples/java/JavaTableExample.java">here (Java)</a> and <a href="https://github.com/apache/flink/tree/master/flink-libraries/flink-table/src/main/scala/org/apache/flink/examples/scala">here (Scala)</a>.</p>
<h3 id="additions-to-the-machine-learning-library">Additions to the Machine Learning library</h3>
-<p>Flink’s <a href="https://github.com/apache/flink/tree/master/flink-staging/flink-ml">Machine Learning
+<p>Flink’s <a href="https://github.com/apache/flink/tree/master/flink-libraries/flink-ml">Machine Learning
library</a>
is seeing quite a bit of traction. Recent additions include the <a href="http://arxiv.org/abs/1409.1458">CoCoA
algorithm</a> for distributed
@@ -3436,11 +3439,6 @@ checkpoints at failure recovery. This functionality is currently
limited in that it does not yet handle large state and iterative
programs.</p>
-<h3 id="flink-on-tez">Flink on Tez</h3>
-
-<p>A new execution environment enables non-iterative Flink jobs to use
-Tez as an execution backend instead of Flink’s own network stack. Learn more
-<a href="http://ci.apache.org/projects/flink/flink-docs-master/setup/flink_on_tez.html">here</a>.</p>
</description>
<pubDate>Tue, 07 Apr 2015 12:00:00 +0200</pubDate>
<link>http://flink.apache.org/news/2015/04/07/march-in-flink.html</link>
@@ -3569,7 +3567,7 @@ Tez as an execution backend instead of Flink’s own network stack. Learn more
<p>Ship and local strategies do not depend on each other and can be independently chosen. Therefore, Flink can execute a join of two data sets R and S in nine different ways by combining any of the three ship strategies (RR, BF with R being broadcasted, BF with S being broadcasted) with any of the three local strategies (SM, HH with R being build-side, HH with S being build-side). Each of these strategy combinations results in different execution performance depending on the data sizes and the available amount of working memory. In case of a small data set R and a much larger data set S, broadcasting R and using it as build-side input of a Hybrid-Hash-Join is usually a good choice because the much larger data set S is not shipped and not materialized (given that the hash table completely fits into memory). If both data sets are rather large or the join is performed on many parallel instances, repartitioning both inputs is a robust choice.</p>
-<p>Flink features a cost-based optimizer which automatically chooses the execution strategies for all operators including joins. Without going into the details of cost-based optimization, this is done by computing cost estimates for execution plans with different strategies and picking the plan with the least estimated costs. Thereby, the optimizer estimates the amount of data which is shipped over the the network and written to disk. If no reliable size estimates for the input data can be obtained, the optimizer falls back to robust default choices. A key feature of the optimizer is to reason about existing data properties. For example, if the data of one input is already partitioned in a suitable way, the generated candidate plans will not repartition this input. Hence, the choice of a RR ship strategy becomes more likely. The same applies for previously sorted data and the Sort-Merge-Join strategy. Flink programs can help the optimizer to reason about existing data properti
es by providing semantic information about user-defined functions <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/programming_guide.html#semantic-annotations">[4]</a>. While the optimizer is a killer feature of Flink, it can happen that a user knows better than the optimizer how to execute a specific join. Similar to relational database systems, Flink offers optimizer hints to tell the optimizer which join strategies to pick <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/dataset_transformations.html#join-algorithm-hints">[5]</a>.</p>
+<p>Flink features a cost-based optimizer which automatically chooses the execution strategies for all operators including joins. Without going into the details of cost-based optimization, this is done by computing cost estimates for execution plans with different strategies and picking the plan with the least estimated costs. Thereby, the optimizer estimates the amount of data which is shipped over the the network and written to disk. If no reliable size estimates for the input data can be obtained, the optimizer falls back to robust default choices. A key feature of the optimizer is to reason about existing data properties. For example, if the data of one input is already partitioned in a suitable way, the generated candidate plans will not repartition this input. Hence, the choice of a RR ship strategy becomes more likely. The same applies for previously sorted data and the Sort-Merge-Join strategy. Flink programs can help the optimizer to reason about existing data properti
es by providing semantic information about user-defined functions <a href="https://ci.apache.org/projects/flink/flink-docs-release-1.0/apis/batch/index.html#semantic-annotations">[4]</a>. While the optimizer is a killer feature of Flink, it can happen that a user knows better than the optimizer how to execute a specific join. Similar to relational database systems, Flink offers optimizer hints to tell the optimizer which join strategies to pick <a href="https://ci.apache.org/projects/flink/flink-docs-release-1.0/apis/batch/dataset_transformations.html#join-algorithm-hints">[5]</a>.</p>
<h3 id="how-is-flinks-join-performance">How is Flink’s join performance?</h3>
@@ -3626,8 +3624,8 @@ Tez as an execution backend instead of Flink’s own network stack. Learn more
<p>[1] <a href="">“MapReduce: Simplified data processing on large clusters”</a>, Dean, Ghemawat, 2004 <br />
[2] <a href="http://ci.apache.org/projects/flink/flink-docs-release-0.8/dataset_transformations.html">Flink 0.8.1 documentation: Data Transformations</a> <br />
[3] <a href="http://ci.apache.org/projects/flink/flink-docs-release-0.8/dataset_transformations.html#join">Flink 0.8.1 documentation: Joins</a> <br />
-[4] <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/programming_guide.html#semantic-annotations">Flink 0.9-SNAPSHOT documentation: Semantic annotations</a> <br />
-[5] <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/dataset_transformations.html#join-algorithm-hints">Flink 0.9-SNAPSHOT documentation: Optimizer join hints</a> <br /></p>
+[4] <a href="https://ci.apache.org/projects/flink/flink-docs-release-1.0/apis/batch/index.html#semantic-annotations">Flink 1.0 documentation: Semantic annotations</a> <br />
+[5] <a href="https://ci.apache.org/projects/flink/flink-docs-release-1.0/apis/batch/dataset_transformations.html#join-algorithm-hints">Flink 1.0 documentation: Optimizer join hints</a> <br /></p>
</description>
<pubDate>Fri, 13 Mar 2015 11:00:00 +0100</pubDate>
<link>http://flink.apache.org/news/2015/03/13/peeking-into-Apache-Flinks-Engine-Room.html</link>
@@ -3706,12 +3704,12 @@ graph:</p>
<span class="n">maxIterations</span><span class="o">)).</span><span class="na">getVertices</span><span class="o">();</span></code></pre></div>
<p>See more Gelly examples
-<a href="https://github.com/apache/flink/tree/master/flink-staging/flink-gelly/src/main/java/org/apache/flink/graph/example">here</a>.</p>
+<a href="https://github.com/apache/flink/tree/master/flink-libraries/flink-gelly-examples">here</a>.</p>
<h3 id="flink-expressions">Flink Expressions</h3>
<p>The newly merged
-<a href="https://github.com/apache/flink/tree/master/flink-staging/flink-table">flink-table</a>
+<a href="https://github.com/apache/flink/tree/master/flink-libraries/flink-table">flink-table</a>
module is the first step in Flink’s roadmap towards logical queries
and SQL support. Here’s a preview on how you can read two CSV file,
assign a logical schema to, and apply transformations like filters and
@@ -3732,7 +3730,7 @@ joins using logical attributes rather than physical data types.</p>
<h3 id="access-to-hcatalog-tables">Access to HCatalog tables</h3>
-<p>With the <a href="https://github.com/apache/flink/tree/master/flink-staging/flink-hcatalog">flink-hcatalog
+<p>With the <a href="https://github.com/apache/flink/tree/master/flink-batch-connectors/flink-hcatalog">flink-hcatalog
module</a>,
you can now conveniently access HCatalog/Hive tables. The module
supports projection (selection and order of fields) and partition
@@ -3761,7 +3759,7 @@ and offers a new API including definition of flexible windows.</p>
<p>In this post, we go through an example that uses the Flink Streaming
API to compute statistics on stock market data that arrive
continuously and combine the stock market data with Twitter streams.
-See the <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html">Streaming Programming
+See the <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/index.html">Streaming Programming
Guide</a> for a
detailed presentation of the Streaming API.</p>
@@ -3838,16 +3836,16 @@ found <a href="https://github.com/mbalassi/flink/blob/stockprices/flink-
<span class="nd">@Override</span>
<span class="kd">public</span> <span class="n">StockPrice</span> <span class="nf">map</span><span class="o">(</span><span class="n">String</span> <span class="n">value</span><span class="o">)</span> <span class="kd">throws</span> <span class="n">Exception</span> <span class="o">{</span>
<span class="n">tokens</span> <span class="o">=</span> <span class="n">value</span><span class="o">.</span><span class="na">split</span><span class="o">(</span><span class="s">&quot;,&quot;</span><span class="o">);</span>
- <span class="k">return</span> <span class="k">new</span> <span class="nf">StockPrice</span><span class="o">(</span><span class="n">tokens</span><span class="o">[</span><span class="mi">0</span><span class="o">],</span>
+ <span class="k">return</span> <span class="k">new</span> <span class="n">StockPrice</span><span class="o">(</span><span class="n">tokens</span><span class="o">[</span><span class="mi">0</span><span class="o">],</span>
<span class="n">Double</span><span class="o">.</span><span class="na">parseDouble</span><span class="o">(</span><span class="n">tokens</span><span class="o">[</span><span class="mi">1</span><span class="o">]));</span>
<span class="o">}</span>
<span class="o">});</span>
<span class="c1">//Generate other stock streams</span>
- <span class="n">DataStream</span><span class="o">&lt;</span><span class="n">StockPrice</span><span class="o">&gt;</span> <span class="n">SPX_stream</span> <span class="o">=</span> <span class="n">env</span><span class="o">.</span><span class="na">addSource</span><span class="o">(</span><span class="k">new</span> <span class="nf">StockSource</span><span class="o">(</span><span class="s">&quot;SPX&quot;</span><span class="o">,</span> <span class="mi">10</span><span class="o">));</span>
- <span class="n">DataStream</span><span class="o">&lt;</span><span class="n">StockPrice</span><span class="o">&gt;</span> <span class="n">FTSE_stream</span> <span class="o">=</span> <span class="n">env</span><span class="o">.</span><span class="na">addSource</span><span class="o">(</span><span class="k">new</span> <span class="nf">StockSource</span><span class="o">(</span><span class="s">&quot;FTSE&quot;</span><span class="o">,</span> <span class="mi">20</span><span class="o">));</span>
- <span class="n">DataStream</span><span class="o">&lt;</span><span class="n">StockPrice</span><span class="o">&gt;</span> <span class="n">DJI_stream</span> <span class="o">=</span> <span class="n">env</span><span class="o">.</span><span class="na">addSource</span><span class="o">(</span><span class="k">new</span> <span class="nf">StockSource</span><span class="o">(</span><span class="s">&quot;DJI&quot;</span><span class="o">,</span> <span class="mi">30</span><span class="o">));</span>
- <span class="n">DataStream</span><span class="o">&lt;</span><span class="n">StockPrice</span><span class="o">&gt;</span> <span class="n">BUX_stream</span> <span class="o">=</span> <span class="n">env</span><span class="o">.</span><span class="na">addSource</span><span class="o">(</span><span class="k">new</span> <span class="nf">StockSource</span><span class="o">(</span><span class="s">&quot;BUX&quot;</span><span class="o">,</span> <span class="mi">40</span><span class="o">));</span>
+ <span class="n">DataStream</span><span class="o">&lt;</span><span class="n">StockPrice</span><span class="o">&gt;</span> <span class="n">SPX_stream</span> <span class="o">=</span> <span class="n">env</span><span class="o">.</span><span class="na">addSource</span><span class="o">(</span><span class="k">new</span> <span class="n">StockSource</span><span class="o">(</span><span class="s">&quot;SPX&quot;</span><span class="o">,</span> <span class="mi">10</span><span class="o">));</span>
+ <span class="n">DataStream</span><span class="o">&lt;</span><span class="n">StockPrice</span><span class="o">&gt;</span> <span class="n">FTSE_stream</span> <span class="o">=</span> <span class="n">env</span><span class="o">.</span><span class="na">addSource</span><span class="o">(</span><span class="k">new</span> <span class="n">StockSource</span><span class="o">(</span><span class="s">&quot;FTSE&quot;</span><span class="o">,</span> <span class="mi">20</span><span class="o">));</span>
+ <span class="n">DataStream</span><span class="o">&lt;</span><span class="n">StockPrice</span><span class="o">&gt;</span> <span class="n">DJI_stream</span> <span class="o">=</span> <span class="n">env</span><span class="o">.</span><span class="na">addSource</span><span class="o">(</span><span class="k">new</span> <span class="n">StockSource</span><span class="o">(</span><span class="s">&quot;DJI&quot;</span><span class="o">,</span> <span class="mi">30</span><span class="o">));</span>
+ <span class="n">DataStream</span><span class="o">&lt;</span><span class="n">StockPrice</span><span class="o">&gt;</span> <span class="n">BUX_stream</span> <span class="o">=</span> <span class="n">env</span><span class="o">.</span><span class="na">addSource</span><span class="o">(</span><span class="k">new</span> <span class="n">StockSource</span><span class="o">(</span><span class="s">&quot;BUX&quot;</span><span class="o">,</span> <span class="mi">40</span><span class="o">));</span>
<span class="c1">//Merge all stock streams together</span>
<span class="n">DataStream</span><span class="o">&lt;</span><span class="n">StockPrice</span><span class="o">&gt;</span> <span class="n">stockStream</span> <span class="o">=</span> <span class="n">socketStockStream</span>
@@ -3861,10 +3859,10 @@ found <a href="https://github.com/mbalassi/flink/blob/stockprices/flink-
</div>
<p>See
-<a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html#sources">here</a>
+<a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/index.html#data-sources">here</a>
on how you can create streaming sources for Flink Streaming
programs. Flink, of course, has support for reading in streams from
-<a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html#stream-connectors">external
+<a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/connectors/index.html">external
sources</a>
such as Apache Kafka, Apache Flume, RabbitMQ, and others. For the sake
of this example, the data streams are simply generated using the
@@ -3928,11 +3926,11 @@ of this example, the data streams are simply generated using the
<span class="nd">@Override</span>
<span class="kd">public</span> <span class="kt">void</span> <span class="nf">invoke</span><span class="o">(</span><span class="n">Collector</span><span class="o">&lt;</span><span class="n">StockPrice</span><span class="o">&gt;</span> <span class="n">collector</span><span class="o">)</span> <span class="kd">throws</span> <span class="n">Exception</span> <span class="o">{</span>
<span class="n">price</span> <span class="o">=</span> <span class="n">DEFAULT_PRICE</span><span class="o">;</span>
- <span class="n">Random</span> <span class="n">random</span> <span class="o">=</span> <span class="k">new</span> <span class="nf">Random</span><span class="o">();</span>
+ <span class="n">Random</span> <span class="n">random</span> <span class="o">=</span> <span class="k">new</span> <span class="n">Random</span><span class="o">();</span>
<span class="k">while</span> <span class="o">(</span><span class="kc">true</span><span class="o">)</span> <span class="o">{</span>
<span class="n">price</span> <span class="o">=</span> <span class="n">price</span> <span class="o">+</span> <span class="n">random</span><span class="o">.</span><span class="na">nextGaussian</span><span class="o">()</span> <span class="o">*</span> <span class="n">sigma</span><span class="o">;</span>
- <span class="n">collector</span><span class="o">.</span><span class="na">collect</span><span class="o">(</span><span class="k">new</span> <span class="nf">StockPrice</span><span class="o">(</span><span class="n">symbol</span><span class="o">,</span> <span class="n">price</span><span class="o">));</span>
+ <span class="n">collector</span><span class="o">.</span><span class="na">collect</span><span class="o">(</span><span class="k">new</span> <span class="n">StockPrice</span><span class="o">(</span><span class="n">symbol</span><span class="o">,</span> <span class="n">price</span><span class="o">));</span>
<span class="n">Thread</span><span class="o">.</span><span class="na">sleep</span><span class="o">(</span><span class="n">random</span><span class="o">.</span><span class="na">nextInt</span><span class="o">(</span><span class="mi">200</span><span class="o">));</span>
<span class="o">}</span>
<span class="o">}</span>
@@ -3972,7 +3970,7 @@ INFO Custom Source(1/1) switched to DEPLOYING
<h2 id="window-aggregations">Window aggregations</h2>
<p>We first compute aggregations on time-based windows of the
-data. Flink provides <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html#window-operators">flexible windowing semantics</a> where windows can
+data. Flink provides <a href="http://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/windows.html">flexible windowing semantics</a> where windows can
also be defined based on count of records or any custom user defined
logic.</p>
@@ -4019,7 +4017,7 @@ performed on named fields of POJOs, making the code more readable.</p>
<span class="n">DataStream</span><span class="o">&lt;</span><span class="n">StockPrice</span><span class="o">&gt;</span> <span class="n">maxByStock</span> <span class="o">=</span> <span class="n">windowedStream</span><span class="o">.</span><span class="na">groupBy</span><span class="o">(</span><span class="s">&quot;symbol&quot;</span><span class="o">)</span>
<span class="o">.</span><span class="na">maxBy</span><span class="o">(</span><span class="s">&quot;price&quot;</span><span class="o">).</span><span class="na">flatten</span><span class="o">();</span>
<span class="n">DataStream</span><span class="o">&lt;</span><span class="n">StockPrice</span><span class="o">&gt;</span> <span class="n">rollingMean</span> <span class="o">=</span> <span class="n">windowedStream</span><span class="o">.</span><span class="na">groupBy</span><span class="o">(</span><span class="s">&quot;symbol&quot;</span><span class="o">)</span>
- <span class="o">.</span><span class="na">mapWindow</span><span class="o">(</span><span class="k">new</span> <span class="nf">WindowMean</span><span class="o">()).</span><span class="na">flatten</span><span class="o">();</span>
+ <span class="o">.</span><span class="na">mapWindow</span><span class="o">(</span><span class="k">new</span> <span class="n">WindowMean</span><span class="o">()).</span><span class="na">flatten</span><span class="o">();</span>
<span class="c1">//Compute the mean of a window</span>
<span class="kd">public</span> <span class="kd">final</span> <span class="kd">static</span> <span class="kd">class</span> <span class="nc">WindowMean</span> <span class="kd">implements</span>
@@ -4039,7 +4037,7 @@ performed on named fields of POJOs, making the code more readable.</p>
<span class="n">symbol</span> <span class="o">=</span> <span class="n">sp</span><span class="o">.</span><span class="na">symbol</span><span class="o">;</span>
<span class="n">count</span><span class="o">++;</span>
<span class="o">}</span>
- <span class="n">out</span><span class="o&q
<TRUNCATED>
[5/8] flink-web git commit: rebuild web page
Posted by mj...@apache.org.
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2012/10/15/icde2013.html
----------------------------------------------------------------------
diff --git a/content/news/2012/10/15/icde2013.html b/content/news/2012/10/15/icde2013.html
deleted file mode 100644
index 29adbef..0000000
--- a/content/news/2012/10/15/icde2013.html
+++ /dev/null
@@ -1,218 +0,0 @@
-<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
- <title>Apache Flink: Stratosphere Demo Accepted for ICDE 2013</title>
- <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
- <link rel="icon" href="/favicon.ico" type="image/x-icon">
-
- <!-- Bootstrap -->
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css">
- <link rel="stylesheet" href="/css/flink.css">
- <link rel="stylesheet" href="/css/syntax.css">
-
- <!-- Blog RSS feed -->
- <link href="/blog/feed.xml" rel="alternate" type="application/rss+xml" title="Apache Flink Blog: RSS feed" />
-
- <!-- jQuery (necessary for Bootstrap's JavaScript plugins) -->
- <!-- We need to load Jquery in the header for custom google analytics event tracking-->
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js"></script>
-
- <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
- <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
-
-
- <!-- Top navbar. -->
- <nav class="navbar navbar-default navbar-fixed-top">
- <div class="container">
- <!-- The logo. -->
- <div class="navbar-header">
- <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- <div class="navbar-logo">
- <a href="/">
- <img alt="Apache Flink" src="/img/navbar-brand-logo.jpg" width="78px" height="40px">
- </a>
- </div>
- </div><!-- /.navbar-header -->
-
- <!-- The navigation links. -->
- <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
- <ul class="nav navbar-nav">
-
- <!-- Overview -->
- <li><a href="/index.html">Overview</a></li>
-
- <!-- Features -->
- <li><a href="/features.html">Features</a></li>
-
- <!-- Downloads -->
- <li><a href="/downloads.html">Downloads</a></li>
-
- <!-- FAQ -->
- <li><a href="/faq.html">FAQ</a></li>
-
-
- <!-- Quickstart -->
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Quickstart <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html">Setup</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/run_example_quickstart.html">Example: Wikipedia Edit Stream</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html">Java API</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/scala_api_quickstart.html">Scala API</a></li>
- </ul>
- </li>
-
- <!-- Documentation -->
- <li class="dropdown">
- <a href="" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Documentation <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Latest stable release -->
- <li role="presentation" class="dropdown-header"><strong>Latest Release</strong> (Stable)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0">1.0 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/java" class="active">1.0 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/scala/index.html" class="active">1.0 ScalaDocs</a></li>
-
- <!-- Snapshot docs -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Snapshot</strong> (Development)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master">1.1 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/java" class="active">1.1 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/scala/index.html" class="active">1.1 ScalaDocs</a></li>
-
- <!-- Wiki -->
- <li class="divider"></li>
- <li><a href="/visualizer/"><small><span class="glyphicon glyphicon-new-window"></span></small> Plan Visualizer</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
-
- </ul>
-
- <ul class="nav navbar-nav navbar-right">
- <!-- Blog -->
- <li class=" active hidden-md hidden-sm"><a href="/blog/">Blog</a></li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Community <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Community -->
- <li role="presentation" class="dropdown-header"><strong>Community</strong></li>
- <li><a href="/community.html#mailing-lists">Mailing Lists</a></li>
- <li><a href="/community.html#irc">IRC</a></li>
- <li><a href="/community.html#stack-overflow">Stack Overflow</a></li>
- <li><a href="/community.html#issue-tracker">Issue Tracker</a></li>
- <li><a href="/community.html#third-party-packages">Third Party Packages</a></li>
- <li><a href="/community.html#source-code">Source Code</a></li>
- <li><a href="/community.html#people">People</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink"><small><span class="glyphicon glyphicon-new-window"></span></small> Powered by Flink</a></li>
-
- <!-- Contribute -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Contribute</strong></li>
- <li><a href="/how-to-contribute.html">How to Contribute</a></li>
- <li><a href="/contribute-code.html">Contribute Code</a></li>
- <li><a href="/contribute-documentation.html">Contribute Documentation</a></li>
- <li><a href="/improve-website.html">Improve the Website</a></li>
- </ul>
- </li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Project <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Project -->
- <li role="presentation" class="dropdown-header"><strong>Project</strong></li>
- <li><a href="/slides.html">Slides</a></li>
- <li><a href="/material.html">Material</a></li>
- <li><a href="https://twitter.com/apacheflink"><small><span class="glyphicon glyphicon-new-window"></span></small> Twitter</a></li>
- <li><a href="https://github.com/apache/flink"><small><span class="glyphicon glyphicon-new-window"></span></small> GitHub</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
- </ul>
- </div><!-- /.navbar-collapse -->
- </div><!-- /.container -->
- </nav>
-
-
- <!-- Main content. -->
- <div class="container">
-
-
-<div class="row">
- <div class="col-sm-8 col-sm-offset-2">
- <div class="row">
- <h1>Stratosphere Demo Accepted for ICDE 2013</h1>
-
- <article>
- <p>15 Oct 2012</p>
-
- <p>Our demo submission<br />
-<strong><cite>"Peeking into the Optimization of Data Flow Programs with MapReduce-style UDFs"</cite></strong><br />
-has been accepted for ICDE 2013 in Brisbane, Australia.<br />
-The demo illustrates the contributions of our VLDB 2012 paper <cite>"Opening the Black Boxes in Data Flow Optimization"</cite> <a href="/assets/papers/optimizationOfDataFlowsWithUDFs_13.pdf">[PDF]</a> and <a href="/assets/papers/optimizationOfDataFlowsWithUDFs_poster_13.pdf">[Poster PDF]</a>.</p>
-<p>Visit our poster, enjoy the demo, and talk to us if you are going to attend ICDE 2013.</p>
-<p><strong>Abstract:</strong><br />
-Data flows are a popular abstraction to define data-intensive processing tasks. In order to support a wide range of use cases, many data processing systems feature MapReduce-style user-defined functions (UDFs). In contrast to UDFs as known from relational DBMS, MapReduce-style UDFs have less strict templates. These templates do not alone provide all the information needed to decide whether they can be reordered with relational operators and other UDFs. However, it is well-known that reordering operators such as filters, joins, and aggregations can yield runtime improvements by orders of magnitude.<br />
-We demonstrate an optimizer for data flows that is able to reorder operators with MapReduce-style UDFs written in an imperative language. Our approach leverages static code analysis to extract information from UDFs which is used to reason about the reorderbility of UDF operators. This information is sufficient to enumerate a large fraction of the search space covered by conventional RDBMS optimizers including filter and aggregation push-down, bushy join orders, and choice of physical execution strategies based on interesting properties.<br />
-We demonstrate our optimizer and a job submission client that allows users to peek step-by-step into each phase of the optimization process: the static code analysis of UDFs, the enumeration of reordered candidate data flows, the generation of physical execution plans, and their parallel execution. For the demonstration, we provide a selection of relational and non-relational data flow programs which highlight the salient features of our approach.</p>
-
-
- </article>
- </div>
-
- <div class="row">
- <div id="disqus_thread"></div>
- <script type="text/javascript">
- /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
- var disqus_shortname = 'stratosphere-eu'; // required: replace example with your forum shortname
-
- /* * * DON'T EDIT BELOW THIS LINE * * */
- (function() {
- var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
- dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js';
- (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
- })();
- </script>
- </div>
- </div>
-</div>
-
- <hr />
- <div class="footer text-center">
- <p>Copyright © 2014-2015 <a href="http://apache.org">The Apache Software Foundation</a>. All Rights Reserved.</p>
- <p>Apache Flink, Apache, and the Apache feather logo are trademarks of The Apache Software Foundation.</p>
- <p><a href="/privacy-policy.html">Privacy Policy</a> · <a href="/blog/feed.xml">RSS feed</a></p>
- </div>
-
- </div><!-- /.container -->
-
- <!-- Include all compiled plugins (below), or include individual files as needed -->
- <script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
- <script src="/js/codetabs.js"></script>
-
- <!-- Google Analytics -->
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-52545728-1', 'auto');
- ga('send', 'pageview');
- </script>
- </body>
-</html>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2012/11/12/btw2013demo.html
----------------------------------------------------------------------
diff --git a/content/news/2012/11/12/btw2013demo.html b/content/news/2012/11/12/btw2013demo.html
deleted file mode 100644
index 5c0fa09..0000000
--- a/content/news/2012/11/12/btw2013demo.html
+++ /dev/null
@@ -1,216 +0,0 @@
-<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
- <title>Apache Flink: Stratosphere Demo Paper Accepted for BTW 2013</title>
- <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
- <link rel="icon" href="/favicon.ico" type="image/x-icon">
-
- <!-- Bootstrap -->
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css">
- <link rel="stylesheet" href="/css/flink.css">
- <link rel="stylesheet" href="/css/syntax.css">
-
- <!-- Blog RSS feed -->
- <link href="/blog/feed.xml" rel="alternate" type="application/rss+xml" title="Apache Flink Blog: RSS feed" />
-
- <!-- jQuery (necessary for Bootstrap's JavaScript plugins) -->
- <!-- We need to load Jquery in the header for custom google analytics event tracking-->
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js"></script>
-
- <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
- <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
-
-
- <!-- Top navbar. -->
- <nav class="navbar navbar-default navbar-fixed-top">
- <div class="container">
- <!-- The logo. -->
- <div class="navbar-header">
- <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- <div class="navbar-logo">
- <a href="/">
- <img alt="Apache Flink" src="/img/navbar-brand-logo.jpg" width="78px" height="40px">
- </a>
- </div>
- </div><!-- /.navbar-header -->
-
- <!-- The navigation links. -->
- <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
- <ul class="nav navbar-nav">
-
- <!-- Overview -->
- <li><a href="/index.html">Overview</a></li>
-
- <!-- Features -->
- <li><a href="/features.html">Features</a></li>
-
- <!-- Downloads -->
- <li><a href="/downloads.html">Downloads</a></li>
-
- <!-- FAQ -->
- <li><a href="/faq.html">FAQ</a></li>
-
-
- <!-- Quickstart -->
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Quickstart <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html">Setup</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/run_example_quickstart.html">Example: Wikipedia Edit Stream</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html">Java API</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/scala_api_quickstart.html">Scala API</a></li>
- </ul>
- </li>
-
- <!-- Documentation -->
- <li class="dropdown">
- <a href="" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Documentation <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Latest stable release -->
- <li role="presentation" class="dropdown-header"><strong>Latest Release</strong> (Stable)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0">1.0 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/java" class="active">1.0 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/scala/index.html" class="active">1.0 ScalaDocs</a></li>
-
- <!-- Snapshot docs -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Snapshot</strong> (Development)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master">1.1 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/java" class="active">1.1 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/scala/index.html" class="active">1.1 ScalaDocs</a></li>
-
- <!-- Wiki -->
- <li class="divider"></li>
- <li><a href="/visualizer/"><small><span class="glyphicon glyphicon-new-window"></span></small> Plan Visualizer</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
-
- </ul>
-
- <ul class="nav navbar-nav navbar-right">
- <!-- Blog -->
- <li class=" active hidden-md hidden-sm"><a href="/blog/">Blog</a></li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Community <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Community -->
- <li role="presentation" class="dropdown-header"><strong>Community</strong></li>
- <li><a href="/community.html#mailing-lists">Mailing Lists</a></li>
- <li><a href="/community.html#irc">IRC</a></li>
- <li><a href="/community.html#stack-overflow">Stack Overflow</a></li>
- <li><a href="/community.html#issue-tracker">Issue Tracker</a></li>
- <li><a href="/community.html#third-party-packages">Third Party Packages</a></li>
- <li><a href="/community.html#source-code">Source Code</a></li>
- <li><a href="/community.html#people">People</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink"><small><span class="glyphicon glyphicon-new-window"></span></small> Powered by Flink</a></li>
-
- <!-- Contribute -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Contribute</strong></li>
- <li><a href="/how-to-contribute.html">How to Contribute</a></li>
- <li><a href="/contribute-code.html">Contribute Code</a></li>
- <li><a href="/contribute-documentation.html">Contribute Documentation</a></li>
- <li><a href="/improve-website.html">Improve the Website</a></li>
- </ul>
- </li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Project <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Project -->
- <li role="presentation" class="dropdown-header"><strong>Project</strong></li>
- <li><a href="/slides.html">Slides</a></li>
- <li><a href="/material.html">Material</a></li>
- <li><a href="https://twitter.com/apacheflink"><small><span class="glyphicon glyphicon-new-window"></span></small> Twitter</a></li>
- <li><a href="https://github.com/apache/flink"><small><span class="glyphicon glyphicon-new-window"></span></small> GitHub</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
- </ul>
- </div><!-- /.navbar-collapse -->
- </div><!-- /.container -->
- </nav>
-
-
- <!-- Main content. -->
- <div class="container">
-
-
-<div class="row">
- <div class="col-sm-8 col-sm-offset-2">
- <div class="row">
- <h1>Stratosphere Demo Paper Accepted for BTW 2013</h1>
-
- <article>
- <p>12 Nov 2012</p>
-
- <p>Our demo submission<br />
-<strong><cite>"Applying Stratosphere for Big Data Analytics"</cite></strong><br />
-has been accepted for BTW 2013 in Magdeburg, Germany.<br />
-The demo focuses on Stratosphere's query language Meteor, which has been presented in our paper <cite>"Meteor/Sopremo: An Extensible Query Language and Operator Model"</cite> <a href="/assets/papers/Sopremo_Meteor BigData.pdf">[pdf]</a> at the BigData workshop associated with VLDB 2012 in Istanbul.</p>
-<p>Visit our demo, and talk to us if you are going to attend BTW 2013.</p>
-<p><strong>Abstract:</strong><br />
-Analyzing big data sets as they occur in modern business and science applications requires query languages that allow for the specification of complex data processing tasks. Moreover, these ideally declarative query specifications have to be optimized, parallelized and scheduled for processing on massively parallel data processing platforms. This paper demonstrates the application of Stratosphere to different kinds of Big Data Analytics tasks. Using examples from different application domains, we show how to formulate analytical tasks as Meteor queries and execute them with Stratosphere. These examples include data cleansing and information extraction tasks, and a correlation analysis of microblogging and stock trade volume data that we describe in detail in this paper.</p>
-
-
- </article>
- </div>
-
- <div class="row">
- <div id="disqus_thread"></div>
- <script type="text/javascript">
- /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
- var disqus_shortname = 'stratosphere-eu'; // required: replace example with your forum shortname
-
- /* * * DON'T EDIT BELOW THIS LINE * * */
- (function() {
- var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
- dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js';
- (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
- })();
- </script>
- </div>
- </div>
-</div>
-
- <hr />
- <div class="footer text-center">
- <p>Copyright © 2014-2015 <a href="http://apache.org">The Apache Software Foundation</a>. All Rights Reserved.</p>
- <p>Apache Flink, Apache, and the Apache feather logo are trademarks of The Apache Software Foundation.</p>
- <p><a href="/privacy-policy.html">Privacy Policy</a> · <a href="/blog/feed.xml">RSS feed</a></p>
- </div>
-
- </div><!-- /.container -->
-
- <!-- Include all compiled plugins (below), or include individual files as needed -->
- <script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
- <script src="/js/codetabs.js"></script>
-
- <!-- Google Analytics -->
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-52545728-1', 'auto');
- ga('send', 'pageview');
- </script>
- </body>
-</html>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2012/11/21/previewICDE2013.html
----------------------------------------------------------------------
diff --git a/content/news/2012/11/21/previewICDE2013.html b/content/news/2012/11/21/previewICDE2013.html
deleted file mode 100644
index 7ce8013..0000000
--- a/content/news/2012/11/21/previewICDE2013.html
+++ /dev/null
@@ -1,211 +0,0 @@
-<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
- <title>Apache Flink: ICDE 2013 Demo Preview</title>
- <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
- <link rel="icon" href="/favicon.ico" type="image/x-icon">
-
- <!-- Bootstrap -->
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css">
- <link rel="stylesheet" href="/css/flink.css">
- <link rel="stylesheet" href="/css/syntax.css">
-
- <!-- Blog RSS feed -->
- <link href="/blog/feed.xml" rel="alternate" type="application/rss+xml" title="Apache Flink Blog: RSS feed" />
-
- <!-- jQuery (necessary for Bootstrap's JavaScript plugins) -->
- <!-- We need to load Jquery in the header for custom google analytics event tracking-->
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js"></script>
-
- <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
- <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
-
-
- <!-- Top navbar. -->
- <nav class="navbar navbar-default navbar-fixed-top">
- <div class="container">
- <!-- The logo. -->
- <div class="navbar-header">
- <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- <div class="navbar-logo">
- <a href="/">
- <img alt="Apache Flink" src="/img/navbar-brand-logo.jpg" width="78px" height="40px">
- </a>
- </div>
- </div><!-- /.navbar-header -->
-
- <!-- The navigation links. -->
- <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
- <ul class="nav navbar-nav">
-
- <!-- Overview -->
- <li><a href="/index.html">Overview</a></li>
-
- <!-- Features -->
- <li><a href="/features.html">Features</a></li>
-
- <!-- Downloads -->
- <li><a href="/downloads.html">Downloads</a></li>
-
- <!-- FAQ -->
- <li><a href="/faq.html">FAQ</a></li>
-
-
- <!-- Quickstart -->
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Quickstart <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html">Setup</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/run_example_quickstart.html">Example: Wikipedia Edit Stream</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html">Java API</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/scala_api_quickstart.html">Scala API</a></li>
- </ul>
- </li>
-
- <!-- Documentation -->
- <li class="dropdown">
- <a href="" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Documentation <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Latest stable release -->
- <li role="presentation" class="dropdown-header"><strong>Latest Release</strong> (Stable)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0">1.0 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/java" class="active">1.0 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/scala/index.html" class="active">1.0 ScalaDocs</a></li>
-
- <!-- Snapshot docs -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Snapshot</strong> (Development)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master">1.1 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/java" class="active">1.1 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/scala/index.html" class="active">1.1 ScalaDocs</a></li>
-
- <!-- Wiki -->
- <li class="divider"></li>
- <li><a href="/visualizer/"><small><span class="glyphicon glyphicon-new-window"></span></small> Plan Visualizer</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
-
- </ul>
-
- <ul class="nav navbar-nav navbar-right">
- <!-- Blog -->
- <li class=" active hidden-md hidden-sm"><a href="/blog/">Blog</a></li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Community <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Community -->
- <li role="presentation" class="dropdown-header"><strong>Community</strong></li>
- <li><a href="/community.html#mailing-lists">Mailing Lists</a></li>
- <li><a href="/community.html#irc">IRC</a></li>
- <li><a href="/community.html#stack-overflow">Stack Overflow</a></li>
- <li><a href="/community.html#issue-tracker">Issue Tracker</a></li>
- <li><a href="/community.html#third-party-packages">Third Party Packages</a></li>
- <li><a href="/community.html#source-code">Source Code</a></li>
- <li><a href="/community.html#people">People</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink"><small><span class="glyphicon glyphicon-new-window"></span></small> Powered by Flink</a></li>
-
- <!-- Contribute -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Contribute</strong></li>
- <li><a href="/how-to-contribute.html">How to Contribute</a></li>
- <li><a href="/contribute-code.html">Contribute Code</a></li>
- <li><a href="/contribute-documentation.html">Contribute Documentation</a></li>
- <li><a href="/improve-website.html">Improve the Website</a></li>
- </ul>
- </li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Project <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Project -->
- <li role="presentation" class="dropdown-header"><strong>Project</strong></li>
- <li><a href="/slides.html">Slides</a></li>
- <li><a href="/material.html">Material</a></li>
- <li><a href="https://twitter.com/apacheflink"><small><span class="glyphicon glyphicon-new-window"></span></small> Twitter</a></li>
- <li><a href="https://github.com/apache/flink"><small><span class="glyphicon glyphicon-new-window"></span></small> GitHub</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
- </ul>
- </div><!-- /.navbar-collapse -->
- </div><!-- /.container -->
- </nav>
-
-
- <!-- Main content. -->
- <div class="container">
-
-
-<div class="row">
- <div class="col-sm-8 col-sm-offset-2">
- <div class="row">
- <h1>ICDE 2013 Demo Preview</h1>
-
- <article>
- <p>21 Nov 2012</p>
-
- <p>This is a preview of our demo that will be presented at ICDE 2013 in Brisbane.<br />
-The demo shows how static code analysis can be leveraged to reordered UDF operators in data flow programs.</p>
-<p>Detailed information can be found in our papers which are available on the <a href="/publications">publication</a> page.</p>
-<p><iframe width="420" height="315" src="http://www.youtube.com/embed/ZYwCMgPXFVE" frameborder="0" allowfullscreen></iframe></p>
- </article>
- </div>
-
- <div class="row">
- <div id="disqus_thread"></div>
- <script type="text/javascript">
- /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
- var disqus_shortname = 'stratosphere-eu'; // required: replace example with your forum shortname
-
- /* * * DON'T EDIT BELOW THIS LINE * * */
- (function() {
- var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
- dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js';
- (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
- })();
- </script>
- </div>
- </div>
-</div>
-
- <hr />
- <div class="footer text-center">
- <p>Copyright © 2014-2015 <a href="http://apache.org">The Apache Software Foundation</a>. All Rights Reserved.</p>
- <p>Apache Flink, Apache, and the Apache feather logo are trademarks of The Apache Software Foundation.</p>
- <p><a href="/privacy-policy.html">Privacy Policy</a> · <a href="/blog/feed.xml">RSS feed</a></p>
- </div>
-
- </div><!-- /.container -->
-
- <!-- Include all compiled plugins (below), or include individual files as needed -->
- <script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
- <script src="/js/codetabs.js"></script>
-
- <!-- Google Analytics -->
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-52545728-1', 'auto');
- ga('send', 'pageview');
- </script>
- </body>
-</html>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2013/03/27/www-demo-paper.html
----------------------------------------------------------------------
diff --git a/content/news/2013/03/27/www-demo-paper.html b/content/news/2013/03/27/www-demo-paper.html
deleted file mode 100644
index b1f74fb..0000000
--- a/content/news/2013/03/27/www-demo-paper.html
+++ /dev/null
@@ -1,215 +0,0 @@
-<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
- <title>Apache Flink: Demo Paper "Large-Scale Social-Media Analytics on Stratosphere" Accepted at WWW 2013</title>
- <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
- <link rel="icon" href="/favicon.ico" type="image/x-icon">
-
- <!-- Bootstrap -->
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css">
- <link rel="stylesheet" href="/css/flink.css">
- <link rel="stylesheet" href="/css/syntax.css">
-
- <!-- Blog RSS feed -->
- <link href="/blog/feed.xml" rel="alternate" type="application/rss+xml" title="Apache Flink Blog: RSS feed" />
-
- <!-- jQuery (necessary for Bootstrap's JavaScript plugins) -->
- <!-- We need to load Jquery in the header for custom google analytics event tracking-->
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js"></script>
-
- <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
- <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
-
-
- <!-- Top navbar. -->
- <nav class="navbar navbar-default navbar-fixed-top">
- <div class="container">
- <!-- The logo. -->
- <div class="navbar-header">
- <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- <div class="navbar-logo">
- <a href="/">
- <img alt="Apache Flink" src="/img/navbar-brand-logo.jpg" width="78px" height="40px">
- </a>
- </div>
- </div><!-- /.navbar-header -->
-
- <!-- The navigation links. -->
- <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
- <ul class="nav navbar-nav">
-
- <!-- Overview -->
- <li><a href="/index.html">Overview</a></li>
-
- <!-- Features -->
- <li><a href="/features.html">Features</a></li>
-
- <!-- Downloads -->
- <li><a href="/downloads.html">Downloads</a></li>
-
- <!-- FAQ -->
- <li><a href="/faq.html">FAQ</a></li>
-
-
- <!-- Quickstart -->
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Quickstart <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html">Setup</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/run_example_quickstart.html">Example: Wikipedia Edit Stream</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html">Java API</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/scala_api_quickstart.html">Scala API</a></li>
- </ul>
- </li>
-
- <!-- Documentation -->
- <li class="dropdown">
- <a href="" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Documentation <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Latest stable release -->
- <li role="presentation" class="dropdown-header"><strong>Latest Release</strong> (Stable)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0">1.0 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/java" class="active">1.0 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/scala/index.html" class="active">1.0 ScalaDocs</a></li>
-
- <!-- Snapshot docs -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Snapshot</strong> (Development)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master">1.1 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/java" class="active">1.1 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/scala/index.html" class="active">1.1 ScalaDocs</a></li>
-
- <!-- Wiki -->
- <li class="divider"></li>
- <li><a href="/visualizer/"><small><span class="glyphicon glyphicon-new-window"></span></small> Plan Visualizer</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
-
- </ul>
-
- <ul class="nav navbar-nav navbar-right">
- <!-- Blog -->
- <li class=" active hidden-md hidden-sm"><a href="/blog/">Blog</a></li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Community <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Community -->
- <li role="presentation" class="dropdown-header"><strong>Community</strong></li>
- <li><a href="/community.html#mailing-lists">Mailing Lists</a></li>
- <li><a href="/community.html#irc">IRC</a></li>
- <li><a href="/community.html#stack-overflow">Stack Overflow</a></li>
- <li><a href="/community.html#issue-tracker">Issue Tracker</a></li>
- <li><a href="/community.html#third-party-packages">Third Party Packages</a></li>
- <li><a href="/community.html#source-code">Source Code</a></li>
- <li><a href="/community.html#people">People</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink"><small><span class="glyphicon glyphicon-new-window"></span></small> Powered by Flink</a></li>
-
- <!-- Contribute -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Contribute</strong></li>
- <li><a href="/how-to-contribute.html">How to Contribute</a></li>
- <li><a href="/contribute-code.html">Contribute Code</a></li>
- <li><a href="/contribute-documentation.html">Contribute Documentation</a></li>
- <li><a href="/improve-website.html">Improve the Website</a></li>
- </ul>
- </li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Project <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Project -->
- <li role="presentation" class="dropdown-header"><strong>Project</strong></li>
- <li><a href="/slides.html">Slides</a></li>
- <li><a href="/material.html">Material</a></li>
- <li><a href="https://twitter.com/apacheflink"><small><span class="glyphicon glyphicon-new-window"></span></small> Twitter</a></li>
- <li><a href="https://github.com/apache/flink"><small><span class="glyphicon glyphicon-new-window"></span></small> GitHub</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
- </ul>
- </div><!-- /.navbar-collapse -->
- </div><!-- /.container -->
- </nav>
-
-
- <!-- Main content. -->
- <div class="container">
-
-
-<div class="row">
- <div class="col-sm-8 col-sm-offset-2">
- <div class="row">
- <h1>Demo Paper "Large-Scale Social-Media Analytics on Stratosphere" Accepted at WWW 2013</h1>
-
- <article>
- <p>27 Mar 2013</p>
-
- <p>Our demo submission<br />
-<strong><cite>"Large-Scale Social-Media Analytics on Stratosphere"</cite></strong><br />
-by Christoph Boden, Marcel Karnstedt, Miriam Fernandez and Volker Markl<br />
-has been accepted for WWW 2013 in Rio de Janeiro, Brazil.</p>
-<p>Visit our demo, and talk to us if you are attending WWW 2013.</p>
-<p><strong>Abstract:</strong><br />
-The importance of social-media platforms and online communities - in business as well as public context - is more and more acknowledged and appreciated by industry and researchers alike. Consequently, a wide range of analytics has been proposed to understand, steer, and exploit the mechanics and laws driving their functionality and creating the resulting benefits. However, analysts usually face significant problems in scaling existing and novel approaches to match the data volume and size of modern online communities. In this work, we propose and demonstrate the usage of the massively parallel data prossesing system Stratosphere, based on second order functions as an extended notion of the MapReduce paradigm, to provide a new level of scalability to such social-media analytics. Based on the popular example of role analysis, we present and illustrate how this massively parallel approach can be leveraged to scale out complex data-mining tasks, while providing a programming approach th
at eases the formulation of complete analytical workflows.</p>
-
- </article>
- </div>
-
- <div class="row">
- <div id="disqus_thread"></div>
- <script type="text/javascript">
- /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
- var disqus_shortname = 'stratosphere-eu'; // required: replace example with your forum shortname
-
- /* * * DON'T EDIT BELOW THIS LINE * * */
- (function() {
- var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
- dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js';
- (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
- })();
- </script>
- </div>
- </div>
-</div>
-
- <hr />
- <div class="footer text-center">
- <p>Copyright © 2014-2015 <a href="http://apache.org">The Apache Software Foundation</a>. All Rights Reserved.</p>
- <p>Apache Flink, Apache, and the Apache feather logo are trademarks of The Apache Software Foundation.</p>
- <p><a href="/privacy-policy.html">Privacy Policy</a> · <a href="/blog/feed.xml">RSS feed</a></p>
- </div>
-
- </div><!-- /.container -->
-
- <!-- Include all compiled plugins (below), or include individual files as needed -->
- <script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
- <script src="/js/codetabs.js"></script>
-
- <!-- Google Analytics -->
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-52545728-1', 'auto');
- ga('send', 'pageview');
- </script>
- </body>
-</html>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2013/10/21/cikm2013-paper.html
----------------------------------------------------------------------
diff --git a/content/news/2013/10/21/cikm2013-paper.html b/content/news/2013/10/21/cikm2013-paper.html
deleted file mode 100644
index ddd5d29..0000000
--- a/content/news/2013/10/21/cikm2013-paper.html
+++ /dev/null
@@ -1,249 +0,0 @@
-<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
- <title>Apache Flink: Paper "All Roads Lead to Rome: Optimistic Recovery for Distributed Iterative Data Processing" accepted at CIKM 2013</title>
- <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
- <link rel="icon" href="/favicon.ico" type="image/x-icon">
-
- <!-- Bootstrap -->
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css">
- <link rel="stylesheet" href="/css/flink.css">
- <link rel="stylesheet" href="/css/syntax.css">
-
- <!-- Blog RSS feed -->
- <link href="/blog/feed.xml" rel="alternate" type="application/rss+xml" title="Apache Flink Blog: RSS feed" />
-
- <!-- jQuery (necessary for Bootstrap's JavaScript plugins) -->
- <!-- We need to load Jquery in the header for custom google analytics event tracking-->
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js"></script>
-
- <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
- <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
-
-
- <!-- Top navbar. -->
- <nav class="navbar navbar-default navbar-fixed-top">
- <div class="container">
- <!-- The logo. -->
- <div class="navbar-header">
- <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- <div class="navbar-logo">
- <a href="/">
- <img alt="Apache Flink" src="/img/navbar-brand-logo.jpg" width="78px" height="40px">
- </a>
- </div>
- </div><!-- /.navbar-header -->
-
- <!-- The navigation links. -->
- <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
- <ul class="nav navbar-nav">
-
- <!-- Overview -->
- <li><a href="/index.html">Overview</a></li>
-
- <!-- Features -->
- <li><a href="/features.html">Features</a></li>
-
- <!-- Downloads -->
- <li><a href="/downloads.html">Downloads</a></li>
-
- <!-- FAQ -->
- <li><a href="/faq.html">FAQ</a></li>
-
-
- <!-- Quickstart -->
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Quickstart <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html">Setup</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/run_example_quickstart.html">Example: Wikipedia Edit Stream</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html">Java API</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/scala_api_quickstart.html">Scala API</a></li>
- </ul>
- </li>
-
- <!-- Documentation -->
- <li class="dropdown">
- <a href="" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Documentation <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Latest stable release -->
- <li role="presentation" class="dropdown-header"><strong>Latest Release</strong> (Stable)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0">1.0 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/java" class="active">1.0 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/scala/index.html" class="active">1.0 ScalaDocs</a></li>
-
- <!-- Snapshot docs -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Snapshot</strong> (Development)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master">1.1 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/java" class="active">1.1 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/scala/index.html" class="active">1.1 ScalaDocs</a></li>
-
- <!-- Wiki -->
- <li class="divider"></li>
- <li><a href="/visualizer/"><small><span class="glyphicon glyphicon-new-window"></span></small> Plan Visualizer</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
-
- </ul>
-
- <ul class="nav navbar-nav navbar-right">
- <!-- Blog -->
- <li class=" active hidden-md hidden-sm"><a href="/blog/">Blog</a></li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Community <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Community -->
- <li role="presentation" class="dropdown-header"><strong>Community</strong></li>
- <li><a href="/community.html#mailing-lists">Mailing Lists</a></li>
- <li><a href="/community.html#irc">IRC</a></li>
- <li><a href="/community.html#stack-overflow">Stack Overflow</a></li>
- <li><a href="/community.html#issue-tracker">Issue Tracker</a></li>
- <li><a href="/community.html#third-party-packages">Third Party Packages</a></li>
- <li><a href="/community.html#source-code">Source Code</a></li>
- <li><a href="/community.html#people">People</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink"><small><span class="glyphicon glyphicon-new-window"></span></small> Powered by Flink</a></li>
-
- <!-- Contribute -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Contribute</strong></li>
- <li><a href="/how-to-contribute.html">How to Contribute</a></li>
- <li><a href="/contribute-code.html">Contribute Code</a></li>
- <li><a href="/contribute-documentation.html">Contribute Documentation</a></li>
- <li><a href="/improve-website.html">Improve the Website</a></li>
- </ul>
- </li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Project <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Project -->
- <li role="presentation" class="dropdown-header"><strong>Project</strong></li>
- <li><a href="/slides.html">Slides</a></li>
- <li><a href="/material.html">Material</a></li>
- <li><a href="https://twitter.com/apacheflink"><small><span class="glyphicon glyphicon-new-window"></span></small> Twitter</a></li>
- <li><a href="https://github.com/apache/flink"><small><span class="glyphicon glyphicon-new-window"></span></small> GitHub</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
- </ul>
- </div><!-- /.navbar-collapse -->
- </div><!-- /.container -->
- </nav>
-
-
- <!-- Main content. -->
- <div class="container">
-
-
-<div class="row">
- <div class="col-sm-8 col-sm-offset-2">
- <div class="row">
- <h1>Paper "All Roads Lead to Rome: Optimistic Recovery for Distributed Iterative Data Processing" accepted at CIKM 2013</h1>
-
- <article>
- <p>21 Oct 2013</p>
-
-<p>Our paper ““All Roads Lead to Rome:” Optimistic Recovery for Distributed
-Iterative Data Processing” authored by Sebastian Schelter, Kostas
-Tzoumas, Stephan Ewen and Volker Markl has been accepted accepted at the
-ACM International Conference on Information and Knowledge Management
-(CIKM 2013) in San Francisco.</p>
-
-<p><strong>Abstract</strong></p>
-
-<p>Executing data-parallel iterative algorithms on large datasets is
-crucial for many advanced analytical applications in the fields of data
-mining and machine learning. Current systems for executing iterative
-tasks in large clusters typically achieve fault tolerance through
-rollback recovery. The principle behind this pessimistic approach is to
-periodically checkpoint the algorithm state. Upon failure, the system
-restores a consistent state from a previously written checkpoint and
-resumes execution from that point.</p>
-
-<p>We propose an optimistic recovery mechanism using algorithmic
-compensations. Our method leverages the robust, self-correcting nature
-of a large class of fixpoint algorithms used in data mining and machine
-learning, which converge to the correct solution from various
-intermediate consistent states. In the case of a failure, we apply a
-user-defined compensate function that algorithmically creates such a
-consistent state, instead of rolling back to a previous checkpointed
-state. Our optimistic recovery does not checkpoint any state and hence
-achieves optimal failure-free performance with respect to the overhead
-necessary for guaranteeing fault tolerance. We illustrate the
-applicability of this approach for three wide classes of problems.
-Furthermore, we show how to implement the proposed optimistic recovery
-mechanism in a data flow system. Similar to the Combine operator in
-MapReduce, our proposed functionality is optional and can be applied to
-increase performance without changing the semantics of programs. In an
-experimental evaluation on large datasets, we show that our proposed
-approach provides optimal failure-free performance. In the absence of
-failures our optimistic scheme is able to outperform a pessimistic
-approach by a factor of two to five. In presence of failures, our
-approach provides fast recovery and outperforms pessimistic approaches
-in the majority of cases.</p>
-
-<p><a href="/assets/papers/optimistic.pdf">Download the paper [PDF]</a></p>
-
-
- </article>
- </div>
-
- <div class="row">
- <div id="disqus_thread"></div>
- <script type="text/javascript">
- /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
- var disqus_shortname = 'stratosphere-eu'; // required: replace example with your forum shortname
-
- /* * * DON'T EDIT BELOW THIS LINE * * */
- (function() {
- var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
- dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js';
- (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
- })();
- </script>
- </div>
- </div>
-</div>
-
- <hr />
- <div class="footer text-center">
- <p>Copyright © 2014-2015 <a href="http://apache.org">The Apache Software Foundation</a>. All Rights Reserved.</p>
- <p>Apache Flink, Apache, and the Apache feather logo are trademarks of The Apache Software Foundation.</p>
- <p><a href="/privacy-policy.html">Privacy Policy</a> · <a href="/blog/feed.xml">RSS feed</a></p>
- </div>
-
- </div><!-- /.container -->
-
- <!-- Include all compiled plugins (below), or include individual files as needed -->
- <script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
- <script src="/js/codetabs.js"></script>
-
- <!-- Google Analytics -->
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-52545728-1', 'auto');
- ga('send', 'pageview');
- </script>
- </body>
-</html>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2013/12/13/humboldt-innovation-award.html
----------------------------------------------------------------------
diff --git a/content/news/2013/12/13/humboldt-innovation-award.html b/content/news/2013/12/13/humboldt-innovation-award.html
deleted file mode 100644
index 79327cc..0000000
--- a/content/news/2013/12/13/humboldt-innovation-award.html
+++ /dev/null
@@ -1,220 +0,0 @@
-<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
- <title>Apache Flink: Stratosphere wins award at Humboldt Innovation Competition "Big Data: Research meets Startups"</title>
- <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
- <link rel="icon" href="/favicon.ico" type="image/x-icon">
-
- <!-- Bootstrap -->
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css">
- <link rel="stylesheet" href="/css/flink.css">
- <link rel="stylesheet" href="/css/syntax.css">
-
- <!-- Blog RSS feed -->
- <link href="/blog/feed.xml" rel="alternate" type="application/rss+xml" title="Apache Flink Blog: RSS feed" />
-
- <!-- jQuery (necessary for Bootstrap's JavaScript plugins) -->
- <!-- We need to load Jquery in the header for custom google analytics event tracking-->
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js"></script>
-
- <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
- <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
-
-
- <!-- Top navbar. -->
- <nav class="navbar navbar-default navbar-fixed-top">
- <div class="container">
- <!-- The logo. -->
- <div class="navbar-header">
- <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- <div class="navbar-logo">
- <a href="/">
- <img alt="Apache Flink" src="/img/navbar-brand-logo.jpg" width="78px" height="40px">
- </a>
- </div>
- </div><!-- /.navbar-header -->
-
- <!-- The navigation links. -->
- <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
- <ul class="nav navbar-nav">
-
- <!-- Overview -->
- <li><a href="/index.html">Overview</a></li>
-
- <!-- Features -->
- <li><a href="/features.html">Features</a></li>
-
- <!-- Downloads -->
- <li><a href="/downloads.html">Downloads</a></li>
-
- <!-- FAQ -->
- <li><a href="/faq.html">FAQ</a></li>
-
-
- <!-- Quickstart -->
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Quickstart <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html">Setup</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/run_example_quickstart.html">Example: Wikipedia Edit Stream</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html">Java API</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/scala_api_quickstart.html">Scala API</a></li>
- </ul>
- </li>
-
- <!-- Documentation -->
- <li class="dropdown">
- <a href="" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Documentation <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Latest stable release -->
- <li role="presentation" class="dropdown-header"><strong>Latest Release</strong> (Stable)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0">1.0 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/java" class="active">1.0 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/scala/index.html" class="active">1.0 ScalaDocs</a></li>
-
- <!-- Snapshot docs -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Snapshot</strong> (Development)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master">1.1 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/java" class="active">1.1 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/scala/index.html" class="active">1.1 ScalaDocs</a></li>
-
- <!-- Wiki -->
- <li class="divider"></li>
- <li><a href="/visualizer/"><small><span class="glyphicon glyphicon-new-window"></span></small> Plan Visualizer</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
-
- </ul>
-
- <ul class="nav navbar-nav navbar-right">
- <!-- Blog -->
- <li class=" active hidden-md hidden-sm"><a href="/blog/">Blog</a></li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Community <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Community -->
- <li role="presentation" class="dropdown-header"><strong>Community</strong></li>
- <li><a href="/community.html#mailing-lists">Mailing Lists</a></li>
- <li><a href="/community.html#irc">IRC</a></li>
- <li><a href="/community.html#stack-overflow">Stack Overflow</a></li>
- <li><a href="/community.html#issue-tracker">Issue Tracker</a></li>
- <li><a href="/community.html#third-party-packages">Third Party Packages</a></li>
- <li><a href="/community.html#source-code">Source Code</a></li>
- <li><a href="/community.html#people">People</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink"><small><span class="glyphicon glyphicon-new-window"></span></small> Powered by Flink</a></li>
-
- <!-- Contribute -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Contribute</strong></li>
- <li><a href="/how-to-contribute.html">How to Contribute</a></li>
- <li><a href="/contribute-code.html">Contribute Code</a></li>
- <li><a href="/contribute-documentation.html">Contribute Documentation</a></li>
- <li><a href="/improve-website.html">Improve the Website</a></li>
- </ul>
- </li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Project <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Project -->
- <li role="presentation" class="dropdown-header"><strong>Project</strong></li>
- <li><a href="/slides.html">Slides</a></li>
- <li><a href="/material.html">Material</a></li>
- <li><a href="https://twitter.com/apacheflink"><small><span class="glyphicon glyphicon-new-window"></span></small> Twitter</a></li>
- <li><a href="https://github.com/apache/flink"><small><span class="glyphicon glyphicon-new-window"></span></small> GitHub</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
- </ul>
- </div><!-- /.navbar-collapse -->
- </div><!-- /.container -->
- </nav>
-
-
- <!-- Main content. -->
- <div class="container">
-
-
-<div class="row">
- <div class="col-sm-8 col-sm-offset-2">
- <div class="row">
- <h1>Stratosphere wins award at Humboldt Innovation Competition "Big Data: Research meets Startups"</h1>
-
- <article>
- <p>13 Dec 2013</p>
-
- <p> Stratosphere won the second place in
- the <a href="http://www.humboldt-innovation.de/de/newsdetail/News/View/Forum%2BJunge%2BSpitzenforscher%2BBIG%2BData%2B%2BResearch%2Bmeets%2BStartups-123.html">competition</a>
- organized by Humboldt Innovation on "Big Data: Research meets
- Startups," where several research projects were evaluated by a
- panel of experts from the Berlin startup ecosystem. The award
- includes a monetary prize of 10,000 euros.
- </p>
-
- <p>We are extremely excited about this award, as it further
- showcases the relevance of the Stratosphere platform and Big Data
- technology in general for the technology startup world.
- </p>
-
- </article>
- </div>
-
- <div class="row">
- <div id="disqus_thread"></div>
- <script type="text/javascript">
- /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
- var disqus_shortname = 'stratosphere-eu'; // required: replace example with your forum shortname
-
- /* * * DON'T EDIT BELOW THIS LINE * * */
- (function() {
- var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
- dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js';
- (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
- })();
- </script>
- </div>
- </div>
-</div>
-
- <hr />
- <div class="footer text-center">
- <p>Copyright © 2014-2015 <a href="http://apache.org">The Apache Software Foundation</a>. All Rights Reserved.</p>
- <p>Apache Flink, Apache, and the Apache feather logo are trademarks of The Apache Software Foundation.</p>
- <p><a href="/privacy-policy.html">Privacy Policy</a> · <a href="/blog/feed.xml">RSS feed</a></p>
- </div>
-
- </div><!-- /.container -->
-
- <!-- Include all compiled plugins (below), or include individual files as needed -->
- <script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
- <script src="/js/codetabs.js"></script>
-
- <!-- Google Analytics -->
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-52545728-1', 'auto');
- ga('send', 'pageview');
- </script>
- </body>
-</html>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/24f3ba5a/content/news/2014/01/10/stratosphere-hadoop-summit.html
----------------------------------------------------------------------
diff --git a/content/news/2014/01/10/stratosphere-hadoop-summit.html b/content/news/2014/01/10/stratosphere-hadoop-summit.html
deleted file mode 100644
index b79a2a5..0000000
--- a/content/news/2014/01/10/stratosphere-hadoop-summit.html
+++ /dev/null
@@ -1,210 +0,0 @@
-<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
- <title>Apache Flink: Stratosphere got accepted to the Hadoop Summit Europe in Amsterdam</title>
- <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
- <link rel="icon" href="/favicon.ico" type="image/x-icon">
-
- <!-- Bootstrap -->
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css">
- <link rel="stylesheet" href="/css/flink.css">
- <link rel="stylesheet" href="/css/syntax.css">
-
- <!-- Blog RSS feed -->
- <link href="/blog/feed.xml" rel="alternate" type="application/rss+xml" title="Apache Flink Blog: RSS feed" />
-
- <!-- jQuery (necessary for Bootstrap's JavaScript plugins) -->
- <!-- We need to load Jquery in the header for custom google analytics event tracking-->
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js"></script>
-
- <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
- <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
-
-
- <!-- Top navbar. -->
- <nav class="navbar navbar-default navbar-fixed-top">
- <div class="container">
- <!-- The logo. -->
- <div class="navbar-header">
- <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- <div class="navbar-logo">
- <a href="/">
- <img alt="Apache Flink" src="/img/navbar-brand-logo.jpg" width="78px" height="40px">
- </a>
- </div>
- </div><!-- /.navbar-header -->
-
- <!-- The navigation links. -->
- <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
- <ul class="nav navbar-nav">
-
- <!-- Overview -->
- <li><a href="/index.html">Overview</a></li>
-
- <!-- Features -->
- <li><a href="/features.html">Features</a></li>
-
- <!-- Downloads -->
- <li><a href="/downloads.html">Downloads</a></li>
-
- <!-- FAQ -->
- <li><a href="/faq.html">FAQ</a></li>
-
-
- <!-- Quickstart -->
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Quickstart <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html">Setup</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/run_example_quickstart.html">Example: Wikipedia Edit Stream</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html">Java API</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/scala_api_quickstart.html">Scala API</a></li>
- </ul>
- </li>
-
- <!-- Documentation -->
- <li class="dropdown">
- <a href="" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false"><small><span class="glyphicon glyphicon-new-window"></span></small> Documentation <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Latest stable release -->
- <li role="presentation" class="dropdown-header"><strong>Latest Release</strong> (Stable)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0">1.0 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/java" class="active">1.0 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-release-1.0/api/scala/index.html" class="active">1.0 ScalaDocs</a></li>
-
- <!-- Snapshot docs -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Snapshot</strong> (Development)</li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master">1.1 Documentation</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/java" class="active">1.1 Javadocs</a></li>
- <li><a href="http://ci.apache.org/projects/flink/flink-docs-master/api/scala/index.html" class="active">1.1 ScalaDocs</a></li>
-
- <!-- Wiki -->
- <li class="divider"></li>
- <li><a href="/visualizer/"><small><span class="glyphicon glyphicon-new-window"></span></small> Plan Visualizer</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
-
- </ul>
-
- <ul class="nav navbar-nav navbar-right">
- <!-- Blog -->
- <li class=" active hidden-md hidden-sm"><a href="/blog/">Blog</a></li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Community <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Community -->
- <li role="presentation" class="dropdown-header"><strong>Community</strong></li>
- <li><a href="/community.html#mailing-lists">Mailing Lists</a></li>
- <li><a href="/community.html#irc">IRC</a></li>
- <li><a href="/community.html#stack-overflow">Stack Overflow</a></li>
- <li><a href="/community.html#issue-tracker">Issue Tracker</a></li>
- <li><a href="/community.html#third-party-packages">Third Party Packages</a></li>
- <li><a href="/community.html#source-code">Source Code</a></li>
- <li><a href="/community.html#people">People</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink"><small><span class="glyphicon glyphicon-new-window"></span></small> Powered by Flink</a></li>
-
- <!-- Contribute -->
- <li class="divider"></li>
- <li role="presentation" class="dropdown-header"><strong>Contribute</strong></li>
- <li><a href="/how-to-contribute.html">How to Contribute</a></li>
- <li><a href="/contribute-code.html">Contribute Code</a></li>
- <li><a href="/contribute-documentation.html">Contribute Documentation</a></li>
- <li><a href="/improve-website.html">Improve the Website</a></li>
- </ul>
- </li>
-
- <li class="dropdown hidden-md hidden-sm">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-expanded="false">Project <span class="caret"></span></a>
- <ul class="dropdown-menu" role="menu">
- <!-- Project -->
- <li role="presentation" class="dropdown-header"><strong>Project</strong></li>
- <li><a href="/slides.html">Slides</a></li>
- <li><a href="/material.html">Material</a></li>
- <li><a href="https://twitter.com/apacheflink"><small><span class="glyphicon glyphicon-new-window"></span></small> Twitter</a></li>
- <li><a href="https://github.com/apache/flink"><small><span class="glyphicon glyphicon-new-window"></span></small> GitHub</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"><small><span class="glyphicon glyphicon-new-window"></span></small> Wiki</a></li>
- </ul>
- </li>
- </ul>
- </div><!-- /.navbar-collapse -->
- </div><!-- /.container -->
- </nav>
-
-
- <!-- Main content. -->
- <div class="container">
-
-
-<div class="row">
- <div class="col-sm-8 col-sm-offset-2">
- <div class="row">
- <h1>Stratosphere got accepted to the Hadoop Summit Europe in Amsterdam</h1>
-
- <article>
- <p>10 Jan 2014</p>
-
-<p>The Stratosphere team is proud to announce that it is going to present at the <a href="http://hadoopsummit.org/amsterdam/">Hadoop Summit 2014 in Amsterdam</a> on April 2-3. Our talk “Big Data looks tiny from Stratosphere” is part of the “Future of Hadoop” Track. The talk abstract already made it into the top 5 in the <a href="https://hadoopsummit.uservoice.com/forums/196822-future-of-apache-hadoop/filters/top">Community Vote</a> that took place by the end of last year.</p>
-
-
- </article>
- </div>
-
- <div class="row">
- <div id="disqus_thread"></div>
- <script type="text/javascript">
- /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
- var disqus_shortname = 'stratosphere-eu'; // required: replace example with your forum shortname
-
- /* * * DON'T EDIT BELOW THIS LINE * * */
- (function() {
- var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
- dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js';
- (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
- })();
- </script>
- </div>
- </div>
-</div>
-
- <hr />
- <div class="footer text-center">
- <p>Copyright © 2014-2015 <a href="http://apache.org">The Apache Software Foundation</a>. All Rights Reserved.</p>
- <p>Apache Flink, Apache, and the Apache feather logo are trademarks of The Apache Software Foundation.</p>
- <p><a href="/privacy-policy.html">Privacy Policy</a> · <a href="/blog/feed.xml">RSS feed</a></p>
- </div>
-
- </div><!-- /.container -->
-
- <!-- Include all compiled plugins (below), or include individual files as needed -->
- <script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script>
- <script src="/js/codetabs.js"></script>
-
- <!-- Google Analytics -->
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-52545728-1', 'auto');
- ga('send', 'pageview');
- </script>
- </body>
-</html>