You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@flink.apache.org by se...@apache.org on 2014/11/17 13:31:23 UTC
[1/2] incubator-flink git commit: [docs] Add description of
Quasiquotes compiler plugin in Eclipse to FAQ
Repository: incubator-flink
Updated Branches:
refs/heads/master 8a955e519 -> e23874cd8
[docs] Add description of Quasiquotes compiler plugin in Eclipse to FAQ
Project: http://git-wip-us.apache.org/repos/asf/incubator-flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-flink/commit/922f4788
Tree: http://git-wip-us.apache.org/repos/asf/incubator-flink/tree/922f4788
Diff: http://git-wip-us.apache.org/repos/asf/incubator-flink/diff/922f4788
Branch: refs/heads/master
Commit: 922f4788d121875286c9e47d98ef5399a8ed9910
Parents: 8a955e5
Author: Stephan Ewen <se...@apache.org>
Authored: Mon Nov 17 12:38:28 2014 +0100
Committer: Stephan Ewen <se...@apache.org>
Committed: Mon Nov 17 12:38:28 2014 +0100
----------------------------------------------------------------------
docs/faq.md | 16 +++++++++++++---
1 file changed, 13 insertions(+), 3 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-flink/blob/922f4788/docs/faq.md
----------------------------------------------------------------------
diff --git a/docs/faq.md b/docs/faq.md
index a62649d..36d7690 100644
--- a/docs/faq.md
+++ b/docs/faq.md
@@ -95,9 +95,6 @@ As a rule-of-thumb, the number of buffers should be at least
### My job fails early with a java.io.EOFException. What could be the cause?
-Note: In version _0.4_, the delta iterations limit the solution set to
-records with fixed-length data types. We will in the next version.
-
The most common case for these exception is when Flink is set up with the
wrong HDFS version. Because different HDFS versions are often not compatible
with each other, the connection between the filesystem master and the client
@@ -121,6 +118,18 @@ Please refer to the [download page]({{site.baseurl}}/downloads.html#maven) and
the {% gh_link README.md master "build instructions" %}
for details on how to set up Flink for different Hadoop and HDFS versions.
+### In Eclipse, I get compilation errors in the Scala projects
+
+Flink uses a new feature of the Scala compiler (called "quasiquotes") that have not yet been properly
+integrated with the Eclipse Scala plugin. In order to make this feature available in Eclipse, you
+need to manually configure the *flink-scala* project to use a *compiler plugin*:
+
+- Right click on *flink-scala* and choose "Properties"
+- Select "Scala Compiler" and click on the "Advanced" tab. (If you do not have that, you probably have not set up Eclipse for Scala properly.)
+- Check the box "Use Project Settings"
+- In the field "Xplugin", put the path "/home/<user-name>/.m2/repository/org/scalamacros/paradise_2.10.4/2.0.1/paradise_2.10.4-2.0.1.jar"
+- NOTE: You have to build Flink with Maven on the command line first, to make sure the plugin is downloaded.
+
### My program does not compute the correct result. Why are my custom key types
are not grouped/joined correctly?
@@ -300,3 +309,4 @@ open source project in the next versions.
Flink has a {% gh_link /flink-core/src/main/java/org/apache/flink/api/common/cache/DistributedCache.java "Distributed Cache" %} that is deeply integrated with the APIs. Please refer to the {% gh_link /flink-java/src/main/java/org/apache/flink/api/java/ExecutionEnvironment.java#L561 "JavaDocs" %} for details on how to use it.
In order to make data sets available on all tasks, we encourage you to use [Broadcast Variables](java_api_guide.html#broadcast_variables) instead. They are more efficient and easier to use than the distributed cache.
+
[2/2] incubator-flink git commit: [FLINK-1242] Fix streaming-examples
and scala-examples POMs to work properly with Eclipse
Posted by se...@apache.org.
[FLINK-1242] Fix streaming-examples and scala-examples POMs to work properly with Eclipse
Project: http://git-wip-us.apache.org/repos/asf/incubator-flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-flink/commit/e23874cd
Tree: http://git-wip-us.apache.org/repos/asf/incubator-flink/tree/e23874cd
Diff: http://git-wip-us.apache.org/repos/asf/incubator-flink/diff/e23874cd
Branch: refs/heads/master
Commit: e23874cd886711d4a0c2812562e20719cc35ebb4
Parents: 922f478
Author: Stephan Ewen <se...@apache.org>
Authored: Mon Nov 17 12:49:05 2014 +0100
Committer: Stephan Ewen <se...@apache.org>
Committed: Mon Nov 17 12:49:05 2014 +0100
----------------------------------------------------------------------
.../flink-streaming-examples/pom.xml | 83 +++++++++++++------
flink-examples/flink-scala-examples/pom.xml | 84 +++++++++++++-------
2 files changed, 114 insertions(+), 53 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-flink/blob/e23874cd/flink-addons/flink-streaming/flink-streaming-examples/pom.xml
----------------------------------------------------------------------
diff --git a/flink-addons/flink-streaming/flink-streaming-examples/pom.xml b/flink-addons/flink-streaming/flink-streaming-examples/pom.xml
index 20e1500..04cdf52 100644
--- a/flink-addons/flink-streaming/flink-streaming-examples/pom.xml
+++ b/flink-addons/flink-streaming/flink-streaming-examples/pom.xml
@@ -59,32 +59,32 @@ under the License.
<!-- get default data from flink-java-examples package -->
<plugin>
- <groupId>org.apache.maven.plugins</groupId>
- <artifactId>maven-dependency-plugin</artifactId>
- <version>2.9</version>
- <executions>
- <execution>
- <id>unpack</id>
- <phase>prepare-package</phase>
- <goals>
- <goal>unpack</goal>
- </goals>
- <configuration>
- <artifactItems>
- <artifactItem>
- <groupId>org.apache.flink</groupId>
- <artifactId>flink-java-examples</artifactId>
- <version>${project.version}</version>
- <type>jar</type>
- <overWrite>false</overWrite>
- <outputDirectory>${project.build.directory}/classes</outputDirectory>
- <includes>org/apache/flink/examples/java/wordcount/util/WordCountData.class</includes>
- </artifactItem>
- </artifactItems>
- </configuration>
- </execution>
- </executions>
- </plugin>
+ <groupId>org.apache.maven.plugins</groupId>
+ <artifactId>maven-dependency-plugin</artifactId>
+ <version>2.9</version><!--$NO-MVN-MAN-VER$-->
+ <executions>
+ <execution>
+ <id>unpack</id>
+ <phase>prepare-package</phase>
+ <goals>
+ <goal>unpack</goal>
+ </goals>
+ <configuration>
+ <artifactItems>
+ <artifactItem>
+ <groupId>org.apache.flink</groupId>
+ <artifactId>flink-java-examples</artifactId>
+ <version>${project.version}</version>
+ <type>jar</type>
+ <overWrite>false</overWrite>
+ <outputDirectory>${project.build.directory}/classes</outputDirectory>
+ <includes>org/apache/flink/examples/java/wordcount/util/WordCountData.class</includes>
+ </artifactItem>
+ </artifactItems>
+ </configuration>
+ </execution>
+ </executions>
+ </plugin>
<!-- self-contained jars for each example -->
<plugin>
@@ -232,6 +232,37 @@ under the License.
</executions>
</plugin>
</plugins>
+
+ <pluginManagement>
+ <plugins>
+ <!--This plugin's configuration is used to store Eclipse m2e settings only. It has no influence on the Maven build itself.-->
+ <plugin>
+ <groupId>org.eclipse.m2e</groupId>
+ <artifactId>lifecycle-mapping</artifactId>
+ <version>1.0.0</version>
+ <configuration>
+ <lifecycleMappingMetadata>
+ <pluginExecutions>
+ <pluginExecution>
+ <pluginExecutionFilter>
+ <groupId>org.apache.maven.plugins</groupId>
+ <artifactId>maven-dependency-plugin</artifactId>
+ <versionRange>[2.9,)</versionRange>
+ <goals>
+ <goal>unpack</goal>
+ </goals>
+ </pluginExecutionFilter>
+ <action>
+ <ignore/>
+ </action>
+ </pluginExecution>
+ </pluginExecutions>
+ </lifecycleMappingMetadata>
+ </configuration>
+ </plugin>
+ </plugins>
+ </pluginManagement>
+
</build>
</project>
http://git-wip-us.apache.org/repos/asf/incubator-flink/blob/e23874cd/flink-examples/flink-scala-examples/pom.xml
----------------------------------------------------------------------
diff --git a/flink-examples/flink-scala-examples/pom.xml b/flink-examples/flink-scala-examples/pom.xml
index ad058fc..e601099 100644
--- a/flink-examples/flink-scala-examples/pom.xml
+++ b/flink-examples/flink-scala-examples/pom.xml
@@ -172,32 +172,32 @@ under the License.
<!-- get default data from flink-java-examples package -->
<plugin>
- <groupId>org.apache.maven.plugins</groupId>
- <artifactId>maven-dependency-plugin</artifactId>
- <version>2.9</version>
- <executions>
- <execution>
- <id>unpack</id>
- <phase>prepare-package</phase>
- <goals>
- <goal>unpack</goal>
- </goals>
- <configuration>
- <artifactItems>
- <artifactItem>
- <groupId>org.apache.flink</groupId>
- <artifactId>flink-java-examples</artifactId>
- <version>${project.version}</version>
- <type>jar</type>
- <overWrite>false</overWrite>
- <outputDirectory>${project.build.directory}/classes</outputDirectory>
- <includes>**/util/*Data*.class</includes>
- </artifactItem>
- </artifactItems>
- </configuration>
- </execution>
- </executions>
- </plugin>
+ <groupId>org.apache.maven.plugins</groupId>
+ <artifactId>maven-dependency-plugin</artifactId>
+ <version>2.9</version><!--$NO-MVN-MAN-VER$-->
+ <executions>
+ <execution>
+ <id>unpack</id>
+ <phase>prepare-package</phase>
+ <goals>
+ <goal>unpack</goal>
+ </goals>
+ <configuration>
+ <artifactItems>
+ <artifactItem>
+ <groupId>org.apache.flink</groupId>
+ <artifactId>flink-java-examples</artifactId>
+ <version>${project.version}</version>
+ <type>jar</type>
+ <overWrite>false</overWrite>
+ <outputDirectory>${project.build.directory}/classes</outputDirectory>
+ <includes>**/util/*Data*.class</includes>
+ </artifactItem>
+ </artifactItems>
+ </configuration>
+ </execution>
+ </executions>
+ </plugin>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
@@ -450,8 +450,38 @@ under the License.
</executions>
</plugin>
-
</plugins>
+
+ <pluginManagement>
+ <plugins>
+ <!-- This plugin's configuration is used to store Eclipse m2e settings only.
+ It has no influence on the Maven build itself and simply suppresses errors in Eclipse.-->
+ <plugin>
+ <groupId>org.eclipse.m2e</groupId>
+ <artifactId>lifecycle-mapping</artifactId>
+ <version>1.0.0</version>
+ <configuration>
+ <lifecycleMappingMetadata>
+ <pluginExecutions>
+ <pluginExecution>
+ <pluginExecutionFilter>
+ <groupId>org.apache.maven.plugins</groupId>
+ <artifactId>maven-dependency-plugin</artifactId>
+ <versionRange>[2.9,)</versionRange>
+ <goals>
+ <goal>unpack</goal>
+ </goals>
+ </pluginExecutionFilter>
+ <action>
+ <ignore/>
+ </action>
+ </pluginExecution>
+ </pluginExecutions>
+ </lifecycleMappingMetadata>
+ </configuration>
+ </plugin>
+ </plugins>
+ </pluginManagement>
</build>
</project>