You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@flink.apache.org by sj...@apache.org on 2020/07/08 21:11:25 UTC
[flink-playgrounds] branch master updated (19e8305 -> a18385d)
This is an automated email from the ASF dual-hosted git repository.
sjwiesman pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink-playgrounds.git.
from 19e8305 [FLINK-18194][walkthroughs] Add table api walkthrough skeleton code
add a93fd44 [FLINK-18498] Update operations playground for Flink 1.11
new a18385d [FLINK-18498] Update table walkthrough for Flink 1.11.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
README.md | 8 ++--
docker/ops-playground-image/Dockerfile | 2 +-
.../java/flink-playground-clickcountjob/pom.xml | 4 +-
operations-playground/README.md | 2 +-
operations-playground/conf/flink-conf.yaml | 3 +-
operations-playground/conf/log4j-cli.properties | 47 ++++++++++++++--------
.../conf/log4j-console.properties | 43 +++++++++++++++-----
operations-playground/docker-compose.yaml | 8 ++--
table-walkthrough/Dockerfile | 17 +++-----
table-walkthrough/docker-compose.yml | 2 +-
table-walkthrough/pom.xml | 2 +-
11 files changed, 85 insertions(+), 53 deletions(-)
[flink-playgrounds] 01/01: [FLINK-18498] Update table walkthrough
for Flink 1.11.
Posted by sj...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
sjwiesman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/flink-playgrounds.git
commit a18385d7202f39cd3eb5e4ae7c0c91fdb6243c2c
Author: David Anderson <da...@alpinegizmo.com>
AuthorDate: Wed Jul 8 14:43:21 2020 +0200
[FLINK-18498] Update table walkthrough for Flink 1.11.
This closes #15
---
README.md | 2 +-
table-walkthrough/Dockerfile | 17 +++++------------
table-walkthrough/docker-compose.yml | 2 +-
table-walkthrough/pom.xml | 2 +-
4 files changed, 8 insertions(+), 15 deletions(-)
diff --git a/README.md b/README.md
index ace4ffa..1b6b5f6 100644
--- a/README.md
+++ b/README.md
@@ -13,7 +13,7 @@ Currently, the following playgrounds are available:
Flink job. The playground is presented in detail in
["Flink Operations Playground"](https://ci.apache.org/projects/flink/flink-docs-release-1.11/try-flink/flink-operations-playground.html), which is part of the _Try Flink_ section of the Flink documentation.
-* The interactive SQL playground is still under development and will be added shortly.
+* The **Table Walkthrough** (in the `table-walkthrough` folder) shows to use the Table API to build an analytics pipeline that reads streaming data from Kafka and writes results to MySQL, along with a real-time dashboard in Grafana. The walkthrough is presented in detail in ["Real Time Reporting with the Table API"](https://ci.apache.org/projects/flink/flink-docs-release-1.11/try-flink/table_api.html), which is part of the _Try Flink_ section of the Flink documentation.
## About
diff --git a/table-walkthrough/Dockerfile b/table-walkthrough/Dockerfile
index 86cf2df..9210b4d 100644
--- a/table-walkthrough/Dockerfile
+++ b/table-walkthrough/Dockerfile
@@ -22,20 +22,13 @@ COPY ./pom.xml /opt/pom.xml
COPY ./src /opt/src
RUN cd /opt; mvn clean install -Dmaven.test.skip
-FROM flink:1.11-SNAPSHOT-scala_2.11
-
-# Download connector libraries for snapshot version
-RUN wget -P /opt/flink/lib/ https://repository.apache.org/content/repositories/snapshots/org/apache/flink/flink-sql-connector-kafka_2.11/1.11-SNAPSHOT/flink-sql-connector-kafka_2.11-1.11-20200610.034108-152.jar; \
- wget -P /opt/flink/lib/ https://repository.apache.org/content/repositories/snapshots/org/apache/flink/flink-connector-jdbc_2.11/1.11-SNAPSHOT/flink-connector-jdbc_2.11-1.11-20200610.033814-8.jar; \
- wget -P /opt/flink/lib/ https://repository.apache.org/content/repositories/snapshots/org/apache/flink/flink-csv/1.11-SNAPSHOT/flink-csv-1.11-20200610.033438-153.jar; \
- wget -P /opt/flink/lib/ https://repo.maven.apache.org/maven2/mysql/mysql-connector-java/8.0.19/mysql-connector-java-8.0.19.jar;
-
+FROM flink:1.11.0-scala_2.11
# Download connector libraries
-#RUN wget -P /opt/flink/lib/ https://repo.maven.apache.org/maven2/org/apache/flink/flink-sql-connector-kafka_2.11/${FLINK_VERSION}/flink-sql-connector-kafka_2.11-${FLINK_VERSION}.jar; \
-# wget -P /opt/flink/lib/ https://repo.maven.apache.org/maven2/org/apache/flink/flink-jdbc_2.11/${FLINK_VERSION}/flink-jdbc_2.11-${FLINK_VERSION}.jar; \
-# wget -P /opt/flink/lib/ https://repo.maven.apache.org/maven2/org/apache/flink/flink-csv/${FLINK_VERSION}/flink-csv-${FLINK_VERSION}.jar; \
-# wget -P /opt/flink/lib/ https://repo.maven.apache.org/maven2/mysql/mysql-connector-java/8.0.19/mysql-connector-java-8.0.19.jar;
+RUN wget -P /opt/flink/lib/ https://repo.maven.apache.org/maven2/org/apache/flink/flink-sql-connector-kafka_2.11/1.11.0/flink-sql-connector-kafka_2.11-1.11.0.jar; \
+ wget -P /opt/flink/lib/ https://repo.maven.apache.org/maven2/org/apache/flink/flink-connector-jdbc_2.11/1.11.0/flink-connector-jdbc_2.11-1.11.0.jar; \
+ wget -P /opt/flink/lib/ https://repo.maven.apache.org/maven2/org/apache/flink/flink-csv/1.11.0/flink-csv-1.11.0.jar; \
+ wget -P /opt/flink/lib/ https://repo.maven.apache.org/maven2/mysql/mysql-connector-java/8.0.19/mysql-connector-java-8.0.19.jar;
COPY --from=builder /opt/target/spend-report-*.jar /opt/flink/usrlib/spend-report.jar
diff --git a/table-walkthrough/docker-compose.yml b/table-walkthrough/docker-compose.yml
index 2388af4..a3e232a 100644
--- a/table-walkthrough/docker-compose.yml
+++ b/table-walkthrough/docker-compose.yml
@@ -33,7 +33,7 @@ services:
- kafka
- mysql
taskmanager:
- image: apache/flink-playground-walkthrough:1-FLINK-1.11-scala_2.11
+ image: apache/flink-table-walkthrough:1-FLINK-1.11-scala_2.11
build: .
expose:
- "6121"
diff --git a/table-walkthrough/pom.xml b/table-walkthrough/pom.xml
index dda85c8..207fc51 100644
--- a/table-walkthrough/pom.xml
+++ b/table-walkthrough/pom.xml
@@ -30,7 +30,7 @@ under the License.
<properties>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
- <flink.version>1.11-SNAPSHOT</flink.version>
+ <flink.version>1.11.0</flink.version>
<java.version>1.8</java.version>
<scala.binary.version>2.11</scala.binary.version>
<maven.compiler.source>${java.version}</maven.compiler.source>