You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Konstantin Knauf <ko...@ververica.com> on 2019/10/06 16:40:02 UTC
[ANNOUNCE] Weekly Community Update 2019/40
Dear community,
happy to share this week's community update including Flink 1.9.1,
unaligned checkpoints, a new type inference system for UDFs in the Table
API and a bit more. Enjoy.
Flink Development
==============
* [releases] The vote for *Flink 1.9.1 RC1* has timed out without a vote. I
guess, Flink Forward Europe preparations in combination with Chinese
national holiday... [1]
* [runtime] Arvid has published a FLIP to support *unaligned checkpoints*.
Unaligned checkpoints could significantly reduce & stabilize checkpointing
times in high backpressure and high load scenarios and result in lower
latencies under checkpointing in general. [2]
* [runtime] Piotr has started a *survey *on dropping the *"non credit-based
flow control"-mode* in Flink's network stack. No replies so far. So, if you
are relying on it, now would be the time to raise your hand. [3]
* [logging] Gyula has started a discussion on adding *contextual
information* (taskmanager, container, job id) to *Flink's logs* and is
looking for feedback. [4]
* [sql] Timo has published FLIP-65, which proposes a *new type inference
mechanism for Table API* user-defined functions. It is based on three
levels of abstraction: automatic type inference, type hints via annotations
and manual declaration. [5]
* [code-style] Zili proposes to drop "final" from method parameters under
the assumption that all method parameters should be final anyway.
Discussion ongoing. [6]
[1]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/VOTE-Release-1-9-1-release-candidate-1-tp33637.html
[2]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-76-Unaligned-checkpoints-tp33651.html
[3]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/SURVEY-Dropping-non-Credit-based-Flow-Control-tp33714.html
[4]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Improve-Flink-logging-with-contextual-information-tp33729.html
[5]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-65-New-type-inference-for-Table-API-UDFs-tp33756.html
[6]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/CODE-STYLE-Parameters-of-method-are-always-final-tp33686.html
Notable Bugs
==========
Not a lot of action here, only 12 bug tickets updated this week.
* [FLINK-14315] [1.9.0] [1.8.3] A race condition in the JobManager
(JobMaster) can result in a NPE during Flink master failover. [7]
[7] https://issues.apache.org/jira/browse/FLINK-14315
Events, Blog Posts, Misc
===================
* *Parag Kesar* & *Ben Liu* of Pinterest have published a blog post on
their Flink-based real-time experimentation platform. [8]
* *Oran Hirsch* of DynamicYield describes their data architecture including
Apache Flink for stream processing in this recently published blogpost. [9]
* There will be full-day meetup with six talks in the Bangalore Kafka Group
on the 2nd of November including at least three Flink talks by *Timo Walter*
(Ververica), *Shashank Agarwal* (Razorpay) and *Rasyid Hakim* (GoJek). [10]
* *Flink Forward Europe *starts tomorrow in Berlin. Hope to see your there.
[]
[8]
https://medium.com/pinterest-engineering/real-time-experiment-analytics-at-pinterest-using-apache-flink-841c8df98dc2
[9] https://www.dynamicyield.com/blog/turning-messy-data-into-a-gold-mine/
[10] https://www.meetup.com/Bangalore-Apache-Kafka-Group/events/265285812/
[11] https://europe-2019.flink-forward.org
Cheers,
Konstantin (@snntrable)
--
Konstantin Knauf | Solutions Architect
+49 160 91394525
Follow us @VervericaData Ververica <https://www.ververica.com/>
--
Join Flink Forward <https://flink-forward.org/> - The Apache Flink
Conference
Stream Processing | Event Driven | Real Time
--
Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany
--
Ververica GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji
(Tony) Cheng