[ANNOUNCE] Apache Kafka 2.1.0

[Dong Lin <li...@apache.org>]

The Apache Kafka community is pleased to announce the release for Apache
Kafka 2.1.0


This is a major release and includes significant features from 28 KIPs. It
contains fixes and improvements from 179 JIRSs, including a few critical
bug fixes. Here is a summary of some notable changes

** Java 11 support
** Support for Zstandard, which achieves compression comparable to gzip
with higher compression and especially decompression speeds(KIP-110)
** Avoid expiring committed offsets for active consumer group (KIP-211)
** Provide Intuitive User Timeouts in The Producer (KIP-91)
** Kafka's replication protocol now supports improved fencing of zombies.
Previously, under certain rare conditions, if a broker became partitioned
from Zookeeper but not the rest of the cluster, then the logs of replicated
partitions could diverge and cause data loss in the worst case (KIP-320)
** Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353, KIP-356)
** Admin script and admin client API improvements to simplify admin
operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
** DNS handling improvements (KIP-235, KIP-302)


All of the changes in this release can be found in the release notes:
https://www.apache.org/dist/kafka/2.1.0/RELEASE_NOTES.html


You can download the source and binary release (Scala <VERSIONS>) from:
https://kafka.apache.org/downloads#2.1.0

---------------------------------------------------------------------------------------------------


Apache Kafka is a distributed streaming platform with four core APIs:


** The Producer API allows an application to publish a stream records to
one or more Kafka topics.

** The Consumer API allows an application to subscribe to one or more
topics and process the stream of records produced to them.

** The Streams API allows an application to act as a stream processor,
consuming an input stream from one or more topics and producing an
output stream to one or more output topics, effectively transforming the
input streams to output streams.

** The Connector API allows building and running reusable producers or
consumers that connect Kafka topics to existing applications or data
systems. For example, a connector to a relational database might
capture every change to a table.


With these APIs, Kafka can be used for two broad classes of application:

** Building real-time streaming data pipelines that reliably get data
between systems or applications.

** Building real-time streaming applications that transform or react
to the streams of data.


Apache Kafka is in use at large and small companies worldwide, including
Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank,
Target, The New York Times, Uber, Yelp, and Zalando, among others.

A big thank you for the following 100 contributors to this release!

Ahmed Al Mehdi, Aleksei Izmalkin, Alex Dunayevsky, Amit Sela, Andras
Katona, Andy Coates, Anna Povzner, Arjun Satish, Attila Sasvari, Aviem Zur,
Bibin Sebastian, Bill Bejeck, Bob Barrett, Brandon Kirchner, Bridger
Howell, Chia-Ping Tsai, Colin Hicks, Colin Patrick McCabe, Dhruvil Shah,
Dong Lin, Edoardo Comar, Eugen Feller, Ewen Cheslack-Postava, Filipe
Agapito, Flavien Raynaud, Gantigmaa Selenge, Gardner Vickers, Gitomain,
Gunnar Morling, Guozhang Wang, hashangayasri, huxi, huxihx, Ismael Juma,
Jagadesh Adireddi, Jason Gustafson, Jim Galasyn, Jimin Hsieh, Jimmy Casey,
Joan Goyeau, John Roesler, Jon Lee, jonathanskrzypek, Jun Rao, Kamal
Chandraprakash, Kevin Lafferty, Kevin Lu, Koen De Groote, Konstantine
Karantasis, lambdaliu, Lee Dongjin, Lincong Li, Liquan Pei, lucapette,
Lucas Wang, Maciej Bryński, Magesh Nandakumar, Manikumar Reddy, Manikumar
Reddy O, Mario Molina, Marko Stanković, Matthias J. Sax, Matthias
Wessendorf, Max Zheng, Mayank Tankhiwale, mgharat, Michal Dziemianko,
Michał Borowiecki, Mickael Maison, Mutasem Aldmour, Nikolay, nixsticks,
nprad, okumin, Radai Rosenblatt, radai-rosenblatt, Rajini Sivaram, Randall
Hauch, Robert Yokota, Rohan, Ron Dagostino, Sam Lendle, Sandor Murakozi,
Simon Clark, Stanislav Kozlovski, Stephane Maarek, Sébastien Launay, Sönke
Liebau, Ted Yu, uncleGen, Vahid Hashemian, Viktor Somogyi, wangshao,
xinzhg, Xiongqi Wesley Wu, Xiongqi Wu, ying-zheng, Yishun Guan, Yu Yang,
Zhanxiang (Patrick) Huang

We welcome your help and feedback. For more information on how to
report problems, and to get involved, visit the project website at
https://kafka.apache.org/

Thank you!

Regards,
Dong

Re: [ANNOUNCE] Apache Kafka 2.1.0

[Mickael Maison <mi...@gmail.com>]

Great! Thanks Dong for running the release
On Wed, Nov 21, 2018 at 6:09 PM Dong Lin <li...@apache.org> wrote:
>
> The Apache Kafka community is pleased to announce the release for Apache
> Kafka 2.1.0
>
>
> This is a major release and includes significant features from 28 KIPs. It
> contains fixes and improvements from 179 JIRSs, including a few critical
> bug fixes. Here is a summary of some notable changes
>
> ** Java 11 support
> ** Support for Zstandard, which achieves compression comparable to gzip
> with higher compression and especially decompression speeds(KIP-110)
> ** Avoid expiring committed offsets for active consumer group (KIP-211)
> ** Provide Intuitive User Timeouts in The Producer (KIP-91)
> ** Kafka's replication protocol now supports improved fencing of zombies.
> Previously, under certain rare conditions, if a broker became partitioned
> from Zookeeper but not the rest of the cluster, then the logs of replicated
> partitions could diverge and cause data loss in the worst case (KIP-320)
> ** Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353, KIP-356)
> ** Admin script and admin client API improvements to simplify admin
> operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
> ** DNS handling improvements (KIP-235, KIP-302)
>
>
> All of the changes in this release can be found in the release notes:
> https://www.apache.org/dist/kafka/2.1.0/RELEASE_NOTES.html
>
>
> You can download the source and binary release (Scala <VERSIONS>) from:
> https://kafka.apache.org/downloads#2.1.0
>
> ---------------------------------------------------------------------------------------------------
>
>
> Apache Kafka is a distributed streaming platform with four core APIs:
>
>
> ** The Producer API allows an application to publish a stream records to
> one or more Kafka topics.
>
> ** The Consumer API allows an application to subscribe to one or more
> topics and process the stream of records produced to them.
>
> ** The Streams API allows an application to act as a stream processor,
> consuming an input stream from one or more topics and producing an
> output stream to one or more output topics, effectively transforming the
> input streams to output streams.
>
> ** The Connector API allows building and running reusable producers or
> consumers that connect Kafka topics to existing applications or data
> systems. For example, a connector to a relational database might
> capture every change to a table.
>
>
> With these APIs, Kafka can be used for two broad classes of application:
>
> ** Building real-time streaming data pipelines that reliably get data
> between systems or applications.
>
> ** Building real-time streaming applications that transform or react
> to the streams of data.
>
>
> Apache Kafka is in use at large and small companies worldwide, including
> Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank,
> Target, The New York Times, Uber, Yelp, and Zalando, among others.
>
> A big thank you for the following 100 contributors to this release!
>
> Ahmed Al Mehdi, Aleksei Izmalkin, Alex Dunayevsky, Amit Sela, Andras
> Katona, Andy Coates, Anna Povzner, Arjun Satish, Attila Sasvari, Aviem Zur,
> Bibin Sebastian, Bill Bejeck, Bob Barrett, Brandon Kirchner, Bridger
> Howell, Chia-Ping Tsai, Colin Hicks, Colin Patrick McCabe, Dhruvil Shah,
> Dong Lin, Edoardo Comar, Eugen Feller, Ewen Cheslack-Postava, Filipe
> Agapito, Flavien Raynaud, Gantigmaa Selenge, Gardner Vickers, Gitomain,
> Gunnar Morling, Guozhang Wang, hashangayasri, huxi, huxihx, Ismael Juma,
> Jagadesh Adireddi, Jason Gustafson, Jim Galasyn, Jimin Hsieh, Jimmy Casey,
> Joan Goyeau, John Roesler, Jon Lee, jonathanskrzypek, Jun Rao, Kamal
> Chandraprakash, Kevin Lafferty, Kevin Lu, Koen De Groote, Konstantine
> Karantasis, lambdaliu, Lee Dongjin, Lincong Li, Liquan Pei, lucapette,
> Lucas Wang, Maciej Bryński, Magesh Nandakumar, Manikumar Reddy, Manikumar
> Reddy O, Mario Molina, Marko Stanković, Matthias J. Sax, Matthias
> Wessendorf, Max Zheng, Mayank Tankhiwale, mgharat, Michal Dziemianko,
> Michał Borowiecki, Mickael Maison, Mutasem Aldmour, Nikolay, nixsticks,
> nprad, okumin, Radai Rosenblatt, radai-rosenblatt, Rajini Sivaram, Randall
> Hauch, Robert Yokota, Rohan, Ron Dagostino, Sam Lendle, Sandor Murakozi,
> Simon Clark, Stanislav Kozlovski, Stephane Maarek, Sébastien Launay, Sönke
> Liebau, Ted Yu, uncleGen, Vahid Hashemian, Viktor Somogyi, wangshao,
> xinzhg, Xiongqi Wesley Wu, Xiongqi Wu, ying-zheng, Yishun Guan, Yu Yang,
> Zhanxiang (Patrick) Huang
>
> We welcome your help and feedback. For more information on how to
> report problems, and to get involved, visit the project website at
> https://kafka.apache.org/
>
> Thank you!
>
> Regards,
> Dong

Re: [ANNOUNCE] Apache Kafka 2.1.0

[Guozhang Wang <wa...@gmail.com>]

Thanks Dong for driving the release!!

Guozhang

On Wed, Nov 21, 2018 at 10:09 AM Dong Lin <li...@apache.org> wrote:

> The Apache Kafka community is pleased to announce the release for Apache
> Kafka 2.1.0
>
>
> This is a major release and includes significant features from 28 KIPs. It
> contains fixes and improvements from 179 JIRSs, including a few critical
> bug fixes. Here is a summary of some notable changes
>
> ** Java 11 support
> ** Support for Zstandard, which achieves compression comparable to gzip
> with higher compression and especially decompression speeds(KIP-110)
> ** Avoid expiring committed offsets for active consumer group (KIP-211)
> ** Provide Intuitive User Timeouts in The Producer (KIP-91)
> ** Kafka's replication protocol now supports improved fencing of zombies.
> Previously, under certain rare conditions, if a broker became partitioned
> from Zookeeper but not the rest of the cluster, then the logs of replicated
> partitions could diverge and cause data loss in the worst case (KIP-320)
> ** Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353, KIP-356)
> ** Admin script and admin client API improvements to simplify admin
> operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
> ** DNS handling improvements (KIP-235, KIP-302)
>
>
> All of the changes in this release can be found in the release notes:
> https://www.apache.org/dist/kafka/2.1.0/RELEASE_NOTES.html
>
>
> You can download the source and binary release (Scala <VERSIONS>) from:
> https://kafka.apache.org/downloads#2.1.0
>
>
> ---------------------------------------------------------------------------------------------------
>
>
> Apache Kafka is a distributed streaming platform with four core APIs:
>
>
> ** The Producer API allows an application to publish a stream records to
> one or more Kafka topics.
>
> ** The Consumer API allows an application to subscribe to one or more
> topics and process the stream of records produced to them.
>
> ** The Streams API allows an application to act as a stream processor,
> consuming an input stream from one or more topics and producing an
> output stream to one or more output topics, effectively transforming the
> input streams to output streams.
>
> ** The Connector API allows building and running reusable producers or
> consumers that connect Kafka topics to existing applications or data
> systems. For example, a connector to a relational database might
> capture every change to a table.
>
>
> With these APIs, Kafka can be used for two broad classes of application:
>
> ** Building real-time streaming data pipelines that reliably get data
> between systems or applications.
>
> ** Building real-time streaming applications that transform or react
> to the streams of data.
>
>
> Apache Kafka is in use at large and small companies worldwide, including
> Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank,
> Target, The New York Times, Uber, Yelp, and Zalando, among others.
>
> A big thank you for the following 100 contributors to this release!
>
> Ahmed Al Mehdi, Aleksei Izmalkin, Alex Dunayevsky, Amit Sela, Andras
> Katona, Andy Coates, Anna Povzner, Arjun Satish, Attila Sasvari, Aviem Zur,
> Bibin Sebastian, Bill Bejeck, Bob Barrett, Brandon Kirchner, Bridger
> Howell, Chia-Ping Tsai, Colin Hicks, Colin Patrick McCabe, Dhruvil Shah,
> Dong Lin, Edoardo Comar, Eugen Feller, Ewen Cheslack-Postava, Filipe
> Agapito, Flavien Raynaud, Gantigmaa Selenge, Gardner Vickers, Gitomain,
> Gunnar Morling, Guozhang Wang, hashangayasri, huxi, huxihx, Ismael Juma,
> Jagadesh Adireddi, Jason Gustafson, Jim Galasyn, Jimin Hsieh, Jimmy Casey,
> Joan Goyeau, John Roesler, Jon Lee, jonathanskrzypek, Jun Rao, Kamal
> Chandraprakash, Kevin Lafferty, Kevin Lu, Koen De Groote, Konstantine
> Karantasis, lambdaliu, Lee Dongjin, Lincong Li, Liquan Pei, lucapette,
> Lucas Wang, Maciej Bryński, Magesh Nandakumar, Manikumar Reddy, Manikumar
> Reddy O, Mario Molina, Marko Stanković, Matthias J. Sax, Matthias
> Wessendorf, Max Zheng, Mayank Tankhiwale, mgharat, Michal Dziemianko,
> Michał Borowiecki, Mickael Maison, Mutasem Aldmour, Nikolay, nixsticks,
> nprad, okumin, Radai Rosenblatt, radai-rosenblatt, Rajini Sivaram, Randall
> Hauch, Robert Yokota, Rohan, Ron Dagostino, Sam Lendle, Sandor Murakozi,
> Simon Clark, Stanislav Kozlovski, Stephane Maarek, Sébastien Launay, Sönke
> Liebau, Ted Yu, uncleGen, Vahid Hashemian, Viktor Somogyi, wangshao,
> xinzhg, Xiongqi Wesley Wu, Xiongqi Wu, ying-zheng, Yishun Guan, Yu Yang,
> Zhanxiang (Patrick) Huang
>
> We welcome your help and feedback. For more information on how to
> report problems, and to get involved, visit the project website at
> https://kafka.apache.org/
>
> Thank you!
>
> Regards,
> Dong
>


-- 
-- Guozhang

Re: [ANNOUNCE] Apache Kafka 2.1.0

[Dongjin Lee <do...@apache.org>]

Thanks for your great work, Dong!

And special thanks to Ismael and Jason for reviewing my PR! Without you,
KIP-110 never could be completed.

- Dongjin

On Thu, Nov 22, 2018 at 11:15 PM Craig Russell <ap...@gmail.com> wrote:

> Hi Kafka,
>
> Just a note that your download page has a link to the KEYS file at
> https://kafka.apache.org/KEYS
>
> The KEYS link should be https://www.apache.org/dist/kafka/KEYS for future
> announcements.
>
> Regards,
>
> Craig
>
> > On Nov 21, 2018, at 10:09 AM, Dong Lin <li...@apache.org> wrote:
> >
> > The Apache Kafka community is pleased to announce the release for Apache
> Kafka 2.1.0
> >
> >
> > This is a major release and includes significant features from 28 KIPs.
> It contains fixes and improvements from 179 JIRSs, including a few critical
> bug fixes. Here is a summary of some notable changes
> >
> > ** Java 11 support
> > ** Support for Zstandard, which achieves compression comparable to gzip
> with higher compression and especially decompression speeds(KIP-110)
> > ** Avoid expiring committed offsets for active consumer group (KIP-211)
> > ** Provide Intuitive User Timeouts in The Producer (KIP-91)
> > ** Kafka's replication protocol now supports improved fencing of
> zombies. Previously, under certain rare conditions, if a broker became
> partitioned from Zookeeper but not the rest of the cluster, then the logs
> of replicated partitions could diverge and cause data loss in the worst
> case (KIP-320)
> > ** Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353, KIP-356)
> > ** Admin script and admin client API improvements to simplify admin
> operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
> > ** DNS handling improvements (KIP-235, KIP-302)
> >
> >
> > All of the changes in this release can be found in the release notes:
> > https://www.apache.org/dist/kafka/2.1.0/RELEASE_NOTES.html <
> https://www.apache.org/dist/kafka/2.1.0/RELEASE_NOTES.html>
> >
> >
> > You can download the source and binary release (Scala <VERSIONS>) from:
> > https://kafka.apache.org/downloads#2.1.0 <
> https://kafka.apache.org/downloads#2.1.0>
> >
> >
> ---------------------------------------------------------------------------------------------------
> >
> >
> > Apache Kafka is a distributed streaming platform with four core APIs:
> >
> >
> > ** The Producer API allows an application to publish a stream records to
> > one or more Kafka topics.
> >
> > ** The Consumer API allows an application to subscribe to one or more
> > topics and process the stream of records produced to them.
> >
> > ** The Streams API allows an application to act as a stream processor,
> > consuming an input stream from one or more topics and producing an
> > output stream to one or more output topics, effectively transforming the
> > input streams to output streams.
> >
> > ** The Connector API allows building and running reusable producers or
> > consumers that connect Kafka topics to existing applications or data
> > systems. For example, a connector to a relational database might
> > capture every change to a table.
> >
> >
> > With these APIs, Kafka can be used for two broad classes of application:
> >
> > ** Building real-time streaming data pipelines that reliably get data
> > between systems or applications.
> >
> > ** Building real-time streaming applications that transform or react
> > to the streams of data.
> >
> >
> > Apache Kafka is in use at large and small companies worldwide, including
> > Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank,
> > Target, The New York Times, Uber, Yelp, and Zalando, among others.
> >
> > A big thank you for the following 100 contributors to this release!
> >
> > Ahmed Al Mehdi, Aleksei Izmalkin, Alex Dunayevsky, Amit Sela, Andras
> Katona, Andy Coates, Anna Povzner, Arjun Satish, Attila Sasvari, Aviem Zur,
> Bibin Sebastian, Bill Bejeck, Bob Barrett, Brandon Kirchner, Bridger
> Howell, Chia-Ping Tsai, Colin Hicks, Colin Patrick McCabe, Dhruvil Shah,
> Dong Lin, Edoardo Comar, Eugen Feller, Ewen Cheslack-Postava, Filipe
> Agapito, Flavien Raynaud, Gantigmaa Selenge, Gardner Vickers, Gitomain,
> Gunnar Morling, Guozhang Wang, hashangayasri, huxi, huxihx, Ismael Juma,
> Jagadesh Adireddi, Jason Gustafson, Jim Galasyn, Jimin Hsieh, Jimmy Casey,
> Joan Goyeau, John Roesler, Jon Lee, jonathanskrzypek, Jun Rao, Kamal
> Chandraprakash, Kevin Lafferty, Kevin Lu, Koen De Groote, Konstantine
> Karantasis, lambdaliu, Lee Dongjin, Lincong Li, Liquan Pei, lucapette,
> Lucas Wang, Maciej Bryński, Magesh Nandakumar, Manikumar Reddy, Manikumar
> Reddy O, Mario Molina, Marko Stanković, Matthias J. Sax, Matthias
> Wessendorf, Max Zheng, Mayank Tankhiwale, mgharat, Michal Dziemianko,
> Michał Borowiecki, Mickael Maison, Mutasem Aldmour, Nikolay, nixsticks,
> nprad, okumin, Radai Rosenblatt, radai-rosenblatt, Rajini Sivaram, Randall
> Hauch, Robert Yokota, Rohan, Ron Dagostino, Sam Lendle, Sandor Murakozi,
> Simon Clark, Stanislav Kozlovski, Stephane Maarek, Sébastien Launay, Sönke
> Liebau, Ted Yu, uncleGen, Vahid Hashemian, Viktor Somogyi, wangshao,
> xinzhg, Xiongqi Wesley Wu, Xiongqi Wu, ying-zheng, Yishun Guan, Yu Yang,
> Zhanxiang (Patrick) Huang
> >
> > We welcome your help and feedback. For more information on how to
> > report problems, and to get involved, visit the project website at
> > https://kafka.apache.org/ <https://kafka.apache.org/>
> >
> > Thank you!
> >
> > Regards,
> > Dong
>
> Craig L Russell
> Secretary, Apache Software Foundation
> clr@apache.org <ma...@apache.org> http://db.apache.org/jdo <
> http://db.apache.org/jdo>
>


-- 
*Dongjin Lee*

*A hitchhiker in the mathematical world.*
*github:  <http://goog_969573159/>github.com/dongjinleekr
<https://github.com/dongjinleekr>linkedin: kr.linkedin.com/in/dongjinleekr
<https://kr.linkedin.com/in/dongjinleekr>speakerdeck: speakerdeck.com/dongjin
<https://speakerdeck.com/dongjin>*

Re: [ANNOUNCE] Apache Kafka 2.1.0

[Dong Lin <li...@apache.org>]

Thanks everyone for the contribution and for verifying the release! I am
really happy to make contribution to Kafka community as well.

Hey Craig,

Thanks much for double checking the URL. You are right and
https://www.apache.org/dev/release-signing.html#keys-policy also suggests
to use https://www.apache.org/dist/kafka/KEYS for key link. It is updated
now.

Hey Mickael,

Thanks much for catching this. I misunderstood one step in the release
process. The issue is fixed now. I also lightly tuned the release process
wiki.

Have a great Thanksgiving holiday everyone!

Cheers,
Dong

On Thu, Nov 22, 2018 at 6:15 AM Craig Russell <ap...@gmail.com> wrote:

> Hi Kafka,
>
> Just a note that your download page has a link to the KEYS file at
> https://kafka.apache.org/KEYS
>
> The KEYS link should be https://www.apache.org/dist/kafka/KEYS for future
> announcements.
>
> Regards,
>
> Craig
>
> > On Nov 21, 2018, at 10:09 AM, Dong Lin <li...@apache.org> wrote:
> >
> > The Apache Kafka community is pleased to announce the release for Apache
> Kafka 2.1.0
> >
> >
> > This is a major release and includes significant features from 28 KIPs.
> It contains fixes and improvements from 179 JIRSs, including a few critical
> bug fixes. Here is a summary of some notable changes
> >
> > ** Java 11 support
> > ** Support for Zstandard, which achieves compression comparable to gzip
> with higher compression and especially decompression speeds(KIP-110)
> > ** Avoid expiring committed offsets for active consumer group (KIP-211)
> > ** Provide Intuitive User Timeouts in The Producer (KIP-91)
> > ** Kafka's replication protocol now supports improved fencing of
> zombies. Previously, under certain rare conditions, if a broker became
> partitioned from Zookeeper but not the rest of the cluster, then the logs
> of replicated partitions could diverge and cause data loss in the worst
> case (KIP-320)
> > ** Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353, KIP-356)
> > ** Admin script and admin client API improvements to simplify admin
> operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
> > ** DNS handling improvements (KIP-235, KIP-302)
> >
> >
> > All of the changes in this release can be found in the release notes:
> > https://www.apache.org/dist/kafka/2.1.0/RELEASE_NOTES.html <
> https://www.apache.org/dist/kafka/2.1.0/RELEASE_NOTES.html>
> >
> >
> > You can download the source and binary release (Scala <VERSIONS>) from:
> > https://kafka.apache.org/downloads#2.1.0 <
> https://kafka.apache.org/downloads#2.1.0>
> >
> >
> ---------------------------------------------------------------------------------------------------
> >
> >
> > Apache Kafka is a distributed streaming platform with four core APIs:
> >
> >
> > ** The Producer API allows an application to publish a stream records to
> > one or more Kafka topics.
> >
> > ** The Consumer API allows an application to subscribe to one or more
> > topics and process the stream of records produced to them.
> >
> > ** The Streams API allows an application to act as a stream processor,
> > consuming an input stream from one or more topics and producing an
> > output stream to one or more output topics, effectively transforming the
> > input streams to output streams.
> >
> > ** The Connector API allows building and running reusable producers or
> > consumers that connect Kafka topics to existing applications or data
> > systems. For example, a connector to a relational database might
> > capture every change to a table.
> >
> >
> > With these APIs, Kafka can be used for two broad classes of application:
> >
> > ** Building real-time streaming data pipelines that reliably get data
> > between systems or applications.
> >
> > ** Building real-time streaming applications that transform or react
> > to the streams of data.
> >
> >
> > Apache Kafka is in use at large and small companies worldwide, including
> > Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank,
> > Target, The New York Times, Uber, Yelp, and Zalando, among others.
> >
> > A big thank you for the following 100 contributors to this release!
> >
> > Ahmed Al Mehdi, Aleksei Izmalkin, Alex Dunayevsky, Amit Sela, Andras
> Katona, Andy Coates, Anna Povzner, Arjun Satish, Attila Sasvari, Aviem Zur,
> Bibin Sebastian, Bill Bejeck, Bob Barrett, Brandon Kirchner, Bridger
> Howell, Chia-Ping Tsai, Colin Hicks, Colin Patrick McCabe, Dhruvil Shah,
> Dong Lin, Edoardo Comar, Eugen Feller, Ewen Cheslack-Postava, Filipe
> Agapito, Flavien Raynaud, Gantigmaa Selenge, Gardner Vickers, Gitomain,
> Gunnar Morling, Guozhang Wang, hashangayasri, huxi, huxihx, Ismael Juma,
> Jagadesh Adireddi, Jason Gustafson, Jim Galasyn, Jimin Hsieh, Jimmy Casey,
> Joan Goyeau, John Roesler, Jon Lee, jonathanskrzypek, Jun Rao, Kamal
> Chandraprakash, Kevin Lafferty, Kevin Lu, Koen De Groote, Konstantine
> Karantasis, lambdaliu, Lee Dongjin, Lincong Li, Liquan Pei, lucapette,
> Lucas Wang, Maciej Bryński, Magesh Nandakumar, Manikumar Reddy, Manikumar
> Reddy O, Mario Molina, Marko Stanković, Matthias J. Sax, Matthias
> Wessendorf, Max Zheng, Mayank Tankhiwale, mgharat, Michal Dziemianko,
> Michał Borowiecki, Mickael Maison, Mutasem Aldmour, Nikolay, nixsticks,
> nprad, okumin, Radai Rosenblatt, radai-rosenblatt, Rajini Sivaram, Randall
> Hauch, Robert Yokota, Rohan, Ron Dagostino, Sam Lendle, Sandor Murakozi,
> Simon Clark, Stanislav Kozlovski, Stephane Maarek, Sébastien Launay, Sönke
> Liebau, Ted Yu, uncleGen, Vahid Hashemian, Viktor Somogyi, wangshao,
> xinzhg, Xiongqi Wesley Wu, Xiongqi Wu, ying-zheng, Yishun Guan, Yu Yang,
> Zhanxiang (Patrick) Huang
> >
> > We welcome your help and feedback. For more information on how to
> > report problems, and to get involved, visit the project website at
> > https://kafka.apache.org/ <https://kafka.apache.org/>
> >
> > Thank you!
> >
> > Regards,
> > Dong
>
> Craig L Russell
> Secretary, Apache Software Foundation
> clr@apache.org <ma...@apache.org> http://db.apache.org/jdo <
> http://db.apache.org/jdo>
>

Re: [ANNOUNCE] Apache Kafka 2.1.0

[Mickael Maison <mi...@gmail.com>]

Dong,

Links to the Javadocs in the documentation
(http://kafka.apache.org/documentation/#api) are broken.

For example, Consumer API links to
http://kafka.apache.org/21/javadoc/index.html?org/apache/kafka/clients/consumer/KafkaConsumer.html
which return 404
On Thu, Nov 22, 2018 at 2:15 PM Craig Russell <ap...@gmail.com> wrote:
>
> Hi Kafka,
>
> Just a note that your download page has a link to the KEYS file at https://kafka.apache.org/KEYS
>
> The KEYS link should be https://www.apache.org/dist/kafka/KEYS for future announcements.
>
> Regards,
>
> Craig
>
> > On Nov 21, 2018, at 10:09 AM, Dong Lin <li...@apache.org> wrote:
> >
> > The Apache Kafka community is pleased to announce the release for Apache Kafka 2.1.0
> >
> >
> > This is a major release and includes significant features from 28 KIPs. It contains fixes and improvements from 179 JIRSs, including a few critical bug fixes. Here is a summary of some notable changes
> >
> > ** Java 11 support
> > ** Support for Zstandard, which achieves compression comparable to gzip with higher compression and especially decompression speeds(KIP-110)
> > ** Avoid expiring committed offsets for active consumer group (KIP-211)
> > ** Provide Intuitive User Timeouts in The Producer (KIP-91)
> > ** Kafka's replication protocol now supports improved fencing of zombies. Previously, under certain rare conditions, if a broker became partitioned from Zookeeper but not the rest of the cluster, then the logs of replicated partitions could diverge and cause data loss in the worst case (KIP-320)
> > ** Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353, KIP-356)
> > ** Admin script and admin client API improvements to simplify admin operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
> > ** DNS handling improvements (KIP-235, KIP-302)
> >
> >
> > All of the changes in this release can be found in the release notes:
> > https://www.apache.org/dist/kafka/2.1.0/RELEASE_NOTES.html <https://www.apache.org/dist/kafka/2.1.0/RELEASE_NOTES.html>
> >
> >
> > You can download the source and binary release (Scala <VERSIONS>) from:
> > https://kafka.apache.org/downloads#2.1.0 <https://kafka.apache.org/downloads#2.1.0>
> >
> > ---------------------------------------------------------------------------------------------------
> >
> >
> > Apache Kafka is a distributed streaming platform with four core APIs:
> >
> >
> > ** The Producer API allows an application to publish a stream records to
> > one or more Kafka topics.
> >
> > ** The Consumer API allows an application to subscribe to one or more
> > topics and process the stream of records produced to them.
> >
> > ** The Streams API allows an application to act as a stream processor,
> > consuming an input stream from one or more topics and producing an
> > output stream to one or more output topics, effectively transforming the
> > input streams to output streams.
> >
> > ** The Connector API allows building and running reusable producers or
> > consumers that connect Kafka topics to existing applications or data
> > systems. For example, a connector to a relational database might
> > capture every change to a table.
> >
> >
> > With these APIs, Kafka can be used for two broad classes of application:
> >
> > ** Building real-time streaming data pipelines that reliably get data
> > between systems or applications.
> >
> > ** Building real-time streaming applications that transform or react
> > to the streams of data.
> >
> >
> > Apache Kafka is in use at large and small companies worldwide, including
> > Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank,
> > Target, The New York Times, Uber, Yelp, and Zalando, among others.
> >
> > A big thank you for the following 100 contributors to this release!
> >
> > Ahmed Al Mehdi, Aleksei Izmalkin, Alex Dunayevsky, Amit Sela, Andras Katona, Andy Coates, Anna Povzner, Arjun Satish, Attila Sasvari, Aviem Zur, Bibin Sebastian, Bill Bejeck, Bob Barrett, Brandon Kirchner, Bridger Howell, Chia-Ping Tsai, Colin Hicks, Colin Patrick McCabe, Dhruvil Shah, Dong Lin, Edoardo Comar, Eugen Feller, Ewen Cheslack-Postava, Filipe Agapito, Flavien Raynaud, Gantigmaa Selenge, Gardner Vickers, Gitomain, Gunnar Morling, Guozhang Wang, hashangayasri, huxi, huxihx, Ismael Juma, Jagadesh Adireddi, Jason Gustafson, Jim Galasyn, Jimin Hsieh, Jimmy Casey, Joan Goyeau, John Roesler, Jon Lee, jonathanskrzypek, Jun Rao, Kamal Chandraprakash, Kevin Lafferty, Kevin Lu, Koen De Groote, Konstantine Karantasis, lambdaliu, Lee Dongjin, Lincong Li, Liquan Pei, lucapette, Lucas Wang, Maciej Bryński, Magesh Nandakumar, Manikumar Reddy, Manikumar Reddy O, Mario Molina, Marko Stanković, Matthias J. Sax, Matthias Wessendorf, Max Zheng, Mayank Tankhiwale, mgharat, Michal Dziemianko, Michał Borowiecki, Mickael Maison, Mutasem Aldmour, Nikolay, nixsticks, nprad, okumin, Radai Rosenblatt, radai-rosenblatt, Rajini Sivaram, Randall Hauch, Robert Yokota, Rohan, Ron Dagostino, Sam Lendle, Sandor Murakozi, Simon Clark, Stanislav Kozlovski, Stephane Maarek, Sébastien Launay, Sönke Liebau, Ted Yu, uncleGen, Vahid Hashemian, Viktor Somogyi, wangshao, xinzhg, Xiongqi Wesley Wu, Xiongqi Wu, ying-zheng, Yishun Guan, Yu Yang, Zhanxiang (Patrick) Huang
> >
> > We welcome your help and feedback. For more information on how to
> > report problems, and to get involved, visit the project website at
> > https://kafka.apache.org/ <https://kafka.apache.org/>
> >
> > Thank you!
> >
> > Regards,
> > Dong
>
> Craig L Russell
> Secretary, Apache Software Foundation
> clr@apache.org <ma...@apache.org> http://db.apache.org/jdo <http://db.apache.org/jdo>

Re: [ANNOUNCE] Apache Kafka 2.1.0

[Craig Russell <ap...@gmail.com>]

Hi Kafka,

Just a note that your download page has a link to the KEYS file at https://kafka.apache.org/KEYS

The KEYS link should be https://www.apache.org/dist/kafka/KEYS for future announcements.

Regards,

Craig

> On Nov 21, 2018, at 10:09 AM, Dong Lin <li...@apache.org> wrote:
> 
> The Apache Kafka community is pleased to announce the release for Apache Kafka 2.1.0
> 
> 
> This is a major release and includes significant features from 28 KIPs. It contains fixes and improvements from 179 JIRSs, including a few critical bug fixes. Here is a summary of some notable changes
> 
> ** Java 11 support
> ** Support for Zstandard, which achieves compression comparable to gzip with higher compression and especially decompression speeds(KIP-110)
> ** Avoid expiring committed offsets for active consumer group (KIP-211)
> ** Provide Intuitive User Timeouts in The Producer (KIP-91)
> ** Kafka's replication protocol now supports improved fencing of zombies. Previously, under certain rare conditions, if a broker became partitioned from Zookeeper but not the rest of the cluster, then the logs of replicated partitions could diverge and cause data loss in the worst case (KIP-320)
> ** Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353, KIP-356)
> ** Admin script and admin client API improvements to simplify admin operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
> ** DNS handling improvements (KIP-235, KIP-302)
> 
> 
> All of the changes in this release can be found in the release notes:
> https://www.apache.org/dist/kafka/2.1.0/RELEASE_NOTES.html <https://www.apache.org/dist/kafka/2.1.0/RELEASE_NOTES.html>
> 
> 
> You can download the source and binary release (Scala <VERSIONS>) from:
> https://kafka.apache.org/downloads#2.1.0 <https://kafka.apache.org/downloads#2.1.0>
> 
> ---------------------------------------------------------------------------------------------------
> 
> 
> Apache Kafka is a distributed streaming platform with four core APIs:
> 
> 
> ** The Producer API allows an application to publish a stream records to
> one or more Kafka topics.
> 
> ** The Consumer API allows an application to subscribe to one or more
> topics and process the stream of records produced to them.
> 
> ** The Streams API allows an application to act as a stream processor,
> consuming an input stream from one or more topics and producing an
> output stream to one or more output topics, effectively transforming the
> input streams to output streams.
> 
> ** The Connector API allows building and running reusable producers or
> consumers that connect Kafka topics to existing applications or data
> systems. For example, a connector to a relational database might
> capture every change to a table.
> 
> 
> With these APIs, Kafka can be used for two broad classes of application:
> 
> ** Building real-time streaming data pipelines that reliably get data
> between systems or applications.
> 
> ** Building real-time streaming applications that transform or react
> to the streams of data.
> 
> 
> Apache Kafka is in use at large and small companies worldwide, including
> Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank,
> Target, The New York Times, Uber, Yelp, and Zalando, among others.
> 
> A big thank you for the following 100 contributors to this release!
> 
> Ahmed Al Mehdi, Aleksei Izmalkin, Alex Dunayevsky, Amit Sela, Andras Katona, Andy Coates, Anna Povzner, Arjun Satish, Attila Sasvari, Aviem Zur, Bibin Sebastian, Bill Bejeck, Bob Barrett, Brandon Kirchner, Bridger Howell, Chia-Ping Tsai, Colin Hicks, Colin Patrick McCabe, Dhruvil Shah, Dong Lin, Edoardo Comar, Eugen Feller, Ewen Cheslack-Postava, Filipe Agapito, Flavien Raynaud, Gantigmaa Selenge, Gardner Vickers, Gitomain, Gunnar Morling, Guozhang Wang, hashangayasri, huxi, huxihx, Ismael Juma, Jagadesh Adireddi, Jason Gustafson, Jim Galasyn, Jimin Hsieh, Jimmy Casey, Joan Goyeau, John Roesler, Jon Lee, jonathanskrzypek, Jun Rao, Kamal Chandraprakash, Kevin Lafferty, Kevin Lu, Koen De Groote, Konstantine Karantasis, lambdaliu, Lee Dongjin, Lincong Li, Liquan Pei, lucapette, Lucas Wang, Maciej Bryński, Magesh Nandakumar, Manikumar Reddy, Manikumar Reddy O, Mario Molina, Marko Stanković, Matthias J. Sax, Matthias Wessendorf, Max Zheng, Mayank Tankhiwale, mgharat, Michal Dziemianko, Michał Borowiecki, Mickael Maison, Mutasem Aldmour, Nikolay, nixsticks, nprad, okumin, Radai Rosenblatt, radai-rosenblatt, Rajini Sivaram, Randall Hauch, Robert Yokota, Rohan, Ron Dagostino, Sam Lendle, Sandor Murakozi, Simon Clark, Stanislav Kozlovski, Stephane Maarek, Sébastien Launay, Sönke Liebau, Ted Yu, uncleGen, Vahid Hashemian, Viktor Somogyi, wangshao, xinzhg, Xiongqi Wesley Wu, Xiongqi Wu, ying-zheng, Yishun Guan, Yu Yang, Zhanxiang (Patrick) Huang
> 
> We welcome your help and feedback. For more information on how to
> report problems, and to get involved, visit the project website at
> https://kafka.apache.org/ <https://kafka.apache.org/>
> 
> Thank you!
> 
> Regards,
> Dong

Craig L Russell
Secretary, Apache Software Foundation
clr@apache.org <ma...@apache.org> http://db.apache.org/jdo <http://db.apache.org/jdo>

Re: [ANNOUNCE] Apache Kafka 2.1.0

[Ismael Juma <is...@gmail.com>]

Thanks for running the release Dong and thanks to all who contributed to
the release!

Ismael

On Wed, Nov 21, 2018, 10:09 AM Dong Lin <lindong@apache.org wrote:

> The Apache Kafka community is pleased to announce the release for Apache
> Kafka 2.1.0
>
>
> This is a major release and includes significant features from 28 KIPs. It
> contains fixes and improvements from 179 JIRSs, including a few critical
> bug fixes. Here is a summary of some notable changes
>
> ** Java 11 support
> ** Support for Zstandard, which achieves compression comparable to gzip
> with higher compression and especially decompression speeds(KIP-110)
> ** Avoid expiring committed offsets for active consumer group (KIP-211)
> ** Provide Intuitive User Timeouts in The Producer (KIP-91)
> ** Kafka's replication protocol now supports improved fencing of zombies.
> Previously, under certain rare conditions, if a broker became partitioned
> from Zookeeper but not the rest of the cluster, then the logs of replicated
> partitions could diverge and cause data loss in the worst case (KIP-320)
> ** Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353, KIP-356)
> ** Admin script and admin client API improvements to simplify admin
> operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
> ** DNS handling improvements (KIP-235, KIP-302)
>
>
> All of the changes in this release can be found in the release notes:
> https://www.apache.org/dist/kafka/2.1.0/RELEASE_NOTES.html
>
>
> You can download the source and binary release (Scala <VERSIONS>) from:
> https://kafka.apache.org/downloads#2.1.0
>
>
> ---------------------------------------------------------------------------------------------------
>
>
> Apache Kafka is a distributed streaming platform with four core APIs:
>
>
> ** The Producer API allows an application to publish a stream records to
> one or more Kafka topics.
>
> ** The Consumer API allows an application to subscribe to one or more
> topics and process the stream of records produced to them.
>
> ** The Streams API allows an application to act as a stream processor,
> consuming an input stream from one or more topics and producing an
> output stream to one or more output topics, effectively transforming the
> input streams to output streams.
>
> ** The Connector API allows building and running reusable producers or
> consumers that connect Kafka topics to existing applications or data
> systems. For example, a connector to a relational database might
> capture every change to a table.
>
>
> With these APIs, Kafka can be used for two broad classes of application:
>
> ** Building real-time streaming data pipelines that reliably get data
> between systems or applications.
>
> ** Building real-time streaming applications that transform or react
> to the streams of data.
>
>
> Apache Kafka is in use at large and small companies worldwide, including
> Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank,
> Target, The New York Times, Uber, Yelp, and Zalando, among others.
>
> A big thank you for the following 100 contributors to this release!
>
> Ahmed Al Mehdi, Aleksei Izmalkin, Alex Dunayevsky, Amit Sela, Andras
> Katona, Andy Coates, Anna Povzner, Arjun Satish, Attila Sasvari, Aviem Zur,
> Bibin Sebastian, Bill Bejeck, Bob Barrett, Brandon Kirchner, Bridger
> Howell, Chia-Ping Tsai, Colin Hicks, Colin Patrick McCabe, Dhruvil Shah,
> Dong Lin, Edoardo Comar, Eugen Feller, Ewen Cheslack-Postava, Filipe
> Agapito, Flavien Raynaud, Gantigmaa Selenge, Gardner Vickers, Gitomain,
> Gunnar Morling, Guozhang Wang, hashangayasri, huxi, huxihx, Ismael Juma,
> Jagadesh Adireddi, Jason Gustafson, Jim Galasyn, Jimin Hsieh, Jimmy Casey,
> Joan Goyeau, John Roesler, Jon Lee, jonathanskrzypek, Jun Rao, Kamal
> Chandraprakash, Kevin Lafferty, Kevin Lu, Koen De Groote, Konstantine
> Karantasis, lambdaliu, Lee Dongjin, Lincong Li, Liquan Pei, lucapette,
> Lucas Wang, Maciej Bryński, Magesh Nandakumar, Manikumar Reddy, Manikumar
> Reddy O, Mario Molina, Marko Stanković, Matthias J. Sax, Matthias
> Wessendorf, Max Zheng, Mayank Tankhiwale, mgharat, Michal Dziemianko,
> Michał Borowiecki, Mickael Maison, Mutasem Aldmour, Nikolay, nixsticks,
> nprad, okumin, Radai Rosenblatt, radai-rosenblatt, Rajini Sivaram, Randall
> Hauch, Robert Yokota, Rohan, Ron Dagostino, Sam Lendle, Sandor Murakozi,
> Simon Clark, Stanislav Kozlovski, Stephane Maarek, Sébastien Launay, Sönke
> Liebau, Ted Yu, uncleGen, Vahid Hashemian, Viktor Somogyi, wangshao,
> xinzhg, Xiongqi Wesley Wu, Xiongqi Wu, ying-zheng, Yishun Guan, Yu Yang,
> Zhanxiang (Patrick) Huang
>
> We welcome your help and feedback. For more information on how to
> report problems, and to get involved, visit the project website at
> https://kafka.apache.org/
>
> Thank you!
>
> Regards,
> Dong
>

Re: [ANNOUNCE] Apache Kafka 2.1.0

[Ismael Juma <is...@gmail.com>]

Thanks for running the release Dong and thanks to all who contributed to
the release!

Ismael

On Wed, Nov 21, 2018, 10:09 AM Dong Lin <lindong@apache.org wrote:

> The Apache Kafka community is pleased to announce the release for Apache
> Kafka 2.1.0
>
>
> This is a major release and includes significant features from 28 KIPs. It
> contains fixes and improvements from 179 JIRSs, including a few critical
> bug fixes. Here is a summary of some notable changes
>
> ** Java 11 support
> ** Support for Zstandard, which achieves compression comparable to gzip
> with higher compression and especially decompression speeds(KIP-110)
> ** Avoid expiring committed offsets for active consumer group (KIP-211)
> ** Provide Intuitive User Timeouts in The Producer (KIP-91)
> ** Kafka's replication protocol now supports improved fencing of zombies.
> Previously, under certain rare conditions, if a broker became partitioned
> from Zookeeper but not the rest of the cluster, then the logs of replicated
> partitions could diverge and cause data loss in the worst case (KIP-320)
> ** Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353, KIP-356)
> ** Admin script and admin client API improvements to simplify admin
> operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
> ** DNS handling improvements (KIP-235, KIP-302)
>
>
> All of the changes in this release can be found in the release notes:
> https://www.apache.org/dist/kafka/2.1.0/RELEASE_NOTES.html
>
>
> You can download the source and binary release (Scala <VERSIONS>) from:
> https://kafka.apache.org/downloads#2.1.0
>
>
> ---------------------------------------------------------------------------------------------------
>
>
> Apache Kafka is a distributed streaming platform with four core APIs:
>
>
> ** The Producer API allows an application to publish a stream records to
> one or more Kafka topics.
>
> ** The Consumer API allows an application to subscribe to one or more
> topics and process the stream of records produced to them.
>
> ** The Streams API allows an application to act as a stream processor,
> consuming an input stream from one or more topics and producing an
> output stream to one or more output topics, effectively transforming the
> input streams to output streams.
>
> ** The Connector API allows building and running reusable producers or
> consumers that connect Kafka topics to existing applications or data
> systems. For example, a connector to a relational database might
> capture every change to a table.
>
>
> With these APIs, Kafka can be used for two broad classes of application:
>
> ** Building real-time streaming data pipelines that reliably get data
> between systems or applications.
>
> ** Building real-time streaming applications that transform or react
> to the streams of data.
>
>
> Apache Kafka is in use at large and small companies worldwide, including
> Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank,
> Target, The New York Times, Uber, Yelp, and Zalando, among others.
>
> A big thank you for the following 100 contributors to this release!
>
> Ahmed Al Mehdi, Aleksei Izmalkin, Alex Dunayevsky, Amit Sela, Andras
> Katona, Andy Coates, Anna Povzner, Arjun Satish, Attila Sasvari, Aviem Zur,
> Bibin Sebastian, Bill Bejeck, Bob Barrett, Brandon Kirchner, Bridger
> Howell, Chia-Ping Tsai, Colin Hicks, Colin Patrick McCabe, Dhruvil Shah,
> Dong Lin, Edoardo Comar, Eugen Feller, Ewen Cheslack-Postava, Filipe
> Agapito, Flavien Raynaud, Gantigmaa Selenge, Gardner Vickers, Gitomain,
> Gunnar Morling, Guozhang Wang, hashangayasri, huxi, huxihx, Ismael Juma,
> Jagadesh Adireddi, Jason Gustafson, Jim Galasyn, Jimin Hsieh, Jimmy Casey,
> Joan Goyeau, John Roesler, Jon Lee, jonathanskrzypek, Jun Rao, Kamal
> Chandraprakash, Kevin Lafferty, Kevin Lu, Koen De Groote, Konstantine
> Karantasis, lambdaliu, Lee Dongjin, Lincong Li, Liquan Pei, lucapette,
> Lucas Wang, Maciej Bryński, Magesh Nandakumar, Manikumar Reddy, Manikumar
> Reddy O, Mario Molina, Marko Stanković, Matthias J. Sax, Matthias
> Wessendorf, Max Zheng, Mayank Tankhiwale, mgharat, Michal Dziemianko,
> Michał Borowiecki, Mickael Maison, Mutasem Aldmour, Nikolay, nixsticks,
> nprad, okumin, Radai Rosenblatt, radai-rosenblatt, Rajini Sivaram, Randall
> Hauch, Robert Yokota, Rohan, Ron Dagostino, Sam Lendle, Sandor Murakozi,
> Simon Clark, Stanislav Kozlovski, Stephane Maarek, Sébastien Launay, Sönke
> Liebau, Ted Yu, uncleGen, Vahid Hashemian, Viktor Somogyi, wangshao,
> xinzhg, Xiongqi Wesley Wu, Xiongqi Wu, ying-zheng, Yishun Guan, Yu Yang,
> Zhanxiang (Patrick) Huang
>
> We welcome your help and feedback. For more information on how to
> report problems, and to get involved, visit the project website at
> https://kafka.apache.org/
>
> Thank you!
>
> Regards,
> Dong
>

Re: [ANNOUNCE] Apache Kafka 2.1.0

[Mickael Maison <mi...@gmail.com>]

Great! Thanks Dong for running the release
On Wed, Nov 21, 2018 at 6:09 PM Dong Lin <li...@apache.org> wrote:
>
> The Apache Kafka community is pleased to announce the release for Apache
> Kafka 2.1.0
>
>
> This is a major release and includes significant features from 28 KIPs. It
> contains fixes and improvements from 179 JIRSs, including a few critical
> bug fixes. Here is a summary of some notable changes
>
> ** Java 11 support
> ** Support for Zstandard, which achieves compression comparable to gzip
> with higher compression and especially decompression speeds(KIP-110)
> ** Avoid expiring committed offsets for active consumer group (KIP-211)
> ** Provide Intuitive User Timeouts in The Producer (KIP-91)
> ** Kafka's replication protocol now supports improved fencing of zombies.
> Previously, under certain rare conditions, if a broker became partitioned
> from Zookeeper but not the rest of the cluster, then the logs of replicated
> partitions could diverge and cause data loss in the worst case (KIP-320)
> ** Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353, KIP-356)
> ** Admin script and admin client API improvements to simplify admin
> operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
> ** DNS handling improvements (KIP-235, KIP-302)
>
>
> All of the changes in this release can be found in the release notes:
> https://www.apache.org/dist/kafka/2.1.0/RELEASE_NOTES.html
>
>
> You can download the source and binary release (Scala <VERSIONS>) from:
> https://kafka.apache.org/downloads#2.1.0
>
> ---------------------------------------------------------------------------------------------------
>
>
> Apache Kafka is a distributed streaming platform with four core APIs:
>
>
> ** The Producer API allows an application to publish a stream records to
> one or more Kafka topics.
>
> ** The Consumer API allows an application to subscribe to one or more
> topics and process the stream of records produced to them.
>
> ** The Streams API allows an application to act as a stream processor,
> consuming an input stream from one or more topics and producing an
> output stream to one or more output topics, effectively transforming the
> input streams to output streams.
>
> ** The Connector API allows building and running reusable producers or
> consumers that connect Kafka topics to existing applications or data
> systems. For example, a connector to a relational database might
> capture every change to a table.
>
>
> With these APIs, Kafka can be used for two broad classes of application:
>
> ** Building real-time streaming data pipelines that reliably get data
> between systems or applications.
>
> ** Building real-time streaming applications that transform or react
> to the streams of data.
>
>
> Apache Kafka is in use at large and small companies worldwide, including
> Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank,
> Target, The New York Times, Uber, Yelp, and Zalando, among others.
>
> A big thank you for the following 100 contributors to this release!
>
> Ahmed Al Mehdi, Aleksei Izmalkin, Alex Dunayevsky, Amit Sela, Andras
> Katona, Andy Coates, Anna Povzner, Arjun Satish, Attila Sasvari, Aviem Zur,
> Bibin Sebastian, Bill Bejeck, Bob Barrett, Brandon Kirchner, Bridger
> Howell, Chia-Ping Tsai, Colin Hicks, Colin Patrick McCabe, Dhruvil Shah,
> Dong Lin, Edoardo Comar, Eugen Feller, Ewen Cheslack-Postava, Filipe
> Agapito, Flavien Raynaud, Gantigmaa Selenge, Gardner Vickers, Gitomain,
> Gunnar Morling, Guozhang Wang, hashangayasri, huxi, huxihx, Ismael Juma,
> Jagadesh Adireddi, Jason Gustafson, Jim Galasyn, Jimin Hsieh, Jimmy Casey,
> Joan Goyeau, John Roesler, Jon Lee, jonathanskrzypek, Jun Rao, Kamal
> Chandraprakash, Kevin Lafferty, Kevin Lu, Koen De Groote, Konstantine
> Karantasis, lambdaliu, Lee Dongjin, Lincong Li, Liquan Pei, lucapette,
> Lucas Wang, Maciej Bryński, Magesh Nandakumar, Manikumar Reddy, Manikumar
> Reddy O, Mario Molina, Marko Stanković, Matthias J. Sax, Matthias
> Wessendorf, Max Zheng, Mayank Tankhiwale, mgharat, Michal Dziemianko,
> Michał Borowiecki, Mickael Maison, Mutasem Aldmour, Nikolay, nixsticks,
> nprad, okumin, Radai Rosenblatt, radai-rosenblatt, Rajini Sivaram, Randall
> Hauch, Robert Yokota, Rohan, Ron Dagostino, Sam Lendle, Sandor Murakozi,
> Simon Clark, Stanislav Kozlovski, Stephane Maarek, Sébastien Launay, Sönke
> Liebau, Ted Yu, uncleGen, Vahid Hashemian, Viktor Somogyi, wangshao,
> xinzhg, Xiongqi Wesley Wu, Xiongqi Wu, ying-zheng, Yishun Guan, Yu Yang,
> Zhanxiang (Patrick) Huang
>
> We welcome your help and feedback. For more information on how to
> report problems, and to get involved, visit the project website at
> https://kafka.apache.org/
>
> Thank you!
>
> Regards,
> Dong

Re: [ANNOUNCE] Apache Kafka 2.1.0

[Vahid Hashemian <va...@gmail.com>]

Awesome! Thank you Dong for running the release.

--Vahid

On Wed, Nov 21, 2018 at 1:00 PM Edoardo Comar <ed...@gmail.com> wrote:

> Bravo Dong!
> Thanks for managing the 2.1.0 release.
>
> Edo
> ____________________
> sent from my phone
>
> On Wed, 21 Nov 2018, 20:41 James Cheng <wushujames@gmail.com wrote:
>
> > Thanks Dong for running the release, and congrats to everyone in the
> > community!
> >
> > -James
> >
> > Sent from my iPhone
> >
> > > On Nov 21, 2018, at 10:09 AM, Dong Lin <li...@apache.org> wrote:
> > >
> > > The Apache Kafka community is pleased to announce the release for
> Apache
> > > Kafka 2.1.0
> > >
> > >
> > > This is a major release and includes significant features from 28 KIPs.
> > It
> > > contains fixes and improvements from 179 JIRSs, including a few
> critical
> > > bug fixes. Here is a summary of some notable changes
> > >
> > > ** Java 11 support
> > > ** Support for Zstandard, which achieves compression comparable to gzip
> > > with higher compression and especially decompression speeds(KIP-110)
> > > ** Avoid expiring committed offsets for active consumer group (KIP-211)
> > > ** Provide Intuitive User Timeouts in The Producer (KIP-91)
> > > ** Kafka's replication protocol now supports improved fencing of
> zombies.
> > > Previously, under certain rare conditions, if a broker became
> partitioned
> > > from Zookeeper but not the rest of the cluster, then the logs of
> > replicated
> > > partitions could diverge and cause data loss in the worst case
> (KIP-320)
> > > ** Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353,
> KIP-356)
> > > ** Admin script and admin client API improvements to simplify admin
> > > operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
> > > ** DNS handling improvements (KIP-235, KIP-302)
> > >
> > >
> > > All of the changes in this release can be found in the release notes:
> > > https://www.apache.org/dist/kafka/2.1.0/RELEASE_NOTES.html
> > >
> > >
> > > You can download the source and binary release (Scala <VERSIONS>) from:
> > > https://kafka.apache.org/downloads#2.1.0
> > >
> > >
> >
> ---------------------------------------------------------------------------------------------------
> > >
> > >
> > > Apache Kafka is a distributed streaming platform with four core APIs:
> > >
> > >
> > > ** The Producer API allows an application to publish a stream records
> to
> > > one or more Kafka topics.
> > >
> > > ** The Consumer API allows an application to subscribe to one or more
> > > topics and process the stream of records produced to them.
> > >
> > > ** The Streams API allows an application to act as a stream processor,
> > > consuming an input stream from one or more topics and producing an
> > > output stream to one or more output topics, effectively transforming
> the
> > > input streams to output streams.
> > >
> > > ** The Connector API allows building and running reusable producers or
> > > consumers that connect Kafka topics to existing applications or data
> > > systems. For example, a connector to a relational database might
> > > capture every change to a table.
> > >
> > >
> > > With these APIs, Kafka can be used for two broad classes of
> application:
> > >
> > > ** Building real-time streaming data pipelines that reliably get data
> > > between systems or applications.
> > >
> > > ** Building real-time streaming applications that transform or react
> > > to the streams of data.
> > >
> > >
> > > Apache Kafka is in use at large and small companies worldwide,
> including
> > > Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest,
> Rabobank,
> > > Target, The New York Times, Uber, Yelp, and Zalando, among others.
> > >
> > > A big thank you for the following 100 contributors to this release!
> > >
> > > Ahmed Al Mehdi, Aleksei Izmalkin, Alex Dunayevsky, Amit Sela, Andras
> > > Katona, Andy Coates, Anna Povzner, Arjun Satish, Attila Sasvari, Aviem
> > Zur,
> > > Bibin Sebastian, Bill Bejeck, Bob Barrett, Brandon Kirchner, Bridger
> > > Howell, Chia-Ping Tsai, Colin Hicks, Colin Patrick McCabe, Dhruvil
> Shah,
> > > Dong Lin, Edoardo Comar, Eugen Feller, Ewen Cheslack-Postava, Filipe
> > > Agapito, Flavien Raynaud, Gantigmaa Selenge, Gardner Vickers, Gitomain,
> > > Gunnar Morling, Guozhang Wang, hashangayasri, huxi, huxihx, Ismael
> Juma,
> > > Jagadesh Adireddi, Jason Gustafson, Jim Galasyn, Jimin Hsieh, Jimmy
> > Casey,
> > > Joan Goyeau, John Roesler, Jon Lee, jonathanskrzypek, Jun Rao, Kamal
> > > Chandraprakash, Kevin Lafferty, Kevin Lu, Koen De Groote, Konstantine
> > > Karantasis, lambdaliu, Lee Dongjin, Lincong Li, Liquan Pei, lucapette,
> > > Lucas Wang, Maciej Bryński, Magesh Nandakumar, Manikumar Reddy,
> Manikumar
> > > Reddy O, Mario Molina, Marko Stanković, Matthias J. Sax, Matthias
> > > Wessendorf, Max Zheng, Mayank Tankhiwale, mgharat, Michal Dziemianko,
> > > Michał Borowiecki, Mickael Maison, Mutasem Aldmour, Nikolay, nixsticks,
> > > nprad, okumin, Radai Rosenblatt, radai-rosenblatt, Rajini Sivaram,
> > Randall
> > > Hauch, Robert Yokota, Rohan, Ron Dagostino, Sam Lendle, Sandor
> Murakozi,
> > > Simon Clark, Stanislav Kozlovski, Stephane Maarek, Sébastien Launay,
> > Sönke
> > > Liebau, Ted Yu, uncleGen, Vahid Hashemian, Viktor Somogyi, wangshao,
> > > xinzhg, Xiongqi Wesley Wu, Xiongqi Wu, ying-zheng, Yishun Guan, Yu
> Yang,
> > > Zhanxiang (Patrick) Huang
> > >
> > > We welcome your help and feedback. For more information on how to
> > > report problems, and to get involved, visit the project website at
> > > https://kafka.apache.org/
> > >
> > > Thank you!
> > >
> > > Regards,
> > > Dong
> >
>

Re: [ANNOUNCE] Apache Kafka 2.1.0

[Vahid Hashemian <va...@gmail.com>]

Awesome! Thank you Dong for running the release.

--Vahid

On Wed, Nov 21, 2018 at 1:00 PM Edoardo Comar <ed...@gmail.com> wrote:

> Bravo Dong!
> Thanks for managing the 2.1.0 release.
>
> Edo
> ____________________
> sent from my phone
>
> On Wed, 21 Nov 2018, 20:41 James Cheng <wushujames@gmail.com wrote:
>
> > Thanks Dong for running the release, and congrats to everyone in the
> > community!
> >
> > -James
> >
> > Sent from my iPhone
> >
> > > On Nov 21, 2018, at 10:09 AM, Dong Lin <li...@apache.org> wrote:
> > >
> > > The Apache Kafka community is pleased to announce the release for
> Apache
> > > Kafka 2.1.0
> > >
> > >
> > > This is a major release and includes significant features from 28 KIPs.
> > It
> > > contains fixes and improvements from 179 JIRSs, including a few
> critical
> > > bug fixes. Here is a summary of some notable changes
> > >
> > > ** Java 11 support
> > > ** Support for Zstandard, which achieves compression comparable to gzip
> > > with higher compression and especially decompression speeds(KIP-110)
> > > ** Avoid expiring committed offsets for active consumer group (KIP-211)
> > > ** Provide Intuitive User Timeouts in The Producer (KIP-91)
> > > ** Kafka's replication protocol now supports improved fencing of
> zombies.
> > > Previously, under certain rare conditions, if a broker became
> partitioned
> > > from Zookeeper but not the rest of the cluster, then the logs of
> > replicated
> > > partitions could diverge and cause data loss in the worst case
> (KIP-320)
> > > ** Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353,
> KIP-356)
> > > ** Admin script and admin client API improvements to simplify admin
> > > operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
> > > ** DNS handling improvements (KIP-235, KIP-302)
> > >
> > >
> > > All of the changes in this release can be found in the release notes:
> > > https://www.apache.org/dist/kafka/2.1.0/RELEASE_NOTES.html
> > >
> > >
> > > You can download the source and binary release (Scala <VERSIONS>) from:
> > > https://kafka.apache.org/downloads#2.1.0
> > >
> > >
> >
> ---------------------------------------------------------------------------------------------------
> > >
> > >
> > > Apache Kafka is a distributed streaming platform with four core APIs:
> > >
> > >
> > > ** The Producer API allows an application to publish a stream records
> to
> > > one or more Kafka topics.
> > >
> > > ** The Consumer API allows an application to subscribe to one or more
> > > topics and process the stream of records produced to them.
> > >
> > > ** The Streams API allows an application to act as a stream processor,
> > > consuming an input stream from one or more topics and producing an
> > > output stream to one or more output topics, effectively transforming
> the
> > > input streams to output streams.
> > >
> > > ** The Connector API allows building and running reusable producers or
> > > consumers that connect Kafka topics to existing applications or data
> > > systems. For example, a connector to a relational database might
> > > capture every change to a table.
> > >
> > >
> > > With these APIs, Kafka can be used for two broad classes of
> application:
> > >
> > > ** Building real-time streaming data pipelines that reliably get data
> > > between systems or applications.
> > >
> > > ** Building real-time streaming applications that transform or react
> > > to the streams of data.
> > >
> > >
> > > Apache Kafka is in use at large and small companies worldwide,
> including
> > > Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest,
> Rabobank,
> > > Target, The New York Times, Uber, Yelp, and Zalando, among others.
> > >
> > > A big thank you for the following 100 contributors to this release!
> > >
> > > Ahmed Al Mehdi, Aleksei Izmalkin, Alex Dunayevsky, Amit Sela, Andras
> > > Katona, Andy Coates, Anna Povzner, Arjun Satish, Attila Sasvari, Aviem
> > Zur,
> > > Bibin Sebastian, Bill Bejeck, Bob Barrett, Brandon Kirchner, Bridger
> > > Howell, Chia-Ping Tsai, Colin Hicks, Colin Patrick McCabe, Dhruvil
> Shah,
> > > Dong Lin, Edoardo Comar, Eugen Feller, Ewen Cheslack-Postava, Filipe
> > > Agapito, Flavien Raynaud, Gantigmaa Selenge, Gardner Vickers, Gitomain,
> > > Gunnar Morling, Guozhang Wang, hashangayasri, huxi, huxihx, Ismael
> Juma,
> > > Jagadesh Adireddi, Jason Gustafson, Jim Galasyn, Jimin Hsieh, Jimmy
> > Casey,
> > > Joan Goyeau, John Roesler, Jon Lee, jonathanskrzypek, Jun Rao, Kamal
> > > Chandraprakash, Kevin Lafferty, Kevin Lu, Koen De Groote, Konstantine
> > > Karantasis, lambdaliu, Lee Dongjin, Lincong Li, Liquan Pei, lucapette,
> > > Lucas Wang, Maciej Bryński, Magesh Nandakumar, Manikumar Reddy,
> Manikumar
> > > Reddy O, Mario Molina, Marko Stanković, Matthias J. Sax, Matthias
> > > Wessendorf, Max Zheng, Mayank Tankhiwale, mgharat, Michal Dziemianko,
> > > Michał Borowiecki, Mickael Maison, Mutasem Aldmour, Nikolay, nixsticks,
> > > nprad, okumin, Radai Rosenblatt, radai-rosenblatt, Rajini Sivaram,
> > Randall
> > > Hauch, Robert Yokota, Rohan, Ron Dagostino, Sam Lendle, Sandor
> Murakozi,
> > > Simon Clark, Stanislav Kozlovski, Stephane Maarek, Sébastien Launay,
> > Sönke
> > > Liebau, Ted Yu, uncleGen, Vahid Hashemian, Viktor Somogyi, wangshao,
> > > xinzhg, Xiongqi Wesley Wu, Xiongqi Wu, ying-zheng, Yishun Guan, Yu
> Yang,
> > > Zhanxiang (Patrick) Huang
> > >
> > > We welcome your help and feedback. For more information on how to
> > > report problems, and to get involved, visit the project website at
> > > https://kafka.apache.org/
> > >
> > > Thank you!
> > >
> > > Regards,
> > > Dong
> >
>

Re: [ANNOUNCE] Apache Kafka 2.1.0

[Edoardo Comar <ed...@gmail.com>]

Bravo Dong!
Thanks for managing the 2.1.0 release.

Edo
____________________
sent from my phone

On Wed, 21 Nov 2018, 20:41 James Cheng <wushujames@gmail.com wrote:

> Thanks Dong for running the release, and congrats to everyone in the
> community!
>
> -James
>
> Sent from my iPhone
>
> > On Nov 21, 2018, at 10:09 AM, Dong Lin <li...@apache.org> wrote:
> >
> > The Apache Kafka community is pleased to announce the release for Apache
> > Kafka 2.1.0
> >
> >
> > This is a major release and includes significant features from 28 KIPs.
> It
> > contains fixes and improvements from 179 JIRSs, including a few critical
> > bug fixes. Here is a summary of some notable changes
> >
> > ** Java 11 support
> > ** Support for Zstandard, which achieves compression comparable to gzip
> > with higher compression and especially decompression speeds(KIP-110)
> > ** Avoid expiring committed offsets for active consumer group (KIP-211)
> > ** Provide Intuitive User Timeouts in The Producer (KIP-91)
> > ** Kafka's replication protocol now supports improved fencing of zombies.
> > Previously, under certain rare conditions, if a broker became partitioned
> > from Zookeeper but not the rest of the cluster, then the logs of
> replicated
> > partitions could diverge and cause data loss in the worst case (KIP-320)
> > ** Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353, KIP-356)
> > ** Admin script and admin client API improvements to simplify admin
> > operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
> > ** DNS handling improvements (KIP-235, KIP-302)
> >
> >
> > All of the changes in this release can be found in the release notes:
> > https://www.apache.org/dist/kafka/2.1.0/RELEASE_NOTES.html
> >
> >
> > You can download the source and binary release (Scala <VERSIONS>) from:
> > https://kafka.apache.org/downloads#2.1.0
> >
> >
> ---------------------------------------------------------------------------------------------------
> >
> >
> > Apache Kafka is a distributed streaming platform with four core APIs:
> >
> >
> > ** The Producer API allows an application to publish a stream records to
> > one or more Kafka topics.
> >
> > ** The Consumer API allows an application to subscribe to one or more
> > topics and process the stream of records produced to them.
> >
> > ** The Streams API allows an application to act as a stream processor,
> > consuming an input stream from one or more topics and producing an
> > output stream to one or more output topics, effectively transforming the
> > input streams to output streams.
> >
> > ** The Connector API allows building and running reusable producers or
> > consumers that connect Kafka topics to existing applications or data
> > systems. For example, a connector to a relational database might
> > capture every change to a table.
> >
> >
> > With these APIs, Kafka can be used for two broad classes of application:
> >
> > ** Building real-time streaming data pipelines that reliably get data
> > between systems or applications.
> >
> > ** Building real-time streaming applications that transform or react
> > to the streams of data.
> >
> >
> > Apache Kafka is in use at large and small companies worldwide, including
> > Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank,
> > Target, The New York Times, Uber, Yelp, and Zalando, among others.
> >
> > A big thank you for the following 100 contributors to this release!
> >
> > Ahmed Al Mehdi, Aleksei Izmalkin, Alex Dunayevsky, Amit Sela, Andras
> > Katona, Andy Coates, Anna Povzner, Arjun Satish, Attila Sasvari, Aviem
> Zur,
> > Bibin Sebastian, Bill Bejeck, Bob Barrett, Brandon Kirchner, Bridger
> > Howell, Chia-Ping Tsai, Colin Hicks, Colin Patrick McCabe, Dhruvil Shah,
> > Dong Lin, Edoardo Comar, Eugen Feller, Ewen Cheslack-Postava, Filipe
> > Agapito, Flavien Raynaud, Gantigmaa Selenge, Gardner Vickers, Gitomain,
> > Gunnar Morling, Guozhang Wang, hashangayasri, huxi, huxihx, Ismael Juma,
> > Jagadesh Adireddi, Jason Gustafson, Jim Galasyn, Jimin Hsieh, Jimmy
> Casey,
> > Joan Goyeau, John Roesler, Jon Lee, jonathanskrzypek, Jun Rao, Kamal
> > Chandraprakash, Kevin Lafferty, Kevin Lu, Koen De Groote, Konstantine
> > Karantasis, lambdaliu, Lee Dongjin, Lincong Li, Liquan Pei, lucapette,
> > Lucas Wang, Maciej Bryński, Magesh Nandakumar, Manikumar Reddy, Manikumar
> > Reddy O, Mario Molina, Marko Stanković, Matthias J. Sax, Matthias
> > Wessendorf, Max Zheng, Mayank Tankhiwale, mgharat, Michal Dziemianko,
> > Michał Borowiecki, Mickael Maison, Mutasem Aldmour, Nikolay, nixsticks,
> > nprad, okumin, Radai Rosenblatt, radai-rosenblatt, Rajini Sivaram,
> Randall
> > Hauch, Robert Yokota, Rohan, Ron Dagostino, Sam Lendle, Sandor Murakozi,
> > Simon Clark, Stanislav Kozlovski, Stephane Maarek, Sébastien Launay,
> Sönke
> > Liebau, Ted Yu, uncleGen, Vahid Hashemian, Viktor Somogyi, wangshao,
> > xinzhg, Xiongqi Wesley Wu, Xiongqi Wu, ying-zheng, Yishun Guan, Yu Yang,
> > Zhanxiang (Patrick) Huang
> >
> > We welcome your help and feedback. For more information on how to
> > report problems, and to get involved, visit the project website at
> > https://kafka.apache.org/
> >
> > Thank you!
> >
> > Regards,
> > Dong
>

Re: [ANNOUNCE] Apache Kafka 2.1.0

[Edoardo Comar <ed...@gmail.com>]

Bravo Dong!
Thanks for managing the 2.1.0 release.

Edo
____________________
sent from my phone

On Wed, 21 Nov 2018, 20:41 James Cheng <wushujames@gmail.com wrote:

> Thanks Dong for running the release, and congrats to everyone in the
> community!
>
> -James
>
> Sent from my iPhone
>
> > On Nov 21, 2018, at 10:09 AM, Dong Lin <li...@apache.org> wrote:
> >
> > The Apache Kafka community is pleased to announce the release for Apache
> > Kafka 2.1.0
> >
> >
> > This is a major release and includes significant features from 28 KIPs.
> It
> > contains fixes and improvements from 179 JIRSs, including a few critical
> > bug fixes. Here is a summary of some notable changes
> >
> > ** Java 11 support
> > ** Support for Zstandard, which achieves compression comparable to gzip
> > with higher compression and especially decompression speeds(KIP-110)
> > ** Avoid expiring committed offsets for active consumer group (KIP-211)
> > ** Provide Intuitive User Timeouts in The Producer (KIP-91)
> > ** Kafka's replication protocol now supports improved fencing of zombies.
> > Previously, under certain rare conditions, if a broker became partitioned
> > from Zookeeper but not the rest of the cluster, then the logs of
> replicated
> > partitions could diverge and cause data loss in the worst case (KIP-320)
> > ** Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353, KIP-356)
> > ** Admin script and admin client API improvements to simplify admin
> > operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
> > ** DNS handling improvements (KIP-235, KIP-302)
> >
> >
> > All of the changes in this release can be found in the release notes:
> > https://www.apache.org/dist/kafka/2.1.0/RELEASE_NOTES.html
> >
> >
> > You can download the source and binary release (Scala <VERSIONS>) from:
> > https://kafka.apache.org/downloads#2.1.0
> >
> >
> ---------------------------------------------------------------------------------------------------
> >
> >
> > Apache Kafka is a distributed streaming platform with four core APIs:
> >
> >
> > ** The Producer API allows an application to publish a stream records to
> > one or more Kafka topics.
> >
> > ** The Consumer API allows an application to subscribe to one or more
> > topics and process the stream of records produced to them.
> >
> > ** The Streams API allows an application to act as a stream processor,
> > consuming an input stream from one or more topics and producing an
> > output stream to one or more output topics, effectively transforming the
> > input streams to output streams.
> >
> > ** The Connector API allows building and running reusable producers or
> > consumers that connect Kafka topics to existing applications or data
> > systems. For example, a connector to a relational database might
> > capture every change to a table.
> >
> >
> > With these APIs, Kafka can be used for two broad classes of application:
> >
> > ** Building real-time streaming data pipelines that reliably get data
> > between systems or applications.
> >
> > ** Building real-time streaming applications that transform or react
> > to the streams of data.
> >
> >
> > Apache Kafka is in use at large and small companies worldwide, including
> > Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank,
> > Target, The New York Times, Uber, Yelp, and Zalando, among others.
> >
> > A big thank you for the following 100 contributors to this release!
> >
> > Ahmed Al Mehdi, Aleksei Izmalkin, Alex Dunayevsky, Amit Sela, Andras
> > Katona, Andy Coates, Anna Povzner, Arjun Satish, Attila Sasvari, Aviem
> Zur,
> > Bibin Sebastian, Bill Bejeck, Bob Barrett, Brandon Kirchner, Bridger
> > Howell, Chia-Ping Tsai, Colin Hicks, Colin Patrick McCabe, Dhruvil Shah,
> > Dong Lin, Edoardo Comar, Eugen Feller, Ewen Cheslack-Postava, Filipe
> > Agapito, Flavien Raynaud, Gantigmaa Selenge, Gardner Vickers, Gitomain,
> > Gunnar Morling, Guozhang Wang, hashangayasri, huxi, huxihx, Ismael Juma,
> > Jagadesh Adireddi, Jason Gustafson, Jim Galasyn, Jimin Hsieh, Jimmy
> Casey,
> > Joan Goyeau, John Roesler, Jon Lee, jonathanskrzypek, Jun Rao, Kamal
> > Chandraprakash, Kevin Lafferty, Kevin Lu, Koen De Groote, Konstantine
> > Karantasis, lambdaliu, Lee Dongjin, Lincong Li, Liquan Pei, lucapette,
> > Lucas Wang, Maciej Bryński, Magesh Nandakumar, Manikumar Reddy, Manikumar
> > Reddy O, Mario Molina, Marko Stanković, Matthias J. Sax, Matthias
> > Wessendorf, Max Zheng, Mayank Tankhiwale, mgharat, Michal Dziemianko,
> > Michał Borowiecki, Mickael Maison, Mutasem Aldmour, Nikolay, nixsticks,
> > nprad, okumin, Radai Rosenblatt, radai-rosenblatt, Rajini Sivaram,
> Randall
> > Hauch, Robert Yokota, Rohan, Ron Dagostino, Sam Lendle, Sandor Murakozi,
> > Simon Clark, Stanislav Kozlovski, Stephane Maarek, Sébastien Launay,
> Sönke
> > Liebau, Ted Yu, uncleGen, Vahid Hashemian, Viktor Somogyi, wangshao,
> > xinzhg, Xiongqi Wesley Wu, Xiongqi Wu, ying-zheng, Yishun Guan, Yu Yang,
> > Zhanxiang (Patrick) Huang
> >
> > We welcome your help and feedback. For more information on how to
> > report problems, and to get involved, visit the project website at
> > https://kafka.apache.org/
> >
> > Thank you!
> >
> > Regards,
> > Dong
>

Re: [ANNOUNCE] Apache Kafka 2.1.0

[James Cheng <wu...@gmail.com>]

Thanks Dong for running the release, and congrats to everyone in the community!

-James

Sent from my iPhone

> On Nov 21, 2018, at 10:09 AM, Dong Lin <li...@apache.org> wrote:
> 
> The Apache Kafka community is pleased to announce the release for Apache
> Kafka 2.1.0
> 
> 
> This is a major release and includes significant features from 28 KIPs. It
> contains fixes and improvements from 179 JIRSs, including a few critical
> bug fixes. Here is a summary of some notable changes
> 
> ** Java 11 support
> ** Support for Zstandard, which achieves compression comparable to gzip
> with higher compression and especially decompression speeds(KIP-110)
> ** Avoid expiring committed offsets for active consumer group (KIP-211)
> ** Provide Intuitive User Timeouts in The Producer (KIP-91)
> ** Kafka's replication protocol now supports improved fencing of zombies.
> Previously, under certain rare conditions, if a broker became partitioned
> from Zookeeper but not the rest of the cluster, then the logs of replicated
> partitions could diverge and cause data loss in the worst case (KIP-320)
> ** Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353, KIP-356)
> ** Admin script and admin client API improvements to simplify admin
> operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
> ** DNS handling improvements (KIP-235, KIP-302)
> 
> 
> All of the changes in this release can be found in the release notes:
> https://www.apache.org/dist/kafka/2.1.0/RELEASE_NOTES.html
> 
> 
> You can download the source and binary release (Scala <VERSIONS>) from:
> https://kafka.apache.org/downloads#2.1.0
> 
> ---------------------------------------------------------------------------------------------------
> 
> 
> Apache Kafka is a distributed streaming platform with four core APIs:
> 
> 
> ** The Producer API allows an application to publish a stream records to
> one or more Kafka topics.
> 
> ** The Consumer API allows an application to subscribe to one or more
> topics and process the stream of records produced to them.
> 
> ** The Streams API allows an application to act as a stream processor,
> consuming an input stream from one or more topics and producing an
> output stream to one or more output topics, effectively transforming the
> input streams to output streams.
> 
> ** The Connector API allows building and running reusable producers or
> consumers that connect Kafka topics to existing applications or data
> systems. For example, a connector to a relational database might
> capture every change to a table.
> 
> 
> With these APIs, Kafka can be used for two broad classes of application:
> 
> ** Building real-time streaming data pipelines that reliably get data
> between systems or applications.
> 
> ** Building real-time streaming applications that transform or react
> to the streams of data.
> 
> 
> Apache Kafka is in use at large and small companies worldwide, including
> Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank,
> Target, The New York Times, Uber, Yelp, and Zalando, among others.
> 
> A big thank you for the following 100 contributors to this release!
> 
> Ahmed Al Mehdi, Aleksei Izmalkin, Alex Dunayevsky, Amit Sela, Andras
> Katona, Andy Coates, Anna Povzner, Arjun Satish, Attila Sasvari, Aviem Zur,
> Bibin Sebastian, Bill Bejeck, Bob Barrett, Brandon Kirchner, Bridger
> Howell, Chia-Ping Tsai, Colin Hicks, Colin Patrick McCabe, Dhruvil Shah,
> Dong Lin, Edoardo Comar, Eugen Feller, Ewen Cheslack-Postava, Filipe
> Agapito, Flavien Raynaud, Gantigmaa Selenge, Gardner Vickers, Gitomain,
> Gunnar Morling, Guozhang Wang, hashangayasri, huxi, huxihx, Ismael Juma,
> Jagadesh Adireddi, Jason Gustafson, Jim Galasyn, Jimin Hsieh, Jimmy Casey,
> Joan Goyeau, John Roesler, Jon Lee, jonathanskrzypek, Jun Rao, Kamal
> Chandraprakash, Kevin Lafferty, Kevin Lu, Koen De Groote, Konstantine
> Karantasis, lambdaliu, Lee Dongjin, Lincong Li, Liquan Pei, lucapette,
> Lucas Wang, Maciej Bryński, Magesh Nandakumar, Manikumar Reddy, Manikumar
> Reddy O, Mario Molina, Marko Stanković, Matthias J. Sax, Matthias
> Wessendorf, Max Zheng, Mayank Tankhiwale, mgharat, Michal Dziemianko,
> Michał Borowiecki, Mickael Maison, Mutasem Aldmour, Nikolay, nixsticks,
> nprad, okumin, Radai Rosenblatt, radai-rosenblatt, Rajini Sivaram, Randall
> Hauch, Robert Yokota, Rohan, Ron Dagostino, Sam Lendle, Sandor Murakozi,
> Simon Clark, Stanislav Kozlovski, Stephane Maarek, Sébastien Launay, Sönke
> Liebau, Ted Yu, uncleGen, Vahid Hashemian, Viktor Somogyi, wangshao,
> xinzhg, Xiongqi Wesley Wu, Xiongqi Wu, ying-zheng, Yishun Guan, Yu Yang,
> Zhanxiang (Patrick) Huang
> 
> We welcome your help and feedback. For more information on how to
> report problems, and to get involved, visit the project website at
> https://kafka.apache.org/
> 
> Thank you!
> 
> Regards,
> Dong

Re: [ANNOUNCE] Apache Kafka 2.1.0

[James Cheng <wu...@gmail.com>]

Thanks Dong for running the release, and congrats to everyone in the community!

-James

Sent from my iPhone

> On Nov 21, 2018, at 10:09 AM, Dong Lin <li...@apache.org> wrote:
> 
> The Apache Kafka community is pleased to announce the release for Apache
> Kafka 2.1.0
> 
> 
> This is a major release and includes significant features from 28 KIPs. It
> contains fixes and improvements from 179 JIRSs, including a few critical
> bug fixes. Here is a summary of some notable changes
> 
> ** Java 11 support
> ** Support for Zstandard, which achieves compression comparable to gzip
> with higher compression and especially decompression speeds(KIP-110)
> ** Avoid expiring committed offsets for active consumer group (KIP-211)
> ** Provide Intuitive User Timeouts in The Producer (KIP-91)
> ** Kafka's replication protocol now supports improved fencing of zombies.
> Previously, under certain rare conditions, if a broker became partitioned
> from Zookeeper but not the rest of the cluster, then the logs of replicated
> partitions could diverge and cause data loss in the worst case (KIP-320)
> ** Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353, KIP-356)
> ** Admin script and admin client API improvements to simplify admin
> operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
> ** DNS handling improvements (KIP-235, KIP-302)
> 
> 
> All of the changes in this release can be found in the release notes:
> https://www.apache.org/dist/kafka/2.1.0/RELEASE_NOTES.html
> 
> 
> You can download the source and binary release (Scala <VERSIONS>) from:
> https://kafka.apache.org/downloads#2.1.0
> 
> ---------------------------------------------------------------------------------------------------
> 
> 
> Apache Kafka is a distributed streaming platform with four core APIs:
> 
> 
> ** The Producer API allows an application to publish a stream records to
> one or more Kafka topics.
> 
> ** The Consumer API allows an application to subscribe to one or more
> topics and process the stream of records produced to them.
> 
> ** The Streams API allows an application to act as a stream processor,
> consuming an input stream from one or more topics and producing an
> output stream to one or more output topics, effectively transforming the
> input streams to output streams.
> 
> ** The Connector API allows building and running reusable producers or
> consumers that connect Kafka topics to existing applications or data
> systems. For example, a connector to a relational database might
> capture every change to a table.
> 
> 
> With these APIs, Kafka can be used for two broad classes of application:
> 
> ** Building real-time streaming data pipelines that reliably get data
> between systems or applications.
> 
> ** Building real-time streaming applications that transform or react
> to the streams of data.
> 
> 
> Apache Kafka is in use at large and small companies worldwide, including
> Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank,
> Target, The New York Times, Uber, Yelp, and Zalando, among others.
> 
> A big thank you for the following 100 contributors to this release!
> 
> Ahmed Al Mehdi, Aleksei Izmalkin, Alex Dunayevsky, Amit Sela, Andras
> Katona, Andy Coates, Anna Povzner, Arjun Satish, Attila Sasvari, Aviem Zur,
> Bibin Sebastian, Bill Bejeck, Bob Barrett, Brandon Kirchner, Bridger
> Howell, Chia-Ping Tsai, Colin Hicks, Colin Patrick McCabe, Dhruvil Shah,
> Dong Lin, Edoardo Comar, Eugen Feller, Ewen Cheslack-Postava, Filipe
> Agapito, Flavien Raynaud, Gantigmaa Selenge, Gardner Vickers, Gitomain,
> Gunnar Morling, Guozhang Wang, hashangayasri, huxi, huxihx, Ismael Juma,
> Jagadesh Adireddi, Jason Gustafson, Jim Galasyn, Jimin Hsieh, Jimmy Casey,
> Joan Goyeau, John Roesler, Jon Lee, jonathanskrzypek, Jun Rao, Kamal
> Chandraprakash, Kevin Lafferty, Kevin Lu, Koen De Groote, Konstantine
> Karantasis, lambdaliu, Lee Dongjin, Lincong Li, Liquan Pei, lucapette,
> Lucas Wang, Maciej Bryński, Magesh Nandakumar, Manikumar Reddy, Manikumar
> Reddy O, Mario Molina, Marko Stanković, Matthias J. Sax, Matthias
> Wessendorf, Max Zheng, Mayank Tankhiwale, mgharat, Michal Dziemianko,
> Michał Borowiecki, Mickael Maison, Mutasem Aldmour, Nikolay, nixsticks,
> nprad, okumin, Radai Rosenblatt, radai-rosenblatt, Rajini Sivaram, Randall
> Hauch, Robert Yokota, Rohan, Ron Dagostino, Sam Lendle, Sandor Murakozi,
> Simon Clark, Stanislav Kozlovski, Stephane Maarek, Sébastien Launay, Sönke
> Liebau, Ted Yu, uncleGen, Vahid Hashemian, Viktor Somogyi, wangshao,
> xinzhg, Xiongqi Wesley Wu, Xiongqi Wu, ying-zheng, Yishun Guan, Yu Yang,
> Zhanxiang (Patrick) Huang
> 
> We welcome your help and feedback. For more information on how to
> report problems, and to get involved, visit the project website at
> https://kafka.apache.org/
> 
> Thank you!
> 
> Regards,
> Dong