You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@beam.apache.org by Raghu Angadi <ra...@google.com> on 2018/02/03 00:12:52 UTC
Deprecate and remove support for Kafka 0.9.x and older version
Is anyone using Apache Beam with Kafka 0.9.x and older?
I am thinking of deprecating 0.9.x and 0.10.0 in Beam 2.4 and remove
support in 2.5 or later. 0.10.1 and up will be supported. 0.10.1+ includes
much better timestamp support.
By deprecation I mean KafkaIO would continue to work with an older version
at runtime, but would not build with it (e.g. `mvn
-Dkafka.clients.version=0.9.1` fails). We can print a deprecation warning
at runtime.
[1]:
https://github.com/apache/kafka/commit/23c69d62a0cabf06c4db8b338f0ca824dc6d81a7
Re: Deprecate and remove support for Kafka 0.9.x and older version
Posted by Raghu Angadi <ra...@google.com>.
Agreed. We will ask users again before we will remove runtime support in a
future version. No timeline yet.
PR 4603 removes compile time support (i.e. can't run unit tests). Please
let me know that looks good.
Raghu.
On Tue, Feb 6, 2018 at 7:40 AM, Ismaël Mejía <ie...@gmail.com> wrote:
> Agree with JB, showing deprecation is ok, but I think it is worth to
> support Kafka 0.9.x for some extra time. Users tend to stay in old
> data stores because migrating these clusters isn't always so easy.
>
>
> On Tue, Feb 6, 2018 at 3:56 PM, Jean-Baptiste Onofré <jb...@nanthrax.net>
> wrote:
> > +1 to flag as deprecated, but I would wait a bit before simply removing
> it.
> >
> > Regards
> > JB
> >
> > On 02/03/2018 01:12 AM, Raghu Angadi wrote:
> >> Is anyone using Apache Beam with Kafka 0.9.x and older?
> >>
> >> I am thinking of deprecating 0.9.x and 0.10.0 in Beam 2.4 and remove
> support in
> >> 2.5 or later. 0.10.1 and up will be supported. 0.10.1+ includes much
> better
> >> timestamp support.
> >>
> >> By deprecation I mean KafkaIO would continue to work with an older
> version at
> >> runtime, but would not build with it (e.g. `mvn
> -Dkafka.clients.version=0.9.1`
> >> fails). We can print a deprecation warning at runtime.
> >>
> >> [1]: https://github.com/apache/kafka/commit/
> 23c69d62a0cabf06c4db8b338f0ca824dc6d81a7
> >
> > --
> > Jean-Baptiste Onofré
> > jbonofre@apache.org
> > http://blog.nanthrax.net
> > Talend - http://www.talend.com
>
Re: Deprecate and remove support for Kafka 0.9.x and older version
Posted by Ismaël Mejía <ie...@gmail.com>.
Agree with JB, showing deprecation is ok, but I think it is worth to
support Kafka 0.9.x for some extra time. Users tend to stay in old
data stores because migrating these clusters isn't always so easy.
On Tue, Feb 6, 2018 at 3:56 PM, Jean-Baptiste Onofré <jb...@nanthrax.net> wrote:
> +1 to flag as deprecated, but I would wait a bit before simply removing it.
>
> Regards
> JB
>
> On 02/03/2018 01:12 AM, Raghu Angadi wrote:
>> Is anyone using Apache Beam with Kafka 0.9.x and older?
>>
>> I am thinking of deprecating 0.9.x and 0.10.0 in Beam 2.4 and remove support in
>> 2.5 or later. 0.10.1 and up will be supported. 0.10.1+ includes much better
>> timestamp support.
>>
>> By deprecation I mean KafkaIO would continue to work with an older version at
>> runtime, but would not build with it (e.g. `mvn -Dkafka.clients.version=0.9.1`
>> fails). We can print a deprecation warning at runtime.
>>
>> [1]: https://github.com/apache/kafka/commit/23c69d62a0cabf06c4db8b338f0ca824dc6d81a7
>
> --
> Jean-Baptiste Onofré
> jbonofre@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
Re: Deprecate and remove support for Kafka 0.9.x and older version
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
+1 to flag as deprecated, but I would wait a bit before simply removing it.
Regards
JB
On 02/03/2018 01:12 AM, Raghu Angadi wrote:
> Is anyone using Apache Beam with Kafka 0.9.x and older?
>
> I am thinking of deprecating 0.9.x and 0.10.0 in Beam 2.4 and remove support in
> 2.5 or later. 0.10.1 and up will be supported. 0.10.1+ includes much better
> timestamp support.
>
> By deprecation I mean KafkaIO would continue to work with an older version at
> runtime, but would not build with it (e.g. `mvn -Dkafka.clients.version=0.9.1`
> fails). We can print a deprecation warning at runtime.
>
> [1]: https://github.com/apache/kafka/commit/23c69d62a0cabf06c4db8b338f0ca824dc6d81a7
--
Jean-Baptiste Onofré
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
Re: Deprecate and remove support for Kafka 0.9.x and older version
Posted by Raghu Angadi <ra...@google.com>.
Thanks. https://github.com/apache/beam/pull/4603
It prints a deprecation warning if the run time version is older than
0.10.1.
Raghu.
On Fri, Feb 2, 2018 at 4:26 PM, Ted Yu <yu...@gmail.com> wrote:
> There wouldn't be new Kafka 0.9.x release.
>
> +1 on dropping support for 0.9.x
>
> On Fri, Feb 2, 2018 at 4:12 PM, Raghu Angadi <ra...@google.com> wrote:
>
>> Is anyone using Apache Beam with Kafka 0.9.x and older?
>>
>> I am thinking of deprecating 0.9.x and 0.10.0 in Beam 2.4 and remove
>> support in 2.5 or later. 0.10.1 and up will be supported. 0.10.1+ includes
>> much better timestamp support.
>>
>> By deprecation I mean KafkaIO would continue to work with an older
>> version at runtime, but would not build with it (e.g. `mvn
>> -Dkafka.clients.version=0.9.1` fails). We can print a deprecation warning
>> at runtime.
>>
>> [1]: https://github.com/apache/kafka/commit/23c69d62a0cabf06
>> c4db8b338f0ca824dc6d81a7
>>
>
>
Re: Deprecate and remove support for Kafka 0.9.x and older version
Posted by Ted Yu <yu...@gmail.com>.
There wouldn't be new Kafka 0.9.x release.
+1 on dropping support for 0.9.x
On Fri, Feb 2, 2018 at 4:12 PM, Raghu Angadi <ra...@google.com> wrote:
> Is anyone using Apache Beam with Kafka 0.9.x and older?
>
> I am thinking of deprecating 0.9.x and 0.10.0 in Beam 2.4 and remove
> support in 2.5 or later. 0.10.1 and up will be supported. 0.10.1+ includes
> much better timestamp support.
>
> By deprecation I mean KafkaIO would continue to work with an older version
> at runtime, but would not build with it (e.g. `mvn
> -Dkafka.clients.version=0.9.1` fails). We can print a deprecation warning
> at runtime.
>
> [1]: https://github.com/apache/kafka/commit/23c69d62a0cabf06c4db8b338f0ca8
> 24dc6d81a7
>