You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by Martijn Visser <ma...@ververica.com> on 2021/12/08 16:03:35 UTC
[DISCUSS] Deprecate MapR FS
Hi all,
Flink supports multiple file systems [1] which includes MapR FS. MapR as a
company doesn't exist anymore since 2019, the technology and intellectual
property has been sold to Hewlett Packard.
I don't think that there's anyone who's using MapR anymore and therefore I
think it would be good to deprecate this for Flink 1.15 and then remove it
in Flink 1.16. Removing this from Flink will slightly shrink the codebase
and CI runtime.
I'm also cross posting this to the User mailing list, in case there's still
anyone who's using MapR.
Best regards,
Martijn
[1]
https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/overview/
Re: [DISCUSS] Deprecate MapR FS
Posted by Yun Tang <my...@live.com>.
+1 for dropping the MapR Fs.
Best
Yun Tang
________________________________
From: Till Rohrmann <tr...@apache.org>
Sent: Wednesday, January 5, 2022 18:33
To: Martijn Visser <ma...@ververica.com>
Cc: David Morávek <dm...@apache.org>; dev <de...@flink.apache.org>; Seth Wiesman <sj...@gmail.com>; User <us...@flink.apache.org>
Subject: Re: [DISCUSS] Deprecate MapR FS
+1 for dropping the MapR FS.
Cheers,
Till
On Wed, Jan 5, 2022 at 10:11 AM Martijn Visser <ma...@ververica.com>> wrote:
Hi everyone,
Thanks for your input. I've checked the MapR implementation and it has no annotation at all. Given the circumstances that we thought that MapR was already dropped, I would propose to immediately remove MapR in Flink 1.15 instead of first marking it as deprecated and removing it in Flink 1.16.
Please let me know what you think.
Best regards,
Martijn
On Thu, 9 Dec 2021 at 17:27, David Morávek <dm...@apache.org>> wrote:
+1, agreed with Seth's reasoning. There has been no real activity in MapR FS module for years [1], so the eventual users should be good with using the jars from the older Flink versions for quite some time
[1] https://github.com/apache/flink/commits/master/flink-filesystems/flink-mapr-fs
Best,
D.
On Thu, Dec 9, 2021 at 4:28 PM Konstantin Knauf <kn...@apache.org>> wrote:
+1 (what Seth said)
On Thu, Dec 9, 2021 at 4:15 PM Seth Wiesman <sj...@gmail.com>> wrote:
> +1
>
> I actually thought we had already dropped this FS. If anyone is still
> relying on it in production, the file system abstraction in Flink has been
> incredibly stable over the years. They should be able to use the 1.14 MapR
> FS with later versions of Flink.
>
> Seth
>
> On Wed, Dec 8, 2021 at 10:03 AM Martijn Visser <ma...@ververica.com>>
> wrote:
>
>> Hi all,
>>
>> Flink supports multiple file systems [1] which includes MapR FS. MapR as
>> a company doesn't exist anymore since 2019, the technology and intellectual
>> property has been sold to Hewlett Packard.
>>
>> I don't think that there's anyone who's using MapR anymore and therefore
>> I think it would be good to deprecate this for Flink 1.15 and then remove
>> it in Flink 1.16. Removing this from Flink will slightly shrink the
>> codebase and CI runtime.
>>
>> I'm also cross posting this to the User mailing list, in case there's
>> still anyone who's using MapR.
>>
>> Best regards,
>>
>> Martijn
>>
>> [1]
>> https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/overview/
>>
>
--
Konstantin Knauf
https://twitter.com/snntrable
https://github.com/knaufk
Re: [DISCUSS] Deprecate MapR FS
Posted by Yun Tang <my...@live.com>.
+1 for dropping the MapR Fs.
Best
Yun Tang
________________________________
From: Till Rohrmann <tr...@apache.org>
Sent: Wednesday, January 5, 2022 18:33
To: Martijn Visser <ma...@ververica.com>
Cc: David Morávek <dm...@apache.org>; dev <de...@flink.apache.org>; Seth Wiesman <sj...@gmail.com>; User <us...@flink.apache.org>
Subject: Re: [DISCUSS] Deprecate MapR FS
+1 for dropping the MapR FS.
Cheers,
Till
On Wed, Jan 5, 2022 at 10:11 AM Martijn Visser <ma...@ververica.com>> wrote:
Hi everyone,
Thanks for your input. I've checked the MapR implementation and it has no annotation at all. Given the circumstances that we thought that MapR was already dropped, I would propose to immediately remove MapR in Flink 1.15 instead of first marking it as deprecated and removing it in Flink 1.16.
Please let me know what you think.
Best regards,
Martijn
On Thu, 9 Dec 2021 at 17:27, David Morávek <dm...@apache.org>> wrote:
+1, agreed with Seth's reasoning. There has been no real activity in MapR FS module for years [1], so the eventual users should be good with using the jars from the older Flink versions for quite some time
[1] https://github.com/apache/flink/commits/master/flink-filesystems/flink-mapr-fs
Best,
D.
On Thu, Dec 9, 2021 at 4:28 PM Konstantin Knauf <kn...@apache.org>> wrote:
+1 (what Seth said)
On Thu, Dec 9, 2021 at 4:15 PM Seth Wiesman <sj...@gmail.com>> wrote:
> +1
>
> I actually thought we had already dropped this FS. If anyone is still
> relying on it in production, the file system abstraction in Flink has been
> incredibly stable over the years. They should be able to use the 1.14 MapR
> FS with later versions of Flink.
>
> Seth
>
> On Wed, Dec 8, 2021 at 10:03 AM Martijn Visser <ma...@ververica.com>>
> wrote:
>
>> Hi all,
>>
>> Flink supports multiple file systems [1] which includes MapR FS. MapR as
>> a company doesn't exist anymore since 2019, the technology and intellectual
>> property has been sold to Hewlett Packard.
>>
>> I don't think that there's anyone who's using MapR anymore and therefore
>> I think it would be good to deprecate this for Flink 1.15 and then remove
>> it in Flink 1.16. Removing this from Flink will slightly shrink the
>> codebase and CI runtime.
>>
>> I'm also cross posting this to the User mailing list, in case there's
>> still anyone who's using MapR.
>>
>> Best regards,
>>
>> Martijn
>>
>> [1]
>> https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/overview/
>>
>
--
Konstantin Knauf
https://twitter.com/snntrable
https://github.com/knaufk
Re: [DISCUSS] Deprecate MapR FS
Posted by Martijn Visser <ma...@ververica.com>.
Thanks everyone. We've moved forward with removing the MapR file system in
Flink 1.15.
On Tue, 11 Jan 2022 at 10:37, Jingsong Li <ji...@gmail.com> wrote:
> +1 for dropping the MapR FS. Thanks for driving.
>
> Best,
> Jingsong
>
> On Tue, Jan 11, 2022 at 5:22 PM Chang Li <li...@gmail.com> wrote:
> >
> > +1 for dropping the MapR FS.
> >
> > Till Rohrmann <tr...@apache.org> 于2022年1月5日周三 18:33写道：
> >
> > > +1 for dropping the MapR FS.
> > >
> > > Cheers,
> > > Till
> > >
> > > On Wed, Jan 5, 2022 at 10:11 AM Martijn Visser <ma...@ververica.com>
> > > wrote:
> > >
> > > > Hi everyone,
> > > >
> > > > Thanks for your input. I've checked the MapR implementation and it
> has no
> > > > annotation at all. Given the circumstances that we thought that MapR
> was
> > > > already dropped, I would propose to immediately remove MapR in Flink
> 1.15
> > > > instead of first marking it as deprecated and removing it in Flink
> 1.16.
> > > >
> > > > Please let me know what you think.
> > > >
> > > > Best regards,
> > > >
> > > > Martijn
> > > >
> > > > On Thu, 9 Dec 2021 at 17:27, David Morávek <dm...@apache.org> wrote:
> > > >
> > > >> +1, agreed with Seth's reasoning. There has been no real activity in
> > > MapR
> > > >> FS module for years [1], so the eventual users should be good with
> using
> > > >> the jars from the older Flink versions for quite some time
> > > >>
> > > >> [1]
> > > >>
> > >
> https://github.com/apache/flink/commits/master/flink-filesystems/flink-mapr-fs
> > > >>
> > > >> Best,
> > > >> D.
> > > >>
> > > >> On Thu, Dec 9, 2021 at 4:28 PM Konstantin Knauf <kn...@apache.org>
> > > >> wrote:
> > > >>
> > > >>> +1 (what Seth said)
> > > >>>
> > > >>> On Thu, Dec 9, 2021 at 4:15 PM Seth Wiesman <sj...@gmail.com>
> > > wrote:
> > > >>>
> > > >>> > +1
> > > >>> >
> > > >>> > I actually thought we had already dropped this FS. If anyone is
> still
> > > >>> > relying on it in production, the file system abstraction in
> Flink has
> > > >>> been
> > > >>> > incredibly stable over the years. They should be able to use the
> 1.14
> > > >>> MapR
> > > >>> > FS with later versions of Flink.
> > > >>> >
> > > >>> > Seth
> > > >>> >
> > > >>> > On Wed, Dec 8, 2021 at 10:03 AM Martijn Visser <
> > > martijn@ververica.com>
> > > >>> > wrote:
> > > >>> >
> > > >>> >> Hi all,
> > > >>> >>
> > > >>> >> Flink supports multiple file systems [1] which includes MapR FS.
> > > MapR
> > > >>> as
> > > >>> >> a company doesn't exist anymore since 2019, the technology and
> > > >>> intellectual
> > > >>> >> property has been sold to Hewlett Packard.
> > > >>> >>
> > > >>> >> I don't think that there's anyone who's using MapR anymore and
> > > >>> therefore
> > > >>> >> I think it would be good to deprecate this for Flink 1.15 and
> then
> > > >>> remove
> > > >>> >> it in Flink 1.16. Removing this from Flink will slightly shrink
> the
> > > >>> >> codebase and CI runtime.
> > > >>> >>
> > > >>> >> I'm also cross posting this to the User mailing list, in case
> > > there's
> > > >>> >> still anyone who's using MapR.
> > > >>> >>
> > > >>> >> Best regards,
> > > >>> >>
> > > >>> >> Martijn
> > > >>> >>
> > > >>> >> [1]
> > > >>> >>
> > > >>>
> > >
> https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/overview/
> > > >>> >>
> > > >>> >
> > > >>>
> > > >>> --
> > > >>>
> > > >>> Konstantin Knauf
> > > >>>
> > > >>> https://twitter.com/snntrable
> > > >>>
> > > >>> https://github.com/knaufk
> > > >>>
> > > >>
> > >
>
Re: [DISCUSS] Deprecate MapR FS
Posted by Jingsong Li <ji...@gmail.com>.
+1 for dropping the MapR FS. Thanks for driving.
Best,
Jingsong
On Tue, Jan 11, 2022 at 5:22 PM Chang Li <li...@gmail.com> wrote:
>
> +1 for dropping the MapR FS.
>
> Till Rohrmann <tr...@apache.org> 于2022年1月5日周三 18:33写道：
>
> > +1 for dropping the MapR FS.
> >
> > Cheers,
> > Till
> >
> > On Wed, Jan 5, 2022 at 10:11 AM Martijn Visser <ma...@ververica.com>
> > wrote:
> >
> > > Hi everyone,
> > >
> > > Thanks for your input. I've checked the MapR implementation and it has no
> > > annotation at all. Given the circumstances that we thought that MapR was
> > > already dropped, I would propose to immediately remove MapR in Flink 1.15
> > > instead of first marking it as deprecated and removing it in Flink 1.16.
> > >
> > > Please let me know what you think.
> > >
> > > Best regards,
> > >
> > > Martijn
> > >
> > > On Thu, 9 Dec 2021 at 17:27, David Morávek <dm...@apache.org> wrote:
> > >
> > >> +1, agreed with Seth's reasoning. There has been no real activity in
> > MapR
> > >> FS module for years [1], so the eventual users should be good with using
> > >> the jars from the older Flink versions for quite some time
> > >>
> > >> [1]
> > >>
> > https://github.com/apache/flink/commits/master/flink-filesystems/flink-mapr-fs
> > >>
> > >> Best,
> > >> D.
> > >>
> > >> On Thu, Dec 9, 2021 at 4:28 PM Konstantin Knauf <kn...@apache.org>
> > >> wrote:
> > >>
> > >>> +1 (what Seth said)
> > >>>
> > >>> On Thu, Dec 9, 2021 at 4:15 PM Seth Wiesman <sj...@gmail.com>
> > wrote:
> > >>>
> > >>> > +1
> > >>> >
> > >>> > I actually thought we had already dropped this FS. If anyone is still
> > >>> > relying on it in production, the file system abstraction in Flink has
> > >>> been
> > >>> > incredibly stable over the years. They should be able to use the 1.14
> > >>> MapR
> > >>> > FS with later versions of Flink.
> > >>> >
> > >>> > Seth
> > >>> >
> > >>> > On Wed, Dec 8, 2021 at 10:03 AM Martijn Visser <
> > martijn@ververica.com>
> > >>> > wrote:
> > >>> >
> > >>> >> Hi all,
> > >>> >>
> > >>> >> Flink supports multiple file systems [1] which includes MapR FS.
> > MapR
> > >>> as
> > >>> >> a company doesn't exist anymore since 2019, the technology and
> > >>> intellectual
> > >>> >> property has been sold to Hewlett Packard.
> > >>> >>
> > >>> >> I don't think that there's anyone who's using MapR anymore and
> > >>> therefore
> > >>> >> I think it would be good to deprecate this for Flink 1.15 and then
> > >>> remove
> > >>> >> it in Flink 1.16. Removing this from Flink will slightly shrink the
> > >>> >> codebase and CI runtime.
> > >>> >>
> > >>> >> I'm also cross posting this to the User mailing list, in case
> > there's
> > >>> >> still anyone who's using MapR.
> > >>> >>
> > >>> >> Best regards,
> > >>> >>
> > >>> >> Martijn
> > >>> >>
> > >>> >> [1]
> > >>> >>
> > >>>
> > https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/overview/
> > >>> >>
> > >>> >
> > >>>
> > >>> --
> > >>>
> > >>> Konstantin Knauf
> > >>>
> > >>> https://twitter.com/snntrable
> > >>>
> > >>> https://github.com/knaufk
> > >>>
> > >>
> >
Re: [DISCUSS] Deprecate MapR FS
Posted by Chang Li <li...@gmail.com>.
+1 for dropping the MapR FS.
Till Rohrmann <tr...@apache.org> 于2022年1月5日周三 18:33写道：
> +1 for dropping the MapR FS.
>
> Cheers,
> Till
>
> On Wed, Jan 5, 2022 at 10:11 AM Martijn Visser <ma...@ververica.com>
> wrote:
>
> > Hi everyone,
> >
> > Thanks for your input. I've checked the MapR implementation and it has no
> > annotation at all. Given the circumstances that we thought that MapR was
> > already dropped, I would propose to immediately remove MapR in Flink 1.15
> > instead of first marking it as deprecated and removing it in Flink 1.16.
> >
> > Please let me know what you think.
> >
> > Best regards,
> >
> > Martijn
> >
> > On Thu, 9 Dec 2021 at 17:27, David Morávek <dm...@apache.org> wrote:
> >
> >> +1, agreed with Seth's reasoning. There has been no real activity in
> MapR
> >> FS module for years [1], so the eventual users should be good with using
> >> the jars from the older Flink versions for quite some time
> >>
> >> [1]
> >>
> https://github.com/apache/flink/commits/master/flink-filesystems/flink-mapr-fs
> >>
> >> Best,
> >> D.
> >>
> >> On Thu, Dec 9, 2021 at 4:28 PM Konstantin Knauf <kn...@apache.org>
> >> wrote:
> >>
> >>> +1 (what Seth said)
> >>>
> >>> On Thu, Dec 9, 2021 at 4:15 PM Seth Wiesman <sj...@gmail.com>
> wrote:
> >>>
> >>> > +1
> >>> >
> >>> > I actually thought we had already dropped this FS. If anyone is still
> >>> > relying on it in production, the file system abstraction in Flink has
> >>> been
> >>> > incredibly stable over the years. They should be able to use the 1.14
> >>> MapR
> >>> > FS with later versions of Flink.
> >>> >
> >>> > Seth
> >>> >
> >>> > On Wed, Dec 8, 2021 at 10:03 AM Martijn Visser <
> martijn@ververica.com>
> >>> > wrote:
> >>> >
> >>> >> Hi all,
> >>> >>
> >>> >> Flink supports multiple file systems [1] which includes MapR FS.
> MapR
> >>> as
> >>> >> a company doesn't exist anymore since 2019, the technology and
> >>> intellectual
> >>> >> property has been sold to Hewlett Packard.
> >>> >>
> >>> >> I don't think that there's anyone who's using MapR anymore and
> >>> therefore
> >>> >> I think it would be good to deprecate this for Flink 1.15 and then
> >>> remove
> >>> >> it in Flink 1.16. Removing this from Flink will slightly shrink the
> >>> >> codebase and CI runtime.
> >>> >>
> >>> >> I'm also cross posting this to the User mailing list, in case
> there's
> >>> >> still anyone who's using MapR.
> >>> >>
> >>> >> Best regards,
> >>> >>
> >>> >> Martijn
> >>> >>
> >>> >> [1]
> >>> >>
> >>>
> https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/overview/
> >>> >>
> >>> >
> >>>
> >>> --
> >>>
> >>> Konstantin Knauf
> >>>
> >>> https://twitter.com/snntrable
> >>>
> >>> https://github.com/knaufk
> >>>
> >>
>
Re: [DISCUSS] Deprecate MapR FS
Posted by Till Rohrmann <tr...@apache.org>.
+1 for dropping the MapR FS.
Cheers,
Till
On Wed, Jan 5, 2022 at 10:11 AM Martijn Visser <ma...@ververica.com>
wrote:
> Hi everyone,
>
> Thanks for your input. I've checked the MapR implementation and it has no
> annotation at all. Given the circumstances that we thought that MapR was
> already dropped, I would propose to immediately remove MapR in Flink 1.15
> instead of first marking it as deprecated and removing it in Flink 1.16.
>
> Please let me know what you think.
>
> Best regards,
>
> Martijn
>
> On Thu, 9 Dec 2021 at 17:27, David Morávek <dm...@apache.org> wrote:
>
>> +1, agreed with Seth's reasoning. There has been no real activity in MapR
>> FS module for years [1], so the eventual users should be good with using
>> the jars from the older Flink versions for quite some time
>>
>> [1]
>> https://github.com/apache/flink/commits/master/flink-filesystems/flink-mapr-fs
>>
>> Best,
>> D.
>>
>> On Thu, Dec 9, 2021 at 4:28 PM Konstantin Knauf <kn...@apache.org>
>> wrote:
>>
>>> +1 (what Seth said)
>>>
>>> On Thu, Dec 9, 2021 at 4:15 PM Seth Wiesman <sj...@gmail.com> wrote:
>>>
>>> > +1
>>> >
>>> > I actually thought we had already dropped this FS. If anyone is still
>>> > relying on it in production, the file system abstraction in Flink has
>>> been
>>> > incredibly stable over the years. They should be able to use the 1.14
>>> MapR
>>> > FS with later versions of Flink.
>>> >
>>> > Seth
>>> >
>>> > On Wed, Dec 8, 2021 at 10:03 AM Martijn Visser <ma...@ververica.com>
>>> > wrote:
>>> >
>>> >> Hi all,
>>> >>
>>> >> Flink supports multiple file systems [1] which includes MapR FS. MapR
>>> as
>>> >> a company doesn't exist anymore since 2019, the technology and
>>> intellectual
>>> >> property has been sold to Hewlett Packard.
>>> >>
>>> >> I don't think that there's anyone who's using MapR anymore and
>>> therefore
>>> >> I think it would be good to deprecate this for Flink 1.15 and then
>>> remove
>>> >> it in Flink 1.16. Removing this from Flink will slightly shrink the
>>> >> codebase and CI runtime.
>>> >>
>>> >> I'm also cross posting this to the User mailing list, in case there's
>>> >> still anyone who's using MapR.
>>> >>
>>> >> Best regards,
>>> >>
>>> >> Martijn
>>> >>
>>> >> [1]
>>> >>
>>> https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/overview/
>>> >>
>>> >
>>>
>>> --
>>>
>>> Konstantin Knauf
>>>
>>> https://twitter.com/snntrable
>>>
>>> https://github.com/knaufk
>>>
>>
Re: [DISCUSS] Deprecate MapR FS
Posted by Till Rohrmann <tr...@apache.org>.
+1 for dropping the MapR FS.
Cheers,
Till
On Wed, Jan 5, 2022 at 10:11 AM Martijn Visser <ma...@ververica.com>
wrote:
> Hi everyone,
>
> Thanks for your input. I've checked the MapR implementation and it has no
> annotation at all. Given the circumstances that we thought that MapR was
> already dropped, I would propose to immediately remove MapR in Flink 1.15
> instead of first marking it as deprecated and removing it in Flink 1.16.
>
> Please let me know what you think.
>
> Best regards,
>
> Martijn
>
> On Thu, 9 Dec 2021 at 17:27, David Morávek <dm...@apache.org> wrote:
>
>> +1, agreed with Seth's reasoning. There has been no real activity in MapR
>> FS module for years [1], so the eventual users should be good with using
>> the jars from the older Flink versions for quite some time
>>
>> [1]
>> https://github.com/apache/flink/commits/master/flink-filesystems/flink-mapr-fs
>>
>> Best,
>> D.
>>
>> On Thu, Dec 9, 2021 at 4:28 PM Konstantin Knauf <kn...@apache.org>
>> wrote:
>>
>>> +1 (what Seth said)
>>>
>>> On Thu, Dec 9, 2021 at 4:15 PM Seth Wiesman <sj...@gmail.com> wrote:
>>>
>>> > +1
>>> >
>>> > I actually thought we had already dropped this FS. If anyone is still
>>> > relying on it in production, the file system abstraction in Flink has
>>> been
>>> > incredibly stable over the years. They should be able to use the 1.14
>>> MapR
>>> > FS with later versions of Flink.
>>> >
>>> > Seth
>>> >
>>> > On Wed, Dec 8, 2021 at 10:03 AM Martijn Visser <ma...@ververica.com>
>>> > wrote:
>>> >
>>> >> Hi all,
>>> >>
>>> >> Flink supports multiple file systems [1] which includes MapR FS. MapR
>>> as
>>> >> a company doesn't exist anymore since 2019, the technology and
>>> intellectual
>>> >> property has been sold to Hewlett Packard.
>>> >>
>>> >> I don't think that there's anyone who's using MapR anymore and
>>> therefore
>>> >> I think it would be good to deprecate this for Flink 1.15 and then
>>> remove
>>> >> it in Flink 1.16. Removing this from Flink will slightly shrink the
>>> >> codebase and CI runtime.
>>> >>
>>> >> I'm also cross posting this to the User mailing list, in case there's
>>> >> still anyone who's using MapR.
>>> >>
>>> >> Best regards,
>>> >>
>>> >> Martijn
>>> >>
>>> >> [1]
>>> >>
>>> https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/overview/
>>> >>
>>> >
>>>
>>> --
>>>
>>> Konstantin Knauf
>>>
>>> https://twitter.com/snntrable
>>>
>>> https://github.com/knaufk
>>>
>>
Re: [DISCUSS] Deprecate MapR FS
Posted by Martijn Visser <ma...@ververica.com>.
Hi everyone,
Thanks for your input. I've checked the MapR implementation and it has no
annotation at all. Given the circumstances that we thought that MapR was
already dropped, I would propose to immediately remove MapR in Flink 1.15
instead of first marking it as deprecated and removing it in Flink 1.16.
Please let me know what you think.
Best regards,
Martijn
On Thu, 9 Dec 2021 at 17:27, David Morávek <dm...@apache.org> wrote:
> +1, agreed with Seth's reasoning. There has been no real activity in MapR
> FS module for years [1], so the eventual users should be good with using
> the jars from the older Flink versions for quite some time
>
> [1]
> https://github.com/apache/flink/commits/master/flink-filesystems/flink-mapr-fs
>
> Best,
> D.
>
> On Thu, Dec 9, 2021 at 4:28 PM Konstantin Knauf <kn...@apache.org> wrote:
>
>> +1 (what Seth said)
>>
>> On Thu, Dec 9, 2021 at 4:15 PM Seth Wiesman <sj...@gmail.com> wrote:
>>
>> > +1
>> >
>> > I actually thought we had already dropped this FS. If anyone is still
>> > relying on it in production, the file system abstraction in Flink has
>> been
>> > incredibly stable over the years. They should be able to use the 1.14
>> MapR
>> > FS with later versions of Flink.
>> >
>> > Seth
>> >
>> > On Wed, Dec 8, 2021 at 10:03 AM Martijn Visser <ma...@ververica.com>
>> > wrote:
>> >
>> >> Hi all,
>> >>
>> >> Flink supports multiple file systems [1] which includes MapR FS. MapR
>> as
>> >> a company doesn't exist anymore since 2019, the technology and
>> intellectual
>> >> property has been sold to Hewlett Packard.
>> >>
>> >> I don't think that there's anyone who's using MapR anymore and
>> therefore
>> >> I think it would be good to deprecate this for Flink 1.15 and then
>> remove
>> >> it in Flink 1.16. Removing this from Flink will slightly shrink the
>> >> codebase and CI runtime.
>> >>
>> >> I'm also cross posting this to the User mailing list, in case there's
>> >> still anyone who's using MapR.
>> >>
>> >> Best regards,
>> >>
>> >> Martijn
>> >>
>> >> [1]
>> >>
>> https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/overview/
>> >>
>> >
>>
>> --
>>
>> Konstantin Knauf
>>
>> https://twitter.com/snntrable
>>
>> https://github.com/knaufk
>>
>
Re: [DISCUSS] Deprecate MapR FS
Posted by Martijn Visser <ma...@ververica.com>.
Hi everyone,
Thanks for your input. I've checked the MapR implementation and it has no
annotation at all. Given the circumstances that we thought that MapR was
already dropped, I would propose to immediately remove MapR in Flink 1.15
instead of first marking it as deprecated and removing it in Flink 1.16.
Please let me know what you think.
Best regards,
Martijn
On Thu, 9 Dec 2021 at 17:27, David Morávek <dm...@apache.org> wrote:
> +1, agreed with Seth's reasoning. There has been no real activity in MapR
> FS module for years [1], so the eventual users should be good with using
> the jars from the older Flink versions for quite some time
>
> [1]
> https://github.com/apache/flink/commits/master/flink-filesystems/flink-mapr-fs
>
> Best,
> D.
>
> On Thu, Dec 9, 2021 at 4:28 PM Konstantin Knauf <kn...@apache.org> wrote:
>
>> +1 (what Seth said)
>>
>> On Thu, Dec 9, 2021 at 4:15 PM Seth Wiesman <sj...@gmail.com> wrote:
>>
>> > +1
>> >
>> > I actually thought we had already dropped this FS. If anyone is still
>> > relying on it in production, the file system abstraction in Flink has
>> been
>> > incredibly stable over the years. They should be able to use the 1.14
>> MapR
>> > FS with later versions of Flink.
>> >
>> > Seth
>> >
>> > On Wed, Dec 8, 2021 at 10:03 AM Martijn Visser <ma...@ververica.com>
>> > wrote:
>> >
>> >> Hi all,
>> >>
>> >> Flink supports multiple file systems [1] which includes MapR FS. MapR
>> as
>> >> a company doesn't exist anymore since 2019, the technology and
>> intellectual
>> >> property has been sold to Hewlett Packard.
>> >>
>> >> I don't think that there's anyone who's using MapR anymore and
>> therefore
>> >> I think it would be good to deprecate this for Flink 1.15 and then
>> remove
>> >> it in Flink 1.16. Removing this from Flink will slightly shrink the
>> >> codebase and CI runtime.
>> >>
>> >> I'm also cross posting this to the User mailing list, in case there's
>> >> still anyone who's using MapR.
>> >>
>> >> Best regards,
>> >>
>> >> Martijn
>> >>
>> >> [1]
>> >>
>> https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/overview/
>> >>
>> >
>>
>> --
>>
>> Konstantin Knauf
>>
>> https://twitter.com/snntrable
>>
>> https://github.com/knaufk
>>
>
Re: [DISCUSS] Deprecate MapR FS
Posted by David Morávek <dm...@apache.org>.
+1, agreed with Seth's reasoning. There has been no real activity in MapR
FS module for years [1], so the eventual users should be good with using
the jars from the older Flink versions for quite some time
[1]
https://github.com/apache/flink/commits/master/flink-filesystems/flink-mapr-fs
Best,
D.
On Thu, Dec 9, 2021 at 4:28 PM Konstantin Knauf <kn...@apache.org> wrote:
> +1 (what Seth said)
>
> On Thu, Dec 9, 2021 at 4:15 PM Seth Wiesman <sj...@gmail.com> wrote:
>
> > +1
> >
> > I actually thought we had already dropped this FS. If anyone is still
> > relying on it in production, the file system abstraction in Flink has
> been
> > incredibly stable over the years. They should be able to use the 1.14
> MapR
> > FS with later versions of Flink.
> >
> > Seth
> >
> > On Wed, Dec 8, 2021 at 10:03 AM Martijn Visser <ma...@ververica.com>
> > wrote:
> >
> >> Hi all,
> >>
> >> Flink supports multiple file systems [1] which includes MapR FS. MapR as
> >> a company doesn't exist anymore since 2019, the technology and
> intellectual
> >> property has been sold to Hewlett Packard.
> >>
> >> I don't think that there's anyone who's using MapR anymore and therefore
> >> I think it would be good to deprecate this for Flink 1.15 and then
> remove
> >> it in Flink 1.16. Removing this from Flink will slightly shrink the
> >> codebase and CI runtime.
> >>
> >> I'm also cross posting this to the User mailing list, in case there's
> >> still anyone who's using MapR.
> >>
> >> Best regards,
> >>
> >> Martijn
> >>
> >> [1]
> >>
> https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/overview/
> >>
> >
>
> --
>
> Konstantin Knauf
>
> https://twitter.com/snntrable
>
> https://github.com/knaufk
>
Re: [DISCUSS] Deprecate MapR FS
Posted by David Morávek <dm...@apache.org>.
+1, agreed with Seth's reasoning. There has been no real activity in MapR
FS module for years [1], so the eventual users should be good with using
the jars from the older Flink versions for quite some time
[1]
https://github.com/apache/flink/commits/master/flink-filesystems/flink-mapr-fs
Best,
D.
On Thu, Dec 9, 2021 at 4:28 PM Konstantin Knauf <kn...@apache.org> wrote:
> +1 (what Seth said)
>
> On Thu, Dec 9, 2021 at 4:15 PM Seth Wiesman <sj...@gmail.com> wrote:
>
> > +1
> >
> > I actually thought we had already dropped this FS. If anyone is still
> > relying on it in production, the file system abstraction in Flink has
> been
> > incredibly stable over the years. They should be able to use the 1.14
> MapR
> > FS with later versions of Flink.
> >
> > Seth
> >
> > On Wed, Dec 8, 2021 at 10:03 AM Martijn Visser <ma...@ververica.com>
> > wrote:
> >
> >> Hi all,
> >>
> >> Flink supports multiple file systems [1] which includes MapR FS. MapR as
> >> a company doesn't exist anymore since 2019, the technology and
> intellectual
> >> property has been sold to Hewlett Packard.
> >>
> >> I don't think that there's anyone who's using MapR anymore and therefore
> >> I think it would be good to deprecate this for Flink 1.15 and then
> remove
> >> it in Flink 1.16. Removing this from Flink will slightly shrink the
> >> codebase and CI runtime.
> >>
> >> I'm also cross posting this to the User mailing list, in case there's
> >> still anyone who's using MapR.
> >>
> >> Best regards,
> >>
> >> Martijn
> >>
> >> [1]
> >>
> https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/overview/
> >>
> >
>
> --
>
> Konstantin Knauf
>
> https://twitter.com/snntrable
>
> https://github.com/knaufk
>
Re: [DISCUSS] Deprecate MapR FS
Posted by Konstantin Knauf <kn...@apache.org>.
+1 (what Seth said)
On Thu, Dec 9, 2021 at 4:15 PM Seth Wiesman <sj...@gmail.com> wrote:
> +1
>
> I actually thought we had already dropped this FS. If anyone is still
> relying on it in production, the file system abstraction in Flink has been
> incredibly stable over the years. They should be able to use the 1.14 MapR
> FS with later versions of Flink.
>
> Seth
>
> On Wed, Dec 8, 2021 at 10:03 AM Martijn Visser <ma...@ververica.com>
> wrote:
>
>> Hi all,
>>
>> Flink supports multiple file systems [1] which includes MapR FS. MapR as
>> a company doesn't exist anymore since 2019, the technology and intellectual
>> property has been sold to Hewlett Packard.
>>
>> I don't think that there's anyone who's using MapR anymore and therefore
>> I think it would be good to deprecate this for Flink 1.15 and then remove
>> it in Flink 1.16. Removing this from Flink will slightly shrink the
>> codebase and CI runtime.
>>
>> I'm also cross posting this to the User mailing list, in case there's
>> still anyone who's using MapR.
>>
>> Best regards,
>>
>> Martijn
>>
>> [1]
>> https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/overview/
>>
>
--
Konstantin Knauf
https://twitter.com/snntrable
https://github.com/knaufk
Re: [DISCUSS] Deprecate MapR FS
Posted by Konstantin Knauf <kn...@apache.org>.
+1 (what Seth said)
On Thu, Dec 9, 2021 at 4:15 PM Seth Wiesman <sj...@gmail.com> wrote:
> +1
>
> I actually thought we had already dropped this FS. If anyone is still
> relying on it in production, the file system abstraction in Flink has been
> incredibly stable over the years. They should be able to use the 1.14 MapR
> FS with later versions of Flink.
>
> Seth
>
> On Wed, Dec 8, 2021 at 10:03 AM Martijn Visser <ma...@ververica.com>
> wrote:
>
>> Hi all,
>>
>> Flink supports multiple file systems [1] which includes MapR FS. MapR as
>> a company doesn't exist anymore since 2019, the technology and intellectual
>> property has been sold to Hewlett Packard.
>>
>> I don't think that there's anyone who's using MapR anymore and therefore
>> I think it would be good to deprecate this for Flink 1.15 and then remove
>> it in Flink 1.16. Removing this from Flink will slightly shrink the
>> codebase and CI runtime.
>>
>> I'm also cross posting this to the User mailing list, in case there's
>> still anyone who's using MapR.
>>
>> Best regards,
>>
>> Martijn
>>
>> [1]
>> https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/overview/
>>
>
--
Konstantin Knauf
https://twitter.com/snntrable
https://github.com/knaufk
Re: [DISCUSS] Deprecate MapR FS
Posted by Seth Wiesman <sj...@gmail.com>.
+1
I actually thought we had already dropped this FS. If anyone is still
relying on it in production, the file system abstraction in Flink has been
incredibly stable over the years. They should be able to use the 1.14 MapR
FS with later versions of Flink.
Seth
On Wed, Dec 8, 2021 at 10:03 AM Martijn Visser <ma...@ververica.com>
wrote:
> Hi all,
>
> Flink supports multiple file systems [1] which includes MapR FS. MapR as a
> company doesn't exist anymore since 2019, the technology and intellectual
> property has been sold to Hewlett Packard.
>
> I don't think that there's anyone who's using MapR anymore and therefore I
> think it would be good to deprecate this for Flink 1.15 and then remove it
> in Flink 1.16. Removing this from Flink will slightly shrink the codebase
> and CI runtime.
>
> I'm also cross posting this to the User mailing list, in case there's
> still anyone who's using MapR.
>
> Best regards,
>
> Martijn
>
> [1]
> https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/overview/
>
Re: [DISCUSS] Deprecate MapR FS
Posted by Seth Wiesman <sj...@gmail.com>.
+1
I actually thought we had already dropped this FS. If anyone is still
relying on it in production, the file system abstraction in Flink has been
incredibly stable over the years. They should be able to use the 1.14 MapR
FS with later versions of Flink.
Seth
On Wed, Dec 8, 2021 at 10:03 AM Martijn Visser <ma...@ververica.com>
wrote:
> Hi all,
>
> Flink supports multiple file systems [1] which includes MapR FS. MapR as a
> company doesn't exist anymore since 2019, the technology and intellectual
> property has been sold to Hewlett Packard.
>
> I don't think that there's anyone who's using MapR anymore and therefore I
> think it would be good to deprecate this for Flink 1.15 and then remove it
> in Flink 1.16. Removing this from Flink will slightly shrink the codebase
> and CI runtime.
>
> I'm also cross posting this to the User mailing list, in case there's
> still anyone who's using MapR.
>
> Best regards,
>
> Martijn
>
> [1]
> https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/overview/
>