You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Richard Zowalla <rz...@apache.org> on 2024/11/13 07:20:13 UTC

[DISCUSS] Dropping Hive Support in next Apache Storm Release

Hi all,

As of now, Hive 3.x has reached end-of-life (see https://hive.apache.org/general/downloads/ ), and we need to consider upgrading to Hive 4.0.x. This upgrade would require us to replace hive-hcatalog-streaming with hive-streaming.

I reached out to one of the Hive developers regarding any available documentation on this migration, but unfortunately, no such documentation currently exists. At a first glance it seems, that we need some rewriting of the related module in order to get it running. The original developers are long gone.

Since we cannot rely on EOL software from a security perspective (given the implications by CRA, etc.), we need to consider how to handle that situation. 

Do we have any Hive users willing to do the upgrade? Otherwise, given these circumstances, I’d like to open up a discussion on potentially dropping Hive support in the next Apache Storm release. 

Please let me know your thoughts or concerns.

Gruß

Richard



P.S. I cross posted this discussion to user@ in order to get some traction from our community. Maybe someone is willing to do the upgrade ;-) If so, please subscribe to dev@ and reply there.

Re: [DISCUSS] Dropping Hive Support in next Apache Storm Release

Posted by Julien Nioche <li...@gmail.com>.
+1 for dropping Hive (jnioche)

On Wed, 13 Nov 2024 at 16:46, Alexandre Vermeerbergen <
avermeerbergen@gmail.com> wrote:

> +1 (binding) for dropping Hive support
>
> Alexandre
>
> Le mer. 13 nov. 2024 à 17:31, Rui Abreu <ru...@gmail.com> a écrit :
> >
> > I agree with keeping this open until the next release is close and
> > drop it if there is no interest from the community in rewriting the
> > code.
> >
> > Thank you @Richard Zowalla
> >
> > On Wed, 13 Nov 2024 at 07:26, Jonas Krauss <jk...@gmail.com> wrote:
> > >
> > > Hi Richard,
> > >
> > > thanks for being communicative about changes like this, I really
> appreciate it.
> > >
> > > For us, as we do not use Hive at all, dropping the support is not an
> issue and I would rather like dev resources invested elsewhere.
> > >
> > > Regards/Gruß
> > >
> > > Jonas
> > >
> > > Am Mi., 13. Nov. 2024 um 08:21 Uhr schrieb Richard Zowalla <
> rzo1@apache.org>:
> > >>
> > >> Hi all,
> > >>
> > >> As of now, Hive 3.x has reached end-of-life (see
> https://hive.apache.org/general/downloads/ ), and we need to consider
> upgrading to Hive 4.0.x. This upgrade would require us to replace
> hive-hcatalog-streaming with hive-streaming.
> > >>
> > >> I reached out to one of the Hive developers regarding any available
> documentation on this migration, but unfortunately, no such documentation
> currently exists. At a first glance it seems, that we need some rewriting
> of the related module in order to get it running. The original developers
> are long gone.
> > >>
> > >> Since we cannot rely on EOL software from a security perspective
> (given the implications by CRA, etc.), we need to consider how to handle
> that situation.
> > >>
> > >> Do we have any Hive users willing to do the upgrade? Otherwise, given
> these circumstances, I’d like to open up a discussion on potentially
> dropping Hive support in the next Apache Storm release.
> > >>
> > >> Please let me know your thoughts or concerns.
> > >>
> > >> Gruß
> > >>
> > >> Richard
> > >>
> > >>
> > >> P.S. I cross posted this discussion to user@ in order to get some
> traction from our community. Maybe someone is willing to do the upgrade ;-)
> If so, please subscribe to dev@ and reply there.
>


-- 
*Julien Nioche *


digitalpebble.com <http://www.digitalpebble.com/>

Re: [DISCUSS] Dropping Hive Support in next Apache Storm Release

Posted by Alexandre Vermeerbergen <av...@gmail.com>.
+1 (binding) for dropping Hive support

Alexandre

Le mer. 13 nov. 2024 à 17:31, Rui Abreu <ru...@gmail.com> a écrit :
>
> I agree with keeping this open until the next release is close and
> drop it if there is no interest from the community in rewriting the
> code.
>
> Thank you @Richard Zowalla
>
> On Wed, 13 Nov 2024 at 07:26, Jonas Krauss <jk...@gmail.com> wrote:
> >
> > Hi Richard,
> >
> > thanks for being communicative about changes like this, I really appreciate it.
> >
> > For us, as we do not use Hive at all, dropping the support is not an issue and I would rather like dev resources invested elsewhere.
> >
> > Regards/Gruß
> >
> > Jonas
> >
> > Am Mi., 13. Nov. 2024 um 08:21 Uhr schrieb Richard Zowalla <rz...@apache.org>:
> >>
> >> Hi all,
> >>
> >> As of now, Hive 3.x has reached end-of-life (see https://hive.apache.org/general/downloads/ ), and we need to consider upgrading to Hive 4.0.x. This upgrade would require us to replace hive-hcatalog-streaming with hive-streaming.
> >>
> >> I reached out to one of the Hive developers regarding any available documentation on this migration, but unfortunately, no such documentation currently exists. At a first glance it seems, that we need some rewriting of the related module in order to get it running. The original developers are long gone.
> >>
> >> Since we cannot rely on EOL software from a security perspective (given the implications by CRA, etc.), we need to consider how to handle that situation.
> >>
> >> Do we have any Hive users willing to do the upgrade? Otherwise, given these circumstances, I’d like to open up a discussion on potentially dropping Hive support in the next Apache Storm release.
> >>
> >> Please let me know your thoughts or concerns.
> >>
> >> Gruß
> >>
> >> Richard
> >>
> >>
> >> P.S. I cross posted this discussion to user@ in order to get some traction from our community. Maybe someone is willing to do the upgrade ;-) If so, please subscribe to dev@ and reply there.

Re: [DISCUSS] Dropping Hive Support in next Apache Storm Release

Posted by Rui Abreu <ru...@gmail.com>.
I agree with keeping this open until the next release is close and
drop it if there is no interest from the community in rewriting the
code.

Thank you @Richard Zowalla

On Wed, 13 Nov 2024 at 07:26, Jonas Krauss <jk...@gmail.com> wrote:
>
> Hi Richard,
>
> thanks for being communicative about changes like this, I really appreciate it.
>
> For us, as we do not use Hive at all, dropping the support is not an issue and I would rather like dev resources invested elsewhere.
>
> Regards/Gruß
>
> Jonas
>
> Am Mi., 13. Nov. 2024 um 08:21 Uhr schrieb Richard Zowalla <rz...@apache.org>:
>>
>> Hi all,
>>
>> As of now, Hive 3.x has reached end-of-life (see https://hive.apache.org/general/downloads/ ), and we need to consider upgrading to Hive 4.0.x. This upgrade would require us to replace hive-hcatalog-streaming with hive-streaming.
>>
>> I reached out to one of the Hive developers regarding any available documentation on this migration, but unfortunately, no such documentation currently exists. At a first glance it seems, that we need some rewriting of the related module in order to get it running. The original developers are long gone.
>>
>> Since we cannot rely on EOL software from a security perspective (given the implications by CRA, etc.), we need to consider how to handle that situation.
>>
>> Do we have any Hive users willing to do the upgrade? Otherwise, given these circumstances, I’d like to open up a discussion on potentially dropping Hive support in the next Apache Storm release.
>>
>> Please let me know your thoughts or concerns.
>>
>> Gruß
>>
>> Richard
>>
>>
>> P.S. I cross posted this discussion to user@ in order to get some traction from our community. Maybe someone is willing to do the upgrade ;-) If so, please subscribe to dev@ and reply there.

Re: [DISCUSS] Dropping Hive Support in next Apache Storm Release

Posted by Jonas Krauss <jk...@gmail.com>.
Hi Richard,

thanks for being communicative about changes like this, I really appreciate
it.

For us, as we do not use Hive at all, dropping the support is not an issue
and I would rather like dev resources invested elsewhere.

Regards/Gruß

Jonas

Am Mi., 13. Nov. 2024 um 08:21 Uhr schrieb Richard Zowalla <rzo1@apache.org
>:

> Hi all,
>
> As of now, Hive 3.x has reached end-of-life (see
> https://hive.apache.org/general/downloads/ ), and we need to consider
> upgrading to Hive 4.0.x. This upgrade would require us to replace
> hive-hcatalog-streaming with hive-streaming.
>
> I reached out to one of the Hive developers regarding any available
> documentation on this migration, but unfortunately, no such documentation
> currently exists. At a first glance it seems, that we need some rewriting
> of the related module in order to get it running. The original developers
> are long gone.
>
> Since we cannot rely on EOL software from a security perspective (given
> the implications by CRA, etc.), we need to consider how to handle that
> situation.
>
> Do we have any Hive users willing to do the upgrade? Otherwise, given
> these circumstances, I’d like to open up a discussion on potentially
> dropping Hive support in the next Apache Storm release.
>
> Please let me know your thoughts or concerns.
>
> Gruß
>
> Richard
>
>
> P.S. I cross posted this discussion to user@ in order to get some
> traction from our community. Maybe someone is willing to do the upgrade ;-)
> If so, please subscribe to dev@ and reply there.
>

Re: [DISCUSS] Dropping Hive Support in next Apache Storm Release

Posted by Richard Zowalla <rz...@apache.org>.
Hi Roshan,

I have marked the classes for removal, so users are aware of it.

Gruß
Richard

> Am 18.11.2024 um 00:15 schrieb Roshan Naik <ro...@yahoo.com.INVALID>:
> 
> Should this be marked as deprecated before dropping entirely ?
> 
> -roshan
> 
> 
> 
> 
> 
> 
> On Sunday, November 17, 2024 at 12:00:51 PM PST, Richard Zowalla <rz...@apache.org> wrote: 
> 
> 
> 
> 
> 
> Looks like we reached consensus here. 
> 
> Let’s drop Hive support after the next release. Will sent a mail shortly.
> 
> Gruß
> Richard
> 
>> Am 13.11.2024 um 08:20 schrieb Richard Zowalla <rz...@apache.org>:
>> 
>> Hi all,
>> 
>> As of now, Hive 3.x has reached end-of-life (see https://hive.apache.org/general/downloads/ ), and we need to consider upgrading to Hive 4.0.x. This upgrade would require us to replace hive-hcatalog-streaming with hive-streaming.
>> 
>> I reached out to one of the Hive developers regarding any available documentation on this migration, but unfortunately, no such documentation currently exists. At a first glance it seems, that we need some rewriting of the related module in order to get it running. The original developers are long gone.
>> 
>> Since we cannot rely on EOL software from a security perspective (given the implications by CRA, etc.), we need to consider how to handle that situation. 
>> 
>> Do we have any Hive users willing to do the upgrade? Otherwise, given these circumstances, I’d like to open up a discussion on potentially dropping Hive support in the next Apache Storm release. 
>> 
>> Please let me know your thoughts or concerns.
>> 
>> Gruß
>> 
>> Richard
>> 
>> 
>> 
>> P.S. I cross posted this discussion to user@ in order to get some traction from our community. Maybe someone is willing to do the upgrade ;-) If so, please subscribe to dev@ and reply there.
>> 
> 


Re: [DISCUSS] Dropping Hive Support in next Apache Storm Release

Posted by Roshan Naik <ro...@yahoo.com.INVALID>.
Should this be marked as deprecated before dropping entirely ?

-roshan






On Sunday, November 17, 2024 at 12:00:51 PM PST, Richard Zowalla <rz...@apache.org> wrote: 





Looks like we reached consensus here. 

Let’s drop Hive support after the next release. Will sent a mail shortly.

Gruß
Richard

> Am 13.11.2024 um 08:20 schrieb Richard Zowalla <rz...@apache.org>:
> 
> Hi all,
> 
> As of now, Hive 3.x has reached end-of-life (see https://hive.apache.org/general/downloads/ ), and we need to consider upgrading to Hive 4.0.x. This upgrade would require us to replace hive-hcatalog-streaming with hive-streaming.
> 
> I reached out to one of the Hive developers regarding any available documentation on this migration, but unfortunately, no such documentation currently exists. At a first glance it seems, that we need some rewriting of the related module in order to get it running. The original developers are long gone.
> 
> Since we cannot rely on EOL software from a security perspective (given the implications by CRA, etc.), we need to consider how to handle that situation. 
> 
> Do we have any Hive users willing to do the upgrade? Otherwise, given these circumstances, I’d like to open up a discussion on potentially dropping Hive support in the next Apache Storm release. 
> 
> Please let me know your thoughts or concerns.
> 
> Gruß
> 
> Richard
> 
> 
> 
> P.S. I cross posted this discussion to user@ in order to get some traction from our community. Maybe someone is willing to do the upgrade ;-) If so, please subscribe to dev@ and reply there.
> 


Re: [DISCUSS] Dropping Hive Support in next Apache Storm Release

Posted by Richard Zowalla <rz...@apache.org>.
Looks like we reached consensus here. 

Let’s drop Hive support after the next release. Will sent a mail shortly.

Gruß
Richard

> Am 13.11.2024 um 08:20 schrieb Richard Zowalla <rz...@apache.org>:
> 
> Hi all,
> 
> As of now, Hive 3.x has reached end-of-life (see https://hive.apache.org/general/downloads/ ), and we need to consider upgrading to Hive 4.0.x. This upgrade would require us to replace hive-hcatalog-streaming with hive-streaming.
> 
> I reached out to one of the Hive developers regarding any available documentation on this migration, but unfortunately, no such documentation currently exists. At a first glance it seems, that we need some rewriting of the related module in order to get it running. The original developers are long gone.
> 
> Since we cannot rely on EOL software from a security perspective (given the implications by CRA, etc.), we need to consider how to handle that situation. 
> 
> Do we have any Hive users willing to do the upgrade? Otherwise, given these circumstances, I’d like to open up a discussion on potentially dropping Hive support in the next Apache Storm release. 
> 
> Please let me know your thoughts or concerns.
> 
> Gruß
> 
> Richard
> 
> 
> 
> P.S. I cross posted this discussion to user@ in order to get some traction from our community. Maybe someone is willing to do the upgrade ;-) If so, please subscribe to dev@ and reply there.
>