You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@impala.apache.org by Rahul P <ra...@gmail.com> on 2025/05/15 06:02:47 UTC
Impala with apche hive suppport or not ?
Dear All
I am using apache impala 4.5.0. I built it from source & by default it's
using *cloudera components* while building .
When starting *catalogd *service getting method not found error.
Please let me know whether Impala will support *apache hive *(3.1.3) or
not.
Thanks & Regards
Rahul
Re: Impala with apche hive suppport or not ?
Posted by Quanlong Huang <hu...@gmail.com>.
Hi Rahul,
I don't have a good answer for this. The CDP Hive version
3.1.3000.7.3.1.0-160 is the one that is used by all tests of Impala
4.5.0. We don't run full tests regularly on Apache Hive 3.1.3 so there
might be bugs. Most of the issues we saw with Apache Hive 3 are on
transactional tables (including insert-only and full ACID) and HMS
notification events processing. So I think if you don't use
transactional tables and the HMS EventProcessor, Impala should work
well. The way to disable HMS EventProcessor is adding
--hms_event_polling_interval_s=0 to the startup flag of catalogd.
If you encounter any problems, please let us know.
Thanks,
Quanlong
On Thu, May 15, 2025 at 9:07 PM Rahul P <ra...@gmail.com> wrote:
>
> Hi Quanlong
>
> Thanks for the reply.
>
> I am able to build Impala with apache hive-3.1.3 for RHEL 9.
>
> Apache hive 3.1.3 is part of my bigtop clusrer.
>
> Is it good idea to proceed apache impala 4.5.0 with apache hive 3.1.3 for production?
>
> Which hive version is recommened for productiom use with impala?
>
> Thanks
> Rahul
>
>
> On Thu, 15 May, 2025, 15:19 Quanlong Huang, <hu...@gmail.com> wrote:
>>
>> Hi Rahul,
>>
>> Please try building Impala with the environment variable
>> USE_APACHE_COMPONENTS=true. With that Impala will build on Apache Hive
>> 3.1.3.
>>
>> Note that Impala has limited support on Apache Hive 3.1.3. There are
>> some remaining issues tracked in
>> https://issues.apache.org/jira/browse/IMPALA-10847 . Welcome
>> contributions!
>>
>> Thanks,
>> Quanlong
>>
>> On Thu, May 15, 2025 at 2:04 PM Rahul P <ra...@gmail.com> wrote:
>> >
>> > Dear All
>> >
>> > I am using apache impala 4.5.0. I built it from source & by default it's using cloudera components while building .
>> >
>> > When starting catalogd service getting method not found error.
>> >
>> > Please let me know whether Impala will support apache hive (3.1.3) or not.
>> >
>> >
>> > Thanks & Regards
>> > Rahul
>>
Re: Impala with apche hive suppport or not ?
Posted by Rahul P <ra...@gmail.com>.
Hi Quanlong
Thanks for the reply.
I am able to build Impala with apache hive-3.1.3 for RHEL 9.
Apache hive 3.1.3 is part of my bigtop clusrer.
Is it good idea to proceed apache impala 4.5.0 with apache hive 3.1.3 for
production?
Which hive version is recommened for productiom use with impala?
Thanks
Rahul
On Thu, 15 May, 2025, 15:19 Quanlong Huang, <hu...@gmail.com> wrote:
> Hi Rahul,
>
> Please try building Impala with the environment variable
> USE_APACHE_COMPONENTS=true. With that Impala will build on Apache Hive
> 3.1.3.
>
> Note that Impala has limited support on Apache Hive 3.1.3. There are
> some remaining issues tracked in
> https://issues.apache.org/jira/browse/IMPALA-10847 . Welcome
> contributions!
>
> Thanks,
> Quanlong
>
> On Thu, May 15, 2025 at 2:04 PM Rahul P <ra...@gmail.com> wrote:
> >
> > Dear All
> >
> > I am using apache impala 4.5.0. I built it from source & by default it's
> using cloudera components while building .
> >
> > When starting catalogd service getting method not found error.
> >
> > Please let me know whether Impala will support apache hive (3.1.3) or
> not.
> >
> >
> > Thanks & Regards
> > Rahul
>
>
Re: Impala with apche hive suppport or not ?
Posted by Quanlong Huang <hu...@gmail.com>.
Hi Rahul,
Please try building Impala with the environment variable
USE_APACHE_COMPONENTS=true. With that Impala will build on Apache Hive
3.1.3.
Note that Impala has limited support on Apache Hive 3.1.3. There are
some remaining issues tracked in
https://issues.apache.org/jira/browse/IMPALA-10847 . Welcome
contributions!
Thanks,
Quanlong
On Thu, May 15, 2025 at 2:04 PM Rahul P <ra...@gmail.com> wrote:
>
> Dear All
>
> I am using apache impala 4.5.0. I built it from source & by default it's using cloudera components while building .
>
> When starting catalogd service getting method not found error.
>
> Please let me know whether Impala will support apache hive (3.1.3) or not.
>
>
> Thanks & Regards
> Rahul