You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@impala.apache.org by Quanlong Huang <hu...@gmail.com> on 2024/05/07 05:56:00 UTC

Re: [DISCUSS] Impala 4.4.0 release

Please also include some recent bug fixes like
https://issues.apache.org/jira/browse/IMPALA-13009

On Tue, Apr 30, 2024 at 7:27 PM Kurt Deschler <kd...@cloudera.com> wrote:

> Please include the new toolchain with IMPALA-13020.
>
> On Tue, Apr 30, 2024 at 4:46 AM Zoltán Borók-Nagy <bo...@apache.org>
> wrote:
>
> > Thanks Riza. This week I'm busy but next week I'll create an RC2.
> >
> > If anyone else wants me to add further patches to the release, please
> reply
> > to this thread.
> >
> > Cheers,
> >     Zoltán
> >
> > Riza Suminto <ri...@cloudera.com> ezt írta (időpont: 2024. ápr.
> > 26.,
> > P 16:41):
> >
> > > A small bug just found this week and I push a patch for review
> > > https://gerrit.cloudera.org/c/21340/
> > > The patch is trivial, but will change behavior of coordinator-only
> query
> > if
> > > Impala cluster does not have executor group set configuration (default
> > pool
> > > only).
> > > I'd like to include it in the 4.4.0 release if possible.
> > >
> > > There are also few patches related with Workload Management and Query
> > Live
> > > Table that is nice to have:
> > > https://gerrit.cloudera.org/c/21302/
> > > https://gerrit.cloudera.org/c/21351/
> > > https://gerrit.cloudera.org/c/21358/
> > > I'll defer to Michael if these can land soon or not.
> > >
> > > Regards,
> > > Riza
> > >
> > >
> > > On Tue, Apr 9, 2024 at 3:28 AM Zoltán Borók-Nagy <
> > boroknagyz@cloudera.com>
> > > wrote:
> > >
> > > > Thanks everyone for the feedback!
> > > >
> > > > If there's any work in progress that you want me to include in the
> 4.4
> > > > release, please let me know.
> > > >
> > > > Quanlong, OK, I'll take a look into how to build RPM/DEB packages,
> and
> > > > share them on https://impala.apache.org/downloads.html if I succeed.
> > > > First 3 CRs are already merged, the last one is WIP:
> > > > https://gerrit.cloudera.org/c/20263. I can wait for it if it can be
> > > merged
> > > > soon.
> > > >
> > > > Cheers,
> > > >     Zoltan
> > > >
> > > >
> > > > On Fri, Apr 5, 2024 at 7:21 AM Quanlong Huang <
> huangquanlong@gmail.com
> > >
> > > > wrote:
> > > >
> > > > > +1
> > > > >
> > > > > Thank Zoltan! I think it's also a good chance to release the
> binaries
> > > > since
> > > > > we already support building RPM/DEB packages. We can mark them as
> > > > > experimental and hopefully get some feedback from the community.
> > > > >
> > > > > Xiang Yang contributed some patches to improve the package support.
> > > It'd
> > > > be
> > > > > nice to get them merged in this release as well:
> > > > > https://gerrit.cloudera.org/c/20921
> > > > > https://gerrit.cloudera.org/c/20928
> > > > > https://gerrit.cloudera.org/c/20929
> > > > > https://gerrit.cloudera.org/c/20263
> > > > >
> > > > > Quanlong
> > > > >
> > > > > On Thu, Apr 4, 2024 at 6:10 AM Laszlo Gaal <la...@apache.org>
> > wrote:
> > > > >
> > > > > > +1
> > > > > >
> > > > > > thank you very much for volunteering to be the release manager,
> > much
> > > > > > appreciated.
> > > > > >
> > > > > >   - LaszloG
> > > > > >
> > > > > > On Wed, Apr 3, 2024 at 8:42 PM Riza Suminto <
> > > riza.suminto@cloudera.com
> > > > >
> > > > > > wrote:
> > > > > >
> > > > > > > +1
> > > > > > >
> > > > > > > On Wed, Apr 3, 2024 at 12:55 AM Gabor Kaszab <
> > > gaborkaszab@apache.org
> > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > > > The last release has been a while.. Indeed this is about time
> > to
> > > > > have a
> > > > > > > new
> > > > > > > > one. Thanks for bringing this up, Zoltan!
> > > > > > > > +1
> > > > > > > >
> > > > > > > > Let's gather the unfinished items that should make it to this
> > > > release
> > > > > > if
> > > > > > > > there are any!
> > > > > > > >
> > > > > > > > Gabor
> > > > > > > >
> > > > > > > >
> > > > > > > > On Tue, Apr 2, 2024 at 8:24 PM Zoltán Borók-Nagy <
> > > > > > boroknagyz@apache.org>
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Our last minor release, 4.3.0, was released ~6 months ago
> > (Oct
> > > > > 2023).
> > > > > > > > There
> > > > > > > > > have been many new changes since then covering
> > > > > > > > > - Iceberg support improvements
> > > > > > > > >     - UPDATE and DROP PARTITION statements
> > > > > > > > >     - OPTIMIZE statement for table maintenance
> > > > > > > > >    - read support for Iceberg tables with equality deletes
> > > > > > > > >    - read support for Iceberg metadata tables
> > > > > > > > > - Workload management functionalities
> > > > > > > > > - Event processor improvements
> > > > > > > > > - Improved support for JDK 17, aarch64, Python 3, and
> Unicode
> > > > names
> > > > > > > > > - A graphical timeline view of query execution
> > > > > > > > > - Support for querying external RDBMS via JDBC
> > > > > > > > > - High availability for Impala's Statestore
> > > > > > > > > - Implemented small string optimization for StringValue to
> > > speed
> > > > > > > > > serialization and lower memory usage
> > > > > > > > > - Improved memory tracking for codegen caching
> > > > > > > > > - High availability for Impala's Statestore
> > > > > > > > > - Improvements to JSON support
> > > > > > > > > - Various optimizations
> > > > > > > > > - Numerous bug fixes
> > > > > > > > >
> > > > > > > > > I propose that we release 4.4.0 soon. I'm willing to
> > volunteer
> > > as
> > > > > the
> > > > > > > > > release manager. I'm interested to hear what the community
> > > thinks
> > > > > > about
> > > > > > > > > doing a release. All feedback is welcome!
> > > > > > > > >
> > > > > > > > > Cheers,
> > > > > > > > > Zoltan
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: [DISCUSS] Impala 4.4.0 release

Posted by Wenzhe Zhou <wz...@cloudera.com>.

@Csaba Ringhofer <cs...@cloudera.com> mentioned he would publish
impala-shell 4.4.0.

Wenzhe Zhou
wzhou@cloudera.com
408-568-0101


On Fri, May 31, 2024 at 10:24 AM Michael Smith <mi...@cloudera.com>
wrote:

> Can someone handle the 4.4.0 release to
> https://pypi.org/project/impala-shell/?
>
> On Mon, May 13, 2024 at 5:32 AM Zoltán Borók-Nagy <bo...@apache.org>
> wrote:
>
> > Thanks for the feedback, I updated the branch:
> > https://github.com/apache/impala/commits/branch-4.4.0/
> > I also had to cherry-pick IMPALA-13045 to make IMPALA-13061 a clean pick.
> >
> > Still waiting for https://gerrit.cloudera.org/#/c/21367/ and maybe
> > https://gerrit.cloudera.org/#/c/21358/.
> >
> > Cheers,
> > Zoltan
> >
> > On Fri, May 10, 2024 at 11:38 AM Quanlong Huang <huangquanlong@gmail.com
> >
> > wrote:
> >
> > > IMPALA-11499 is just fixed. It'd be nice to include it as well.
> > >
> > > On Thu, May 9, 2024 at 1:15 AM Michael Smith <
> michael.smith@cloudera.com
> > >
> > > wrote:
> > >
> > > > If we're making another RC I'd nominate IMPALA-13054 and IMPALA-13061
> > as
> > > > well.
> > > >
> > > > On Tue, May 7, 2024 at 10:01 AM Wenzhe Zhou <wz...@cloudera.com>
> > wrote:
> > > >
> > > > > Please include IMPALA-12910 in the release.
> > > > >
> > > > > Wenzhe Zhou
> > > > > wzhou@cloudera.com
> > > > > 408-568-0101
> > > > >
> > > > >
> > > > > On Tue, May 7, 2024 at 6:15 AM Zoltán Borók-Nagy <
> > > boroknagyz@apache.org>
> > > > > wrote:
> > > > >
> > > > > > Thanks for the feedback.
> > > > > > Since the RC1 I added the following commits:
> > > > > > 74960cca6f IMPALA-12977: add search and pagination to
> /hadoop-varz
> > > > > > 5d32919f46 IMPALA-13009: Fix catalogd not sending deletion
> updates
> > > for
> > > > > some
> > > > > > dropped partitions
> > > > > > 73f13f0e9f IMPALA-13012: Lower default query_log_max_queued
> > > > > > 91a9dd81cc IMPALA-13005: Create Query Live table in HMS
> > > > > > 7ca9798949 IMPALA-13024: Ignore slots if using default pool and
> > empty
> > > > > group
> > > > > > 5045f19b53 IMPALA-13015: Dataload fails due to concurrency issue
> > with
> > > > > > test.jceks
> > > > > > https://github.com/apache/impala/commits/branch-4.4.0/
> > > > > >
> > > > > > I see that IMPALA-13020 is still on review, but hopefully it
> merges
> > > > soon:
> > > > > > https://gerrit.cloudera.org/#/c/21367/
> > > > > > https://gerrit.cloudera.org/#/c/21358/ is also on review, but
> > AFAICT
> > > > it
> > > > > > only affects the tests.
> > > > > >
> > > > > > Cheers,
> > > > > > Zoltan
> > > > > >
> > > > > >
> > > > > > On Tue, May 7, 2024 at 9:41 AM Saurabh Katiyal <
> > > > saurabhkatiyal@gmail.com
> > > > > >
> > > > > > wrote:
> > > > > >
> > > > > > > A small UI improvement for /hadoop-varz page which will make
> its
> > UI
> > > > > > > consistent with other pages in webUI
> > > > > > > https://issues.apache.org/jira/browse/IMPALA-12977
> > > > > > > [https://gerrit.cloudera.org/c/21329/]
> > > > > > >
> > > > > > > If possible, I'd like to include it in the 4.4.0 release
> > > > > > >
> > > > > > > Regards,
> > > > > > > Saurabh Katiyal
> > > > > > >
> > > > > > > On Tue, May 7, 2024 at 11:26 AM Quanlong Huang <
> > > > > huangquanlong@gmail.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Please also include some recent bug fixes like
> > > > > > > > https://issues.apache.org/jira/browse/IMPALA-13009
> > > > > > > >
> > > > > > > > On Tue, Apr 30, 2024 at 7:27 PM Kurt Deschler <
> > > > kdeschle@cloudera.com
> > > > > >
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Please include the new toolchain with IMPALA-13020.
> > > > > > > > >
> > > > > > > > > On Tue, Apr 30, 2024 at 4:46 AM Zoltán Borók-Nagy <
> > > > > > > boroknagyz@apache.org
> > > > > > > > >
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > Thanks Riza. This week I'm busy but next week I'll create
> > an
> > > > RC2.
> > > > > > > > > >
> > > > > > > > > > If anyone else wants me to add further patches to the
> > > release,
> > > > > > please
> > > > > > > > > reply
> > > > > > > > > > to this thread.
> > > > > > > > > >
> > > > > > > > > > Cheers,
> > > > > > > > > >     Zoltán
> > > > > > > > > >
> > > > > > > > > > Riza Suminto <ri...@cloudera.com> ezt írta
> > (időpont:
> > > > > 2024.
> > > > > > > ápr.
> > > > > > > > > > 26.,
> > > > > > > > > > P 16:41):
> > > > > > > > > >
> > > > > > > > > > > A small bug just found this week and I push a patch for
> > > > review
> > > > > > > > > > > https://gerrit.cloudera.org/c/21340/
> > > > > > > > > > > The patch is trivial, but will change behavior of
> > > > > > coordinator-only
> > > > > > > > > query
> > > > > > > > > > if
> > > > > > > > > > > Impala cluster does not have executor group set
> > > configuration
> > > > > > > > (default
> > > > > > > > > > pool
> > > > > > > > > > > only).
> > > > > > > > > > > I'd like to include it in the 4.4.0 release if
> possible.
> > > > > > > > > > >
> > > > > > > > > > > There are also few patches related with Workload
> > Management
> > > > and
> > > > > > > Query
> > > > > > > > > > Live
> > > > > > > > > > > Table that is nice to have:
> > > > > > > > > > > https://gerrit.cloudera.org/c/21302/
> > > > > > > > > > > https://gerrit.cloudera.org/c/21351/
> > > > > > > > > > > https://gerrit.cloudera.org/c/21358/
> > > > > > > > > > > I'll defer to Michael if these can land soon or not.
> > > > > > > > > > >
> > > > > > > > > > > Regards,
> > > > > > > > > > > Riza
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > On Tue, Apr 9, 2024 at 3:28 AM Zoltán Borók-Nagy <
> > > > > > > > > > boroknagyz@cloudera.com>
> > > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > > Thanks everyone for the feedback!
> > > > > > > > > > > >
> > > > > > > > > > > > If there's any work in progress that you want me to
> > > include
> > > > > in
> > > > > > > the
> > > > > > > > > 4.4
> > > > > > > > > > > > release, please let me know.
> > > > > > > > > > > >
> > > > > > > > > > > > Quanlong, OK, I'll take a look into how to build
> > RPM/DEB
> > > > > > > packages,
> > > > > > > > > and
> > > > > > > > > > > > share them on
> https://impala.apache.org/downloads.html
> > > if
> > > > I
> > > > > > > > succeed.
> > > > > > > > > > > > First 3 CRs are already merged, the last one is WIP:
> > > > > > > > > > > > https://gerrit.cloudera.org/c/20263. I can wait for
> it
> > > if
> > > > it
> > > > > > can
> > > > > > > > be
> > > > > > > > > > > merged
> > > > > > > > > > > > soon.
> > > > > > > > > > > >
> > > > > > > > > > > > Cheers,
> > > > > > > > > > > >     Zoltan
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > On Fri, Apr 5, 2024 at 7:21 AM Quanlong Huang <
> > > > > > > > > huangquanlong@gmail.com
> > > > > > > > > > >
> > > > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > > +1
> > > > > > > > > > > > >
> > > > > > > > > > > > > Thank Zoltan! I think it's also a good chance to
> > > release
> > > > > the
> > > > > > > > > binaries
> > > > > > > > > > > > since
> > > > > > > > > > > > > we already support building RPM/DEB packages. We
> can
> > > mark
> > > > > > them
> > > > > > > as
> > > > > > > > > > > > > experimental and hopefully get some feedback from
> the
> > > > > > > community.
> > > > > > > > > > > > >
> > > > > > > > > > > > > Xiang Yang contributed some patches to improve the
> > > > package
> > > > > > > > support.
> > > > > > > > > > > It'd
> > > > > > > > > > > > be
> > > > > > > > > > > > > nice to get them merged in this release as well:
> > > > > > > > > > > > > https://gerrit.cloudera.org/c/20921
> > > > > > > > > > > > > https://gerrit.cloudera.org/c/20928
> > > > > > > > > > > > > https://gerrit.cloudera.org/c/20929
> > > > > > > > > > > > > https://gerrit.cloudera.org/c/20263
> > > > > > > > > > > > >
> > > > > > > > > > > > > Quanlong
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Thu, Apr 4, 2024 at 6:10 AM Laszlo Gaal <
> > > > > > laszlog@apache.org
> > > > > > > >
> > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > > > +1
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > thank you very much for volunteering to be the
> > > release
> > > > > > > manager,
> > > > > > > > > > much
> > > > > > > > > > > > > > appreciated.
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >   - LaszloG
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > On Wed, Apr 3, 2024 at 8:42 PM Riza Suminto <
> > > > > > > > > > > riza.suminto@cloudera.com
> > > > > > > > > > > > >
> > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > > +1
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > On Wed, Apr 3, 2024 at 12:55 AM Gabor Kaszab <
> > > > > > > > > > > gaborkaszab@apache.org
> > > > > > > > > > > > >
> > > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > The last release has been a while.. Indeed
> this
> > > is
> > > > > > about
> > > > > > > > time
> > > > > > > > > > to
> > > > > > > > > > > > > have a
> > > > > > > > > > > > > > > new
> > > > > > > > > > > > > > > > one. Thanks for bringing this up, Zoltan!
> > > > > > > > > > > > > > > > +1
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Let's gather the unfinished items that should
> > > make
> > > > it
> > > > > > to
> > > > > > > > this
> > > > > > > > > > > > release
> > > > > > > > > > > > > > if
> > > > > > > > > > > > > > > > there are any!
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Gabor
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > On Tue, Apr 2, 2024 at 8:24 PM Zoltán
> > Borók-Nagy
> > > <
> > > > > > > > > > > > > > boroknagyz@apache.org>
> > > > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > Our last minor release, 4.3.0, was released
> > ~6
> > > > > months
> > > > > > > ago
> > > > > > > > > > (Oct
> > > > > > > > > > > > > 2023).
> > > > > > > > > > > > > > > > There
> > > > > > > > > > > > > > > > > have been many new changes since then
> > covering
> > > > > > > > > > > > > > > > > - Iceberg support improvements
> > > > > > > > > > > > > > > > >     - UPDATE and DROP PARTITION statements
> > > > > > > > > > > > > > > > >     - OPTIMIZE statement for table
> > maintenance
> > > > > > > > > > > > > > > > >    - read support for Iceberg tables with
> > > > equality
> > > > > > > > deletes
> > > > > > > > > > > > > > > > >    - read support for Iceberg metadata
> tables
> > > > > > > > > > > > > > > > > - Workload management functionalities
> > > > > > > > > > > > > > > > > - Event processor improvements
> > > > > > > > > > > > > > > > > - Improved support for JDK 17, aarch64,
> > Python
> > > 3,
> > > > > and
> > > > > > > > > Unicode
> > > > > > > > > > > > names
> > > > > > > > > > > > > > > > > - A graphical timeline view of query
> > execution
> > > > > > > > > > > > > > > > > - Support for querying external RDBMS via
> > JDBC
> > > > > > > > > > > > > > > > > - High availability for Impala's Statestore
> > > > > > > > > > > > > > > > > - Implemented small string optimization for
> > > > > > StringValue
> > > > > > > > to
> > > > > > > > > > > speed
> > > > > > > > > > > > > > > > > serialization and lower memory usage
> > > > > > > > > > > > > > > > > - Improved memory tracking for codegen
> > caching
> > > > > > > > > > > > > > > > > - High availability for Impala's Statestore
> > > > > > > > > > > > > > > > > - Improvements to JSON support
> > > > > > > > > > > > > > > > > - Various optimizations
> > > > > > > > > > > > > > > > > - Numerous bug fixes
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > I propose that we release 4.4.0 soon. I'm
> > > willing
> > > > > to
> > > > > > > > > > volunteer
> > > > > > > > > > > as
> > > > > > > > > > > > > the
> > > > > > > > > > > > > > > > > release manager. I'm interested to hear
> what
> > > the
> > > > > > > > community
> > > > > > > > > > > thinks
> > > > > > > > > > > > > > about
> > > > > > > > > > > > > > > > > doing a release. All feedback is welcome!
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > Cheers,
> > > > > > > > > > > > > > > > > Zoltan
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: [DISCUSS] Impala 4.4.0 release

Posted by Michael Smith <mi...@cloudera.com>.

Can someone handle the 4.4.0 release to
https://pypi.org/project/impala-shell/?

On Mon, May 13, 2024 at 5:32 AM Zoltán Borók-Nagy <bo...@apache.org>
wrote:

> Thanks for the feedback, I updated the branch:
> https://github.com/apache/impala/commits/branch-4.4.0/
> I also had to cherry-pick IMPALA-13045 to make IMPALA-13061 a clean pick.
>
> Still waiting for https://gerrit.cloudera.org/#/c/21367/ and maybe
> https://gerrit.cloudera.org/#/c/21358/.
>
> Cheers,
> Zoltan
>
> On Fri, May 10, 2024 at 11:38 AM Quanlong Huang <hu...@gmail.com>
> wrote:
>
> > IMPALA-11499 is just fixed. It'd be nice to include it as well.
> >
> > On Thu, May 9, 2024 at 1:15 AM Michael Smith <michael.smith@cloudera.com
> >
> > wrote:
> >
> > > If we're making another RC I'd nominate IMPALA-13054 and IMPALA-13061
> as
> > > well.
> > >
> > > On Tue, May 7, 2024 at 10:01 AM Wenzhe Zhou <wz...@cloudera.com>
> wrote:
> > >
> > > > Please include IMPALA-12910 in the release.
> > > >
> > > > Wenzhe Zhou
> > > > wzhou@cloudera.com
> > > > 408-568-0101
> > > >
> > > >
> > > > On Tue, May 7, 2024 at 6:15 AM Zoltán Borók-Nagy <
> > boroknagyz@apache.org>
> > > > wrote:
> > > >
> > > > > Thanks for the feedback.
> > > > > Since the RC1 I added the following commits:
> > > > > 74960cca6f IMPALA-12977: add search and pagination to /hadoop-varz
> > > > > 5d32919f46 IMPALA-13009: Fix catalogd not sending deletion updates
> > for
> > > > some
> > > > > dropped partitions
> > > > > 73f13f0e9f IMPALA-13012: Lower default query_log_max_queued
> > > > > 91a9dd81cc IMPALA-13005: Create Query Live table in HMS
> > > > > 7ca9798949 IMPALA-13024: Ignore slots if using default pool and
> empty
> > > > group
> > > > > 5045f19b53 IMPALA-13015: Dataload fails due to concurrency issue
> with
> > > > > test.jceks
> > > > > https://github.com/apache/impala/commits/branch-4.4.0/
> > > > >
> > > > > I see that IMPALA-13020 is still on review, but hopefully it merges
> > > soon:
> > > > > https://gerrit.cloudera.org/#/c/21367/
> > > > > https://gerrit.cloudera.org/#/c/21358/ is also on review, but
> AFAICT
> > > it
> > > > > only affects the tests.
> > > > >
> > > > > Cheers,
> > > > > Zoltan
> > > > >
> > > > >
> > > > > On Tue, May 7, 2024 at 9:41 AM Saurabh Katiyal <
> > > saurabhkatiyal@gmail.com
> > > > >
> > > > > wrote:
> > > > >
> > > > > > A small UI improvement for /hadoop-varz page which will make its
> UI
> > > > > > consistent with other pages in webUI
> > > > > > https://issues.apache.org/jira/browse/IMPALA-12977
> > > > > > [https://gerrit.cloudera.org/c/21329/]
> > > > > >
> > > > > > If possible, I'd like to include it in the 4.4.0 release
> > > > > >
> > > > > > Regards,
> > > > > > Saurabh Katiyal
> > > > > >
> > > > > > On Tue, May 7, 2024 at 11:26 AM Quanlong Huang <
> > > > huangquanlong@gmail.com>
> > > > > > wrote:
> > > > > >
> > > > > > > Please also include some recent bug fixes like
> > > > > > > https://issues.apache.org/jira/browse/IMPALA-13009
> > > > > > >
> > > > > > > On Tue, Apr 30, 2024 at 7:27 PM Kurt Deschler <
> > > kdeschle@cloudera.com
> > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Please include the new toolchain with IMPALA-13020.
> > > > > > > >
> > > > > > > > On Tue, Apr 30, 2024 at 4:46 AM Zoltán Borók-Nagy <
> > > > > > boroknagyz@apache.org
> > > > > > > >
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Thanks Riza. This week I'm busy but next week I'll create
> an
> > > RC2.
> > > > > > > > >
> > > > > > > > > If anyone else wants me to add further patches to the
> > release,
> > > > > please
> > > > > > > > reply
> > > > > > > > > to this thread.
> > > > > > > > >
> > > > > > > > > Cheers,
> > > > > > > > >     Zoltán
> > > > > > > > >
> > > > > > > > > Riza Suminto <ri...@cloudera.com> ezt írta
> (időpont:
> > > > 2024.
> > > > > > ápr.
> > > > > > > > > 26.,
> > > > > > > > > P 16:41):
> > > > > > > > >
> > > > > > > > > > A small bug just found this week and I push a patch for
> > > review
> > > > > > > > > > https://gerrit.cloudera.org/c/21340/
> > > > > > > > > > The patch is trivial, but will change behavior of
> > > > > coordinator-only
> > > > > > > > query
> > > > > > > > > if
> > > > > > > > > > Impala cluster does not have executor group set
> > configuration
> > > > > > > (default
> > > > > > > > > pool
> > > > > > > > > > only).
> > > > > > > > > > I'd like to include it in the 4.4.0 release if possible.
> > > > > > > > > >
> > > > > > > > > > There are also few patches related with Workload
> Management
> > > and
> > > > > > Query
> > > > > > > > > Live
> > > > > > > > > > Table that is nice to have:
> > > > > > > > > > https://gerrit.cloudera.org/c/21302/
> > > > > > > > > > https://gerrit.cloudera.org/c/21351/
> > > > > > > > > > https://gerrit.cloudera.org/c/21358/
> > > > > > > > > > I'll defer to Michael if these can land soon or not.
> > > > > > > > > >
> > > > > > > > > > Regards,
> > > > > > > > > > Riza
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Tue, Apr 9, 2024 at 3:28 AM Zoltán Borók-Nagy <
> > > > > > > > > boroknagyz@cloudera.com>
> > > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > Thanks everyone for the feedback!
> > > > > > > > > > >
> > > > > > > > > > > If there's any work in progress that you want me to
> > include
> > > > in
> > > > > > the
> > > > > > > > 4.4
> > > > > > > > > > > release, please let me know.
> > > > > > > > > > >
> > > > > > > > > > > Quanlong, OK, I'll take a look into how to build
> RPM/DEB
> > > > > > packages,
> > > > > > > > and
> > > > > > > > > > > share them on https://impala.apache.org/downloads.html
> > if
> > > I
> > > > > > > succeed.
> > > > > > > > > > > First 3 CRs are already merged, the last one is WIP:
> > > > > > > > > > > https://gerrit.cloudera.org/c/20263. I can wait for it
> > if
> > > it
> > > > > can
> > > > > > > be
> > > > > > > > > > merged
> > > > > > > > > > > soon.
> > > > > > > > > > >
> > > > > > > > > > > Cheers,
> > > > > > > > > > >     Zoltan
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > On Fri, Apr 5, 2024 at 7:21 AM Quanlong Huang <
> > > > > > > > huangquanlong@gmail.com
> > > > > > > > > >
> > > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > > +1
> > > > > > > > > > > >
> > > > > > > > > > > > Thank Zoltan! I think it's also a good chance to
> > release
> > > > the
> > > > > > > > binaries
> > > > > > > > > > > since
> > > > > > > > > > > > we already support building RPM/DEB packages. We can
> > mark
> > > > > them
> > > > > > as
> > > > > > > > > > > > experimental and hopefully get some feedback from the
> > > > > > community.
> > > > > > > > > > > >
> > > > > > > > > > > > Xiang Yang contributed some patches to improve the
> > > package
> > > > > > > support.
> > > > > > > > > > It'd
> > > > > > > > > > > be
> > > > > > > > > > > > nice to get them merged in this release as well:
> > > > > > > > > > > > https://gerrit.cloudera.org/c/20921
> > > > > > > > > > > > https://gerrit.cloudera.org/c/20928
> > > > > > > > > > > > https://gerrit.cloudera.org/c/20929
> > > > > > > > > > > > https://gerrit.cloudera.org/c/20263
> > > > > > > > > > > >
> > > > > > > > > > > > Quanlong
> > > > > > > > > > > >
> > > > > > > > > > > > On Thu, Apr 4, 2024 at 6:10 AM Laszlo Gaal <
> > > > > laszlog@apache.org
> > > > > > >
> > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > > +1
> > > > > > > > > > > > >
> > > > > > > > > > > > > thank you very much for volunteering to be the
> > release
> > > > > > manager,
> > > > > > > > > much
> > > > > > > > > > > > > appreciated.
> > > > > > > > > > > > >
> > > > > > > > > > > > >   - LaszloG
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Wed, Apr 3, 2024 at 8:42 PM Riza Suminto <
> > > > > > > > > > riza.suminto@cloudera.com
> > > > > > > > > > > >
> > > > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > > > +1
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > On Wed, Apr 3, 2024 at 12:55 AM Gabor Kaszab <
> > > > > > > > > > gaborkaszab@apache.org
> > > > > > > > > > > >
> > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > > The last release has been a while.. Indeed this
> > is
> > > > > about
> > > > > > > time
> > > > > > > > > to
> > > > > > > > > > > > have a
> > > > > > > > > > > > > > new
> > > > > > > > > > > > > > > one. Thanks for bringing this up, Zoltan!
> > > > > > > > > > > > > > > +1
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Let's gather the unfinished items that should
> > make
> > > it
> > > > > to
> > > > > > > this
> > > > > > > > > > > release
> > > > > > > > > > > > > if
> > > > > > > > > > > > > > > there are any!
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Gabor
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > On Tue, Apr 2, 2024 at 8:24 PM Zoltán
> Borók-Nagy
> > <
> > > > > > > > > > > > > boroknagyz@apache.org>
> > > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Our last minor release, 4.3.0, was released
> ~6
> > > > months
> > > > > > ago
> > > > > > > > > (Oct
> > > > > > > > > > > > 2023).
> > > > > > > > > > > > > > > There
> > > > > > > > > > > > > > > > have been many new changes since then
> covering
> > > > > > > > > > > > > > > > - Iceberg support improvements
> > > > > > > > > > > > > > > >     - UPDATE and DROP PARTITION statements
> > > > > > > > > > > > > > > >     - OPTIMIZE statement for table
> maintenance
> > > > > > > > > > > > > > > >    - read support for Iceberg tables with
> > > equality
> > > > > > > deletes
> > > > > > > > > > > > > > > >    - read support for Iceberg metadata tables
> > > > > > > > > > > > > > > > - Workload management functionalities
> > > > > > > > > > > > > > > > - Event processor improvements
> > > > > > > > > > > > > > > > - Improved support for JDK 17, aarch64,
> Python
> > 3,
> > > > and
> > > > > > > > Unicode
> > > > > > > > > > > names
> > > > > > > > > > > > > > > > - A graphical timeline view of query
> execution
> > > > > > > > > > > > > > > > - Support for querying external RDBMS via
> JDBC
> > > > > > > > > > > > > > > > - High availability for Impala's Statestore
> > > > > > > > > > > > > > > > - Implemented small string optimization for
> > > > > StringValue
> > > > > > > to
> > > > > > > > > > speed
> > > > > > > > > > > > > > > > serialization and lower memory usage
> > > > > > > > > > > > > > > > - Improved memory tracking for codegen
> caching
> > > > > > > > > > > > > > > > - High availability for Impala's Statestore
> > > > > > > > > > > > > > > > - Improvements to JSON support
> > > > > > > > > > > > > > > > - Various optimizations
> > > > > > > > > > > > > > > > - Numerous bug fixes
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > I propose that we release 4.4.0 soon. I'm
> > willing
> > > > to
> > > > > > > > > volunteer
> > > > > > > > > > as
> > > > > > > > > > > > the
> > > > > > > > > > > > > > > > release manager. I'm interested to hear what
> > the
> > > > > > > community
> > > > > > > > > > thinks
> > > > > > > > > > > > > about
> > > > > > > > > > > > > > > > doing a release. All feedback is welcome!
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Cheers,
> > > > > > > > > > > > > > > > Zoltan
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: [DISCUSS] Impala 4.4.0 release

Posted by Zoltán Borók-Nagy <bo...@apache.org>.

Thanks for the feedback, I updated the branch:
https://github.com/apache/impala/commits/branch-4.4.0/
I also had to cherry-pick IMPALA-13045 to make IMPALA-13061 a clean pick.

Still waiting for https://gerrit.cloudera.org/#/c/21367/ and maybe
https://gerrit.cloudera.org/#/c/21358/.

Cheers,
Zoltan

On Fri, May 10, 2024 at 11:38 AM Quanlong Huang <hu...@gmail.com>
wrote:

> IMPALA-11499 is just fixed. It'd be nice to include it as well.
>
> On Thu, May 9, 2024 at 1:15 AM Michael Smith <mi...@cloudera.com>
> wrote:
>
> > If we're making another RC I'd nominate IMPALA-13054 and IMPALA-13061 as
> > well.
> >
> > On Tue, May 7, 2024 at 10:01 AM Wenzhe Zhou <wz...@cloudera.com> wrote:
> >
> > > Please include IMPALA-12910 in the release.
> > >
> > > Wenzhe Zhou
> > > wzhou@cloudera.com
> > > 408-568-0101
> > >
> > >
> > > On Tue, May 7, 2024 at 6:15 AM Zoltán Borók-Nagy <
> boroknagyz@apache.org>
> > > wrote:
> > >
> > > > Thanks for the feedback.
> > > > Since the RC1 I added the following commits:
> > > > 74960cca6f IMPALA-12977: add search and pagination to /hadoop-varz
> > > > 5d32919f46 IMPALA-13009: Fix catalogd not sending deletion updates
> for
> > > some
> > > > dropped partitions
> > > > 73f13f0e9f IMPALA-13012: Lower default query_log_max_queued
> > > > 91a9dd81cc IMPALA-13005: Create Query Live table in HMS
> > > > 7ca9798949 IMPALA-13024: Ignore slots if using default pool and empty
> > > group
> > > > 5045f19b53 IMPALA-13015: Dataload fails due to concurrency issue with
> > > > test.jceks
> > > > https://github.com/apache/impala/commits/branch-4.4.0/
> > > >
> > > > I see that IMPALA-13020 is still on review, but hopefully it merges
> > soon:
> > > > https://gerrit.cloudera.org/#/c/21367/
> > > > https://gerrit.cloudera.org/#/c/21358/ is also on review, but AFAICT
> > it
> > > > only affects the tests.
> > > >
> > > > Cheers,
> > > > Zoltan
> > > >
> > > >
> > > > On Tue, May 7, 2024 at 9:41 AM Saurabh Katiyal <
> > saurabhkatiyal@gmail.com
> > > >
> > > > wrote:
> > > >
> > > > > A small UI improvement for /hadoop-varz page which will make its UI
> > > > > consistent with other pages in webUI
> > > > > https://issues.apache.org/jira/browse/IMPALA-12977
> > > > > [https://gerrit.cloudera.org/c/21329/]
> > > > >
> > > > > If possible, I'd like to include it in the 4.4.0 release
> > > > >
> > > > > Regards,
> > > > > Saurabh Katiyal
> > > > >
> > > > > On Tue, May 7, 2024 at 11:26 AM Quanlong Huang <
> > > huangquanlong@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Please also include some recent bug fixes like
> > > > > > https://issues.apache.org/jira/browse/IMPALA-13009
> > > > > >
> > > > > > On Tue, Apr 30, 2024 at 7:27 PM Kurt Deschler <
> > kdeschle@cloudera.com
> > > >
> > > > > > wrote:
> > > > > >
> > > > > > > Please include the new toolchain with IMPALA-13020.
> > > > > > >
> > > > > > > On Tue, Apr 30, 2024 at 4:46 AM Zoltán Borók-Nagy <
> > > > > boroknagyz@apache.org
> > > > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Thanks Riza. This week I'm busy but next week I'll create an
> > RC2.
> > > > > > > >
> > > > > > > > If anyone else wants me to add further patches to the
> release,
> > > > please
> > > > > > > reply
> > > > > > > > to this thread.
> > > > > > > >
> > > > > > > > Cheers,
> > > > > > > >     Zoltán
> > > > > > > >
> > > > > > > > Riza Suminto <ri...@cloudera.com> ezt írta (időpont:
> > > 2024.
> > > > > ápr.
> > > > > > > > 26.,
> > > > > > > > P 16:41):
> > > > > > > >
> > > > > > > > > A small bug just found this week and I push a patch for
> > review
> > > > > > > > > https://gerrit.cloudera.org/c/21340/
> > > > > > > > > The patch is trivial, but will change behavior of
> > > > coordinator-only
> > > > > > > query
> > > > > > > > if
> > > > > > > > > Impala cluster does not have executor group set
> configuration
> > > > > > (default
> > > > > > > > pool
> > > > > > > > > only).
> > > > > > > > > I'd like to include it in the 4.4.0 release if possible.
> > > > > > > > >
> > > > > > > > > There are also few patches related with Workload Management
> > and
> > > > > Query
> > > > > > > > Live
> > > > > > > > > Table that is nice to have:
> > > > > > > > > https://gerrit.cloudera.org/c/21302/
> > > > > > > > > https://gerrit.cloudera.org/c/21351/
> > > > > > > > > https://gerrit.cloudera.org/c/21358/
> > > > > > > > > I'll defer to Michael if these can land soon or not.
> > > > > > > > >
> > > > > > > > > Regards,
> > > > > > > > > Riza
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Tue, Apr 9, 2024 at 3:28 AM Zoltán Borók-Nagy <
> > > > > > > > boroknagyz@cloudera.com>
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > Thanks everyone for the feedback!
> > > > > > > > > >
> > > > > > > > > > If there's any work in progress that you want me to
> include
> > > in
> > > > > the
> > > > > > > 4.4
> > > > > > > > > > release, please let me know.
> > > > > > > > > >
> > > > > > > > > > Quanlong, OK, I'll take a look into how to build RPM/DEB
> > > > > packages,
> > > > > > > and
> > > > > > > > > > share them on https://impala.apache.org/downloads.html
> if
> > I
> > > > > > succeed.
> > > > > > > > > > First 3 CRs are already merged, the last one is WIP:
> > > > > > > > > > https://gerrit.cloudera.org/c/20263. I can wait for it
> if
> > it
> > > > can
> > > > > > be
> > > > > > > > > merged
> > > > > > > > > > soon.
> > > > > > > > > >
> > > > > > > > > > Cheers,
> > > > > > > > > >     Zoltan
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Fri, Apr 5, 2024 at 7:21 AM Quanlong Huang <
> > > > > > > huangquanlong@gmail.com
> > > > > > > > >
> > > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > +1
> > > > > > > > > > >
> > > > > > > > > > > Thank Zoltan! I think it's also a good chance to
> release
> > > the
> > > > > > > binaries
> > > > > > > > > > since
> > > > > > > > > > > we already support building RPM/DEB packages. We can
> mark
> > > > them
> > > > > as
> > > > > > > > > > > experimental and hopefully get some feedback from the
> > > > > community.
> > > > > > > > > > >
> > > > > > > > > > > Xiang Yang contributed some patches to improve the
> > package
> > > > > > support.
> > > > > > > > > It'd
> > > > > > > > > > be
> > > > > > > > > > > nice to get them merged in this release as well:
> > > > > > > > > > > https://gerrit.cloudera.org/c/20921
> > > > > > > > > > > https://gerrit.cloudera.org/c/20928
> > > > > > > > > > > https://gerrit.cloudera.org/c/20929
> > > > > > > > > > > https://gerrit.cloudera.org/c/20263
> > > > > > > > > > >
> > > > > > > > > > > Quanlong
> > > > > > > > > > >
> > > > > > > > > > > On Thu, Apr 4, 2024 at 6:10 AM Laszlo Gaal <
> > > > laszlog@apache.org
> > > > > >
> > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > > +1
> > > > > > > > > > > >
> > > > > > > > > > > > thank you very much for volunteering to be the
> release
> > > > > manager,
> > > > > > > > much
> > > > > > > > > > > > appreciated.
> > > > > > > > > > > >
> > > > > > > > > > > >   - LaszloG
> > > > > > > > > > > >
> > > > > > > > > > > > On Wed, Apr 3, 2024 at 8:42 PM Riza Suminto <
> > > > > > > > > riza.suminto@cloudera.com
> > > > > > > > > > >
> > > > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > > +1
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Wed, Apr 3, 2024 at 12:55 AM Gabor Kaszab <
> > > > > > > > > gaborkaszab@apache.org
> > > > > > > > > > >
> > > > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > > > The last release has been a while.. Indeed this
> is
> > > > about
> > > > > > time
> > > > > > > > to
> > > > > > > > > > > have a
> > > > > > > > > > > > > new
> > > > > > > > > > > > > > one. Thanks for bringing this up, Zoltan!
> > > > > > > > > > > > > > +1
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Let's gather the unfinished items that should
> make
> > it
> > > > to
> > > > > > this
> > > > > > > > > > release
> > > > > > > > > > > > if
> > > > > > > > > > > > > > there are any!
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Gabor
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > On Tue, Apr 2, 2024 at 8:24 PM Zoltán Borók-Nagy
> <
> > > > > > > > > > > > boroknagyz@apache.org>
> > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Our last minor release, 4.3.0, was released ~6
> > > months
> > > > > ago
> > > > > > > > (Oct
> > > > > > > > > > > 2023).
> > > > > > > > > > > > > > There
> > > > > > > > > > > > > > > have been many new changes since then covering
> > > > > > > > > > > > > > > - Iceberg support improvements
> > > > > > > > > > > > > > >     - UPDATE and DROP PARTITION statements
> > > > > > > > > > > > > > >     - OPTIMIZE statement for table maintenance
> > > > > > > > > > > > > > >    - read support for Iceberg tables with
> > equality
> > > > > > deletes
> > > > > > > > > > > > > > >    - read support for Iceberg metadata tables
> > > > > > > > > > > > > > > - Workload management functionalities
> > > > > > > > > > > > > > > - Event processor improvements
> > > > > > > > > > > > > > > - Improved support for JDK 17, aarch64, Python
> 3,
> > > and
> > > > > > > Unicode
> > > > > > > > > > names
> > > > > > > > > > > > > > > - A graphical timeline view of query execution
> > > > > > > > > > > > > > > - Support for querying external RDBMS via JDBC
> > > > > > > > > > > > > > > - High availability for Impala's Statestore
> > > > > > > > > > > > > > > - Implemented small string optimization for
> > > > StringValue
> > > > > > to
> > > > > > > > > speed
> > > > > > > > > > > > > > > serialization and lower memory usage
> > > > > > > > > > > > > > > - Improved memory tracking for codegen caching
> > > > > > > > > > > > > > > - High availability for Impala's Statestore
> > > > > > > > > > > > > > > - Improvements to JSON support
> > > > > > > > > > > > > > > - Various optimizations
> > > > > > > > > > > > > > > - Numerous bug fixes
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > I propose that we release 4.4.0 soon. I'm
> willing
> > > to
> > > > > > > > volunteer
> > > > > > > > > as
> > > > > > > > > > > the
> > > > > > > > > > > > > > > release manager. I'm interested to hear what
> the
> > > > > > community
> > > > > > > > > thinks
> > > > > > > > > > > > about
> > > > > > > > > > > > > > > doing a release. All feedback is welcome!
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Cheers,
> > > > > > > > > > > > > > > Zoltan
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: [DISCUSS] Impala 4.4.0 release

Posted by Quanlong Huang <hu...@gmail.com>.

IMPALA-11499 is just fixed. It'd be nice to include it as well.

On Thu, May 9, 2024 at 1:15 AM Michael Smith <mi...@cloudera.com>
wrote:

> If we're making another RC I'd nominate IMPALA-13054 and IMPALA-13061 as
> well.
>
> On Tue, May 7, 2024 at 10:01 AM Wenzhe Zhou <wz...@cloudera.com> wrote:
>
> > Please include IMPALA-12910 in the release.
> >
> > Wenzhe Zhou
> > wzhou@cloudera.com
> > 408-568-0101
> >
> >
> > On Tue, May 7, 2024 at 6:15 AM Zoltán Borók-Nagy <bo...@apache.org>
> > wrote:
> >
> > > Thanks for the feedback.
> > > Since the RC1 I added the following commits:
> > > 74960cca6f IMPALA-12977: add search and pagination to /hadoop-varz
> > > 5d32919f46 IMPALA-13009: Fix catalogd not sending deletion updates for
> > some
> > > dropped partitions
> > > 73f13f0e9f IMPALA-13012: Lower default query_log_max_queued
> > > 91a9dd81cc IMPALA-13005: Create Query Live table in HMS
> > > 7ca9798949 IMPALA-13024: Ignore slots if using default pool and empty
> > group
> > > 5045f19b53 IMPALA-13015: Dataload fails due to concurrency issue with
> > > test.jceks
> > > https://github.com/apache/impala/commits/branch-4.4.0/
> > >
> > > I see that IMPALA-13020 is still on review, but hopefully it merges
> soon:
> > > https://gerrit.cloudera.org/#/c/21367/
> > > https://gerrit.cloudera.org/#/c/21358/ is also on review, but AFAICT
> it
> > > only affects the tests.
> > >
> > > Cheers,
> > > Zoltan
> > >
> > >
> > > On Tue, May 7, 2024 at 9:41 AM Saurabh Katiyal <
> saurabhkatiyal@gmail.com
> > >
> > > wrote:
> > >
> > > > A small UI improvement for /hadoop-varz page which will make its UI
> > > > consistent with other pages in webUI
> > > > https://issues.apache.org/jira/browse/IMPALA-12977
> > > > [https://gerrit.cloudera.org/c/21329/]
> > > >
> > > > If possible, I'd like to include it in the 4.4.0 release
> > > >
> > > > Regards,
> > > > Saurabh Katiyal
> > > >
> > > > On Tue, May 7, 2024 at 11:26 AM Quanlong Huang <
> > huangquanlong@gmail.com>
> > > > wrote:
> > > >
> > > > > Please also include some recent bug fixes like
> > > > > https://issues.apache.org/jira/browse/IMPALA-13009
> > > > >
> > > > > On Tue, Apr 30, 2024 at 7:27 PM Kurt Deschler <
> kdeschle@cloudera.com
> > >
> > > > > wrote:
> > > > >
> > > > > > Please include the new toolchain with IMPALA-13020.
> > > > > >
> > > > > > On Tue, Apr 30, 2024 at 4:46 AM Zoltán Borók-Nagy <
> > > > boroknagyz@apache.org
> > > > > >
> > > > > > wrote:
> > > > > >
> > > > > > > Thanks Riza. This week I'm busy but next week I'll create an
> RC2.
> > > > > > >
> > > > > > > If anyone else wants me to add further patches to the release,
> > > please
> > > > > > reply
> > > > > > > to this thread.
> > > > > > >
> > > > > > > Cheers,
> > > > > > >     Zoltán
> > > > > > >
> > > > > > > Riza Suminto <ri...@cloudera.com> ezt írta (időpont:
> > 2024.
> > > > ápr.
> > > > > > > 26.,
> > > > > > > P 16:41):
> > > > > > >
> > > > > > > > A small bug just found this week and I push a patch for
> review
> > > > > > > > https://gerrit.cloudera.org/c/21340/
> > > > > > > > The patch is trivial, but will change behavior of
> > > coordinator-only
> > > > > > query
> > > > > > > if
> > > > > > > > Impala cluster does not have executor group set configuration
> > > > > (default
> > > > > > > pool
> > > > > > > > only).
> > > > > > > > I'd like to include it in the 4.4.0 release if possible.
> > > > > > > >
> > > > > > > > There are also few patches related with Workload Management
> and
> > > > Query
> > > > > > > Live
> > > > > > > > Table that is nice to have:
> > > > > > > > https://gerrit.cloudera.org/c/21302/
> > > > > > > > https://gerrit.cloudera.org/c/21351/
> > > > > > > > https://gerrit.cloudera.org/c/21358/
> > > > > > > > I'll defer to Michael if these can land soon or not.
> > > > > > > >
> > > > > > > > Regards,
> > > > > > > > Riza
> > > > > > > >
> > > > > > > >
> > > > > > > > On Tue, Apr 9, 2024 at 3:28 AM Zoltán Borók-Nagy <
> > > > > > > boroknagyz@cloudera.com>
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Thanks everyone for the feedback!
> > > > > > > > >
> > > > > > > > > If there's any work in progress that you want me to include
> > in
> > > > the
> > > > > > 4.4
> > > > > > > > > release, please let me know.
> > > > > > > > >
> > > > > > > > > Quanlong, OK, I'll take a look into how to build RPM/DEB
> > > > packages,
> > > > > > and
> > > > > > > > > share them on https://impala.apache.org/downloads.html if
> I
> > > > > succeed.
> > > > > > > > > First 3 CRs are already merged, the last one is WIP:
> > > > > > > > > https://gerrit.cloudera.org/c/20263. I can wait for it if
> it
> > > can
> > > > > be
> > > > > > > > merged
> > > > > > > > > soon.
> > > > > > > > >
> > > > > > > > > Cheers,
> > > > > > > > >     Zoltan
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Fri, Apr 5, 2024 at 7:21 AM Quanlong Huang <
> > > > > > huangquanlong@gmail.com
> > > > > > > >
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > +1
> > > > > > > > > >
> > > > > > > > > > Thank Zoltan! I think it's also a good chance to release
> > the
> > > > > > binaries
> > > > > > > > > since
> > > > > > > > > > we already support building RPM/DEB packages. We can mark
> > > them
> > > > as
> > > > > > > > > > experimental and hopefully get some feedback from the
> > > > community.
> > > > > > > > > >
> > > > > > > > > > Xiang Yang contributed some patches to improve the
> package
> > > > > support.
> > > > > > > > It'd
> > > > > > > > > be
> > > > > > > > > > nice to get them merged in this release as well:
> > > > > > > > > > https://gerrit.cloudera.org/c/20921
> > > > > > > > > > https://gerrit.cloudera.org/c/20928
> > > > > > > > > > https://gerrit.cloudera.org/c/20929
> > > > > > > > > > https://gerrit.cloudera.org/c/20263
> > > > > > > > > >
> > > > > > > > > > Quanlong
> > > > > > > > > >
> > > > > > > > > > On Thu, Apr 4, 2024 at 6:10 AM Laszlo Gaal <
> > > laszlog@apache.org
> > > > >
> > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > +1
> > > > > > > > > > >
> > > > > > > > > > > thank you very much for volunteering to be the release
> > > > manager,
> > > > > > > much
> > > > > > > > > > > appreciated.
> > > > > > > > > > >
> > > > > > > > > > >   - LaszloG
> > > > > > > > > > >
> > > > > > > > > > > On Wed, Apr 3, 2024 at 8:42 PM Riza Suminto <
> > > > > > > > riza.suminto@cloudera.com
> > > > > > > > > >
> > > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > > +1
> > > > > > > > > > > >
> > > > > > > > > > > > On Wed, Apr 3, 2024 at 12:55 AM Gabor Kaszab <
> > > > > > > > gaborkaszab@apache.org
> > > > > > > > > >
> > > > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > > The last release has been a while.. Indeed this is
> > > about
> > > > > time
> > > > > > > to
> > > > > > > > > > have a
> > > > > > > > > > > > new
> > > > > > > > > > > > > one. Thanks for bringing this up, Zoltan!
> > > > > > > > > > > > > +1
> > > > > > > > > > > > >
> > > > > > > > > > > > > Let's gather the unfinished items that should make
> it
> > > to
> > > > > this
> > > > > > > > > release
> > > > > > > > > > > if
> > > > > > > > > > > > > there are any!
> > > > > > > > > > > > >
> > > > > > > > > > > > > Gabor
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Tue, Apr 2, 2024 at 8:24 PM Zoltán Borók-Nagy <
> > > > > > > > > > > boroknagyz@apache.org>
> > > > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > > > Our last minor release, 4.3.0, was released ~6
> > months
> > > > ago
> > > > > > > (Oct
> > > > > > > > > > 2023).
> > > > > > > > > > > > > There
> > > > > > > > > > > > > > have been many new changes since then covering
> > > > > > > > > > > > > > - Iceberg support improvements
> > > > > > > > > > > > > >     - UPDATE and DROP PARTITION statements
> > > > > > > > > > > > > >     - OPTIMIZE statement for table maintenance
> > > > > > > > > > > > > >    - read support for Iceberg tables with
> equality
> > > > > deletes
> > > > > > > > > > > > > >    - read support for Iceberg metadata tables
> > > > > > > > > > > > > > - Workload management functionalities
> > > > > > > > > > > > > > - Event processor improvements
> > > > > > > > > > > > > > - Improved support for JDK 17, aarch64, Python 3,
> > and
> > > > > > Unicode
> > > > > > > > > names
> > > > > > > > > > > > > > - A graphical timeline view of query execution
> > > > > > > > > > > > > > - Support for querying external RDBMS via JDBC
> > > > > > > > > > > > > > - High availability for Impala's Statestore
> > > > > > > > > > > > > > - Implemented small string optimization for
> > > StringValue
> > > > > to
> > > > > > > > speed
> > > > > > > > > > > > > > serialization and lower memory usage
> > > > > > > > > > > > > > - Improved memory tracking for codegen caching
> > > > > > > > > > > > > > - High availability for Impala's Statestore
> > > > > > > > > > > > > > - Improvements to JSON support
> > > > > > > > > > > > > > - Various optimizations
> > > > > > > > > > > > > > - Numerous bug fixes
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > I propose that we release 4.4.0 soon. I'm willing
> > to
> > > > > > > volunteer
> > > > > > > > as
> > > > > > > > > > the
> > > > > > > > > > > > > > release manager. I'm interested to hear what the
> > > > > community
> > > > > > > > thinks
> > > > > > > > > > > about
> > > > > > > > > > > > > > doing a release. All feedback is welcome!
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Cheers,
> > > > > > > > > > > > > > Zoltan
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: [DISCUSS] Impala 4.4.0 release

Posted by Michael Smith <mi...@cloudera.com>.

If we're making another RC I'd nominate IMPALA-13054 and IMPALA-13061 as
well.

On Tue, May 7, 2024 at 10:01 AM Wenzhe Zhou <wz...@cloudera.com> wrote:

> Please include IMPALA-12910 in the release.
>
> Wenzhe Zhou
> wzhou@cloudera.com
> 408-568-0101
>
>
> On Tue, May 7, 2024 at 6:15 AM Zoltán Borók-Nagy <bo...@apache.org>
> wrote:
>
> > Thanks for the feedback.
> > Since the RC1 I added the following commits:
> > 74960cca6f IMPALA-12977: add search and pagination to /hadoop-varz
> > 5d32919f46 IMPALA-13009: Fix catalogd not sending deletion updates for
> some
> > dropped partitions
> > 73f13f0e9f IMPALA-13012: Lower default query_log_max_queued
> > 91a9dd81cc IMPALA-13005: Create Query Live table in HMS
> > 7ca9798949 IMPALA-13024: Ignore slots if using default pool and empty
> group
> > 5045f19b53 IMPALA-13015: Dataload fails due to concurrency issue with
> > test.jceks
> > https://github.com/apache/impala/commits/branch-4.4.0/
> >
> > I see that IMPALA-13020 is still on review, but hopefully it merges soon:
> > https://gerrit.cloudera.org/#/c/21367/
> > https://gerrit.cloudera.org/#/c/21358/ is also on review, but AFAICT it
> > only affects the tests.
> >
> > Cheers,
> > Zoltan
> >
> >
> > On Tue, May 7, 2024 at 9:41 AM Saurabh Katiyal <saurabhkatiyal@gmail.com
> >
> > wrote:
> >
> > > A small UI improvement for /hadoop-varz page which will make its UI
> > > consistent with other pages in webUI
> > > https://issues.apache.org/jira/browse/IMPALA-12977
> > > [https://gerrit.cloudera.org/c/21329/]
> > >
> > > If possible, I'd like to include it in the 4.4.0 release
> > >
> > > Regards,
> > > Saurabh Katiyal
> > >
> > > On Tue, May 7, 2024 at 11:26 AM Quanlong Huang <
> huangquanlong@gmail.com>
> > > wrote:
> > >
> > > > Please also include some recent bug fixes like
> > > > https://issues.apache.org/jira/browse/IMPALA-13009
> > > >
> > > > On Tue, Apr 30, 2024 at 7:27 PM Kurt Deschler <kdeschle@cloudera.com
> >
> > > > wrote:
> > > >
> > > > > Please include the new toolchain with IMPALA-13020.
> > > > >
> > > > > On Tue, Apr 30, 2024 at 4:46 AM Zoltán Borók-Nagy <
> > > boroknagyz@apache.org
> > > > >
> > > > > wrote:
> > > > >
> > > > > > Thanks Riza. This week I'm busy but next week I'll create an RC2.
> > > > > >
> > > > > > If anyone else wants me to add further patches to the release,
> > please
> > > > > reply
> > > > > > to this thread.
> > > > > >
> > > > > > Cheers,
> > > > > >     Zoltán
> > > > > >
> > > > > > Riza Suminto <ri...@cloudera.com> ezt írta (időpont:
> 2024.
> > > ápr.
> > > > > > 26.,
> > > > > > P 16:41):
> > > > > >
> > > > > > > A small bug just found this week and I push a patch for review
> > > > > > > https://gerrit.cloudera.org/c/21340/
> > > > > > > The patch is trivial, but will change behavior of
> > coordinator-only
> > > > > query
> > > > > > if
> > > > > > > Impala cluster does not have executor group set configuration
> > > > (default
> > > > > > pool
> > > > > > > only).
> > > > > > > I'd like to include it in the 4.4.0 release if possible.
> > > > > > >
> > > > > > > There are also few patches related with Workload Management and
> > > Query
> > > > > > Live
> > > > > > > Table that is nice to have:
> > > > > > > https://gerrit.cloudera.org/c/21302/
> > > > > > > https://gerrit.cloudera.org/c/21351/
> > > > > > > https://gerrit.cloudera.org/c/21358/
> > > > > > > I'll defer to Michael if these can land soon or not.
> > > > > > >
> > > > > > > Regards,
> > > > > > > Riza
> > > > > > >
> > > > > > >
> > > > > > > On Tue, Apr 9, 2024 at 3:28 AM Zoltán Borók-Nagy <
> > > > > > boroknagyz@cloudera.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Thanks everyone for the feedback!
> > > > > > > >
> > > > > > > > If there's any work in progress that you want me to include
> in
> > > the
> > > > > 4.4
> > > > > > > > release, please let me know.
> > > > > > > >
> > > > > > > > Quanlong, OK, I'll take a look into how to build RPM/DEB
> > > packages,
> > > > > and
> > > > > > > > share them on https://impala.apache.org/downloads.html if I
> > > > succeed.
> > > > > > > > First 3 CRs are already merged, the last one is WIP:
> > > > > > > > https://gerrit.cloudera.org/c/20263. I can wait for it if it
> > can
> > > > be
> > > > > > > merged
> > > > > > > > soon.
> > > > > > > >
> > > > > > > > Cheers,
> > > > > > > >     Zoltan
> > > > > > > >
> > > > > > > >
> > > > > > > > On Fri, Apr 5, 2024 at 7:21 AM Quanlong Huang <
> > > > > huangquanlong@gmail.com
> > > > > > >
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > +1
> > > > > > > > >
> > > > > > > > > Thank Zoltan! I think it's also a good chance to release
> the
> > > > > binaries
> > > > > > > > since
> > > > > > > > > we already support building RPM/DEB packages. We can mark
> > them
> > > as
> > > > > > > > > experimental and hopefully get some feedback from the
> > > community.
> > > > > > > > >
> > > > > > > > > Xiang Yang contributed some patches to improve the package
> > > > support.
> > > > > > > It'd
> > > > > > > > be
> > > > > > > > > nice to get them merged in this release as well:
> > > > > > > > > https://gerrit.cloudera.org/c/20921
> > > > > > > > > https://gerrit.cloudera.org/c/20928
> > > > > > > > > https://gerrit.cloudera.org/c/20929
> > > > > > > > > https://gerrit.cloudera.org/c/20263
> > > > > > > > >
> > > > > > > > > Quanlong
> > > > > > > > >
> > > > > > > > > On Thu, Apr 4, 2024 at 6:10 AM Laszlo Gaal <
> > laszlog@apache.org
> > > >
> > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > +1
> > > > > > > > > >
> > > > > > > > > > thank you very much for volunteering to be the release
> > > manager,
> > > > > > much
> > > > > > > > > > appreciated.
> > > > > > > > > >
> > > > > > > > > >   - LaszloG
> > > > > > > > > >
> > > > > > > > > > On Wed, Apr 3, 2024 at 8:42 PM Riza Suminto <
> > > > > > > riza.suminto@cloudera.com
> > > > > > > > >
> > > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > +1
> > > > > > > > > > >
> > > > > > > > > > > On Wed, Apr 3, 2024 at 12:55 AM Gabor Kaszab <
> > > > > > > gaborkaszab@apache.org
> > > > > > > > >
> > > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > > The last release has been a while.. Indeed this is
> > about
> > > > time
> > > > > > to
> > > > > > > > > have a
> > > > > > > > > > > new
> > > > > > > > > > > > one. Thanks for bringing this up, Zoltan!
> > > > > > > > > > > > +1
> > > > > > > > > > > >
> > > > > > > > > > > > Let's gather the unfinished items that should make it
> > to
> > > > this
> > > > > > > > release
> > > > > > > > > > if
> > > > > > > > > > > > there are any!
> > > > > > > > > > > >
> > > > > > > > > > > > Gabor
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > On Tue, Apr 2, 2024 at 8:24 PM Zoltán Borók-Nagy <
> > > > > > > > > > boroknagyz@apache.org>
> > > > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > > Our last minor release, 4.3.0, was released ~6
> months
> > > ago
> > > > > > (Oct
> > > > > > > > > 2023).
> > > > > > > > > > > > There
> > > > > > > > > > > > > have been many new changes since then covering
> > > > > > > > > > > > > - Iceberg support improvements
> > > > > > > > > > > > >     - UPDATE and DROP PARTITION statements
> > > > > > > > > > > > >     - OPTIMIZE statement for table maintenance
> > > > > > > > > > > > >    - read support for Iceberg tables with equality
> > > > deletes
> > > > > > > > > > > > >    - read support for Iceberg metadata tables
> > > > > > > > > > > > > - Workload management functionalities
> > > > > > > > > > > > > - Event processor improvements
> > > > > > > > > > > > > - Improved support for JDK 17, aarch64, Python 3,
> and
> > > > > Unicode
> > > > > > > > names
> > > > > > > > > > > > > - A graphical timeline view of query execution
> > > > > > > > > > > > > - Support for querying external RDBMS via JDBC
> > > > > > > > > > > > > - High availability for Impala's Statestore
> > > > > > > > > > > > > - Implemented small string optimization for
> > StringValue
> > > > to
> > > > > > > speed
> > > > > > > > > > > > > serialization and lower memory usage
> > > > > > > > > > > > > - Improved memory tracking for codegen caching
> > > > > > > > > > > > > - High availability for Impala's Statestore
> > > > > > > > > > > > > - Improvements to JSON support
> > > > > > > > > > > > > - Various optimizations
> > > > > > > > > > > > > - Numerous bug fixes
> > > > > > > > > > > > >
> > > > > > > > > > > > > I propose that we release 4.4.0 soon. I'm willing
> to
> > > > > > volunteer
> > > > > > > as
> > > > > > > > > the
> > > > > > > > > > > > > release manager. I'm interested to hear what the
> > > > community
> > > > > > > thinks
> > > > > > > > > > about
> > > > > > > > > > > > > doing a release. All feedback is welcome!
> > > > > > > > > > > > >
> > > > > > > > > > > > > Cheers,
> > > > > > > > > > > > > Zoltan
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: [DISCUSS] Impala 4.4.0 release

Posted by Wenzhe Zhou <wz...@cloudera.com>.

Please include IMPALA-12910 in the release.

Wenzhe Zhou
wzhou@cloudera.com
408-568-0101


On Tue, May 7, 2024 at 6:15 AM Zoltán Borók-Nagy <bo...@apache.org>
wrote:

> Thanks for the feedback.
> Since the RC1 I added the following commits:
> 74960cca6f IMPALA-12977: add search and pagination to /hadoop-varz
> 5d32919f46 IMPALA-13009: Fix catalogd not sending deletion updates for some
> dropped partitions
> 73f13f0e9f IMPALA-13012: Lower default query_log_max_queued
> 91a9dd81cc IMPALA-13005: Create Query Live table in HMS
> 7ca9798949 IMPALA-13024: Ignore slots if using default pool and empty group
> 5045f19b53 IMPALA-13015: Dataload fails due to concurrency issue with
> test.jceks
> https://github.com/apache/impala/commits/branch-4.4.0/
>
> I see that IMPALA-13020 is still on review, but hopefully it merges soon:
> https://gerrit.cloudera.org/#/c/21367/
> https://gerrit.cloudera.org/#/c/21358/ is also on review, but AFAICT it
> only affects the tests.
>
> Cheers,
> Zoltan
>
>
> On Tue, May 7, 2024 at 9:41 AM Saurabh Katiyal <sa...@gmail.com>
> wrote:
>
> > A small UI improvement for /hadoop-varz page which will make its UI
> > consistent with other pages in webUI
> > https://issues.apache.org/jira/browse/IMPALA-12977
> > [https://gerrit.cloudera.org/c/21329/]
> >
> > If possible, I'd like to include it in the 4.4.0 release
> >
> > Regards,
> > Saurabh Katiyal
> >
> > On Tue, May 7, 2024 at 11:26 AM Quanlong Huang <hu...@gmail.com>
> > wrote:
> >
> > > Please also include some recent bug fixes like
> > > https://issues.apache.org/jira/browse/IMPALA-13009
> > >
> > > On Tue, Apr 30, 2024 at 7:27 PM Kurt Deschler <kd...@cloudera.com>
> > > wrote:
> > >
> > > > Please include the new toolchain with IMPALA-13020.
> > > >
> > > > On Tue, Apr 30, 2024 at 4:46 AM Zoltán Borók-Nagy <
> > boroknagyz@apache.org
> > > >
> > > > wrote:
> > > >
> > > > > Thanks Riza. This week I'm busy but next week I'll create an RC2.
> > > > >
> > > > > If anyone else wants me to add further patches to the release,
> please
> > > > reply
> > > > > to this thread.
> > > > >
> > > > > Cheers,
> > > > >     Zoltán
> > > > >
> > > > > Riza Suminto <ri...@cloudera.com> ezt írta (időpont: 2024.
> > ápr.
> > > > > 26.,
> > > > > P 16:41):
> > > > >
> > > > > > A small bug just found this week and I push a patch for review
> > > > > > https://gerrit.cloudera.org/c/21340/
> > > > > > The patch is trivial, but will change behavior of
> coordinator-only
> > > > query
> > > > > if
> > > > > > Impala cluster does not have executor group set configuration
> > > (default
> > > > > pool
> > > > > > only).
> > > > > > I'd like to include it in the 4.4.0 release if possible.
> > > > > >
> > > > > > There are also few patches related with Workload Management and
> > Query
> > > > > Live
> > > > > > Table that is nice to have:
> > > > > > https://gerrit.cloudera.org/c/21302/
> > > > > > https://gerrit.cloudera.org/c/21351/
> > > > > > https://gerrit.cloudera.org/c/21358/
> > > > > > I'll defer to Michael if these can land soon or not.
> > > > > >
> > > > > > Regards,
> > > > > > Riza
> > > > > >
> > > > > >
> > > > > > On Tue, Apr 9, 2024 at 3:28 AM Zoltán Borók-Nagy <
> > > > > boroknagyz@cloudera.com>
> > > > > > wrote:
> > > > > >
> > > > > > > Thanks everyone for the feedback!
> > > > > > >
> > > > > > > If there's any work in progress that you want me to include in
> > the
> > > > 4.4
> > > > > > > release, please let me know.
> > > > > > >
> > > > > > > Quanlong, OK, I'll take a look into how to build RPM/DEB
> > packages,
> > > > and
> > > > > > > share them on https://impala.apache.org/downloads.html if I
> > > succeed.
> > > > > > > First 3 CRs are already merged, the last one is WIP:
> > > > > > > https://gerrit.cloudera.org/c/20263. I can wait for it if it
> can
> > > be
> > > > > > merged
> > > > > > > soon.
> > > > > > >
> > > > > > > Cheers,
> > > > > > >     Zoltan
> > > > > > >
> > > > > > >
> > > > > > > On Fri, Apr 5, 2024 at 7:21 AM Quanlong Huang <
> > > > huangquanlong@gmail.com
> > > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > > > +1
> > > > > > > >
> > > > > > > > Thank Zoltan! I think it's also a good chance to release the
> > > > binaries
> > > > > > > since
> > > > > > > > we already support building RPM/DEB packages. We can mark
> them
> > as
> > > > > > > > experimental and hopefully get some feedback from the
> > community.
> > > > > > > >
> > > > > > > > Xiang Yang contributed some patches to improve the package
> > > support.
> > > > > > It'd
> > > > > > > be
> > > > > > > > nice to get them merged in this release as well:
> > > > > > > > https://gerrit.cloudera.org/c/20921
> > > > > > > > https://gerrit.cloudera.org/c/20928
> > > > > > > > https://gerrit.cloudera.org/c/20929
> > > > > > > > https://gerrit.cloudera.org/c/20263
> > > > > > > >
> > > > > > > > Quanlong
> > > > > > > >
> > > > > > > > On Thu, Apr 4, 2024 at 6:10 AM Laszlo Gaal <
> laszlog@apache.org
> > >
> > > > > wrote:
> > > > > > > >
> > > > > > > > > +1
> > > > > > > > >
> > > > > > > > > thank you very much for volunteering to be the release
> > manager,
> > > > > much
> > > > > > > > > appreciated.
> > > > > > > > >
> > > > > > > > >   - LaszloG
> > > > > > > > >
> > > > > > > > > On Wed, Apr 3, 2024 at 8:42 PM Riza Suminto <
> > > > > > riza.suminto@cloudera.com
> > > > > > > >
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > +1
> > > > > > > > > >
> > > > > > > > > > On Wed, Apr 3, 2024 at 12:55 AM Gabor Kaszab <
> > > > > > gaborkaszab@apache.org
> > > > > > > >
> > > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > The last release has been a while.. Indeed this is
> about
> > > time
> > > > > to
> > > > > > > > have a
> > > > > > > > > > new
> > > > > > > > > > > one. Thanks for bringing this up, Zoltan!
> > > > > > > > > > > +1
> > > > > > > > > > >
> > > > > > > > > > > Let's gather the unfinished items that should make it
> to
> > > this
> > > > > > > release
> > > > > > > > > if
> > > > > > > > > > > there are any!
> > > > > > > > > > >
> > > > > > > > > > > Gabor
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > On Tue, Apr 2, 2024 at 8:24 PM Zoltán Borók-Nagy <
> > > > > > > > > boroknagyz@apache.org>
> > > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > > Our last minor release, 4.3.0, was released ~6 months
> > ago
> > > > > (Oct
> > > > > > > > 2023).
> > > > > > > > > > > There
> > > > > > > > > > > > have been many new changes since then covering
> > > > > > > > > > > > - Iceberg support improvements
> > > > > > > > > > > >     - UPDATE and DROP PARTITION statements
> > > > > > > > > > > >     - OPTIMIZE statement for table maintenance
> > > > > > > > > > > >    - read support for Iceberg tables with equality
> > > deletes
> > > > > > > > > > > >    - read support for Iceberg metadata tables
> > > > > > > > > > > > - Workload management functionalities
> > > > > > > > > > > > - Event processor improvements
> > > > > > > > > > > > - Improved support for JDK 17, aarch64, Python 3, and
> > > > Unicode
> > > > > > > names
> > > > > > > > > > > > - A graphical timeline view of query execution
> > > > > > > > > > > > - Support for querying external RDBMS via JDBC
> > > > > > > > > > > > - High availability for Impala's Statestore
> > > > > > > > > > > > - Implemented small string optimization for
> StringValue
> > > to
> > > > > > speed
> > > > > > > > > > > > serialization and lower memory usage
> > > > > > > > > > > > - Improved memory tracking for codegen caching
> > > > > > > > > > > > - High availability for Impala's Statestore
> > > > > > > > > > > > - Improvements to JSON support
> > > > > > > > > > > > - Various optimizations
> > > > > > > > > > > > - Numerous bug fixes
> > > > > > > > > > > >
> > > > > > > > > > > > I propose that we release 4.4.0 soon. I'm willing to
> > > > > volunteer
> > > > > > as
> > > > > > > > the
> > > > > > > > > > > > release manager. I'm interested to hear what the
> > > community
> > > > > > thinks
> > > > > > > > > about
> > > > > > > > > > > > doing a release. All feedback is welcome!
> > > > > > > > > > > >
> > > > > > > > > > > > Cheers,
> > > > > > > > > > > > Zoltan
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: [DISCUSS] Impala 4.4.0 release

Posted by Zoltán Borók-Nagy <bo...@apache.org>.

Thanks for the feedback.
Since the RC1 I added the following commits:
74960cca6f IMPALA-12977: add search and pagination to /hadoop-varz
5d32919f46 IMPALA-13009: Fix catalogd not sending deletion updates for some
dropped partitions
73f13f0e9f IMPALA-13012: Lower default query_log_max_queued
91a9dd81cc IMPALA-13005: Create Query Live table in HMS
7ca9798949 IMPALA-13024: Ignore slots if using default pool and empty group
5045f19b53 IMPALA-13015: Dataload fails due to concurrency issue with
test.jceks
https://github.com/apache/impala/commits/branch-4.4.0/

I see that IMPALA-13020 is still on review, but hopefully it merges soon:
https://gerrit.cloudera.org/#/c/21367/
https://gerrit.cloudera.org/#/c/21358/ is also on review, but AFAICT it
only affects the tests.

Cheers,
Zoltan


On Tue, May 7, 2024 at 9:41 AM Saurabh Katiyal <sa...@gmail.com>
wrote:

> A small UI improvement for /hadoop-varz page which will make its UI
> consistent with other pages in webUI
> https://issues.apache.org/jira/browse/IMPALA-12977
> [https://gerrit.cloudera.org/c/21329/]
>
> If possible, I'd like to include it in the 4.4.0 release
>
> Regards,
> Saurabh Katiyal
>
> On Tue, May 7, 2024 at 11:26 AM Quanlong Huang <hu...@gmail.com>
> wrote:
>
> > Please also include some recent bug fixes like
> > https://issues.apache.org/jira/browse/IMPALA-13009
> >
> > On Tue, Apr 30, 2024 at 7:27 PM Kurt Deschler <kd...@cloudera.com>
> > wrote:
> >
> > > Please include the new toolchain with IMPALA-13020.
> > >
> > > On Tue, Apr 30, 2024 at 4:46 AM Zoltán Borók-Nagy <
> boroknagyz@apache.org
> > >
> > > wrote:
> > >
> > > > Thanks Riza. This week I'm busy but next week I'll create an RC2.
> > > >
> > > > If anyone else wants me to add further patches to the release, please
> > > reply
> > > > to this thread.
> > > >
> > > > Cheers,
> > > >     Zoltán
> > > >
> > > > Riza Suminto <ri...@cloudera.com> ezt írta (időpont: 2024.
> ápr.
> > > > 26.,
> > > > P 16:41):
> > > >
> > > > > A small bug just found this week and I push a patch for review
> > > > > https://gerrit.cloudera.org/c/21340/
> > > > > The patch is trivial, but will change behavior of coordinator-only
> > > query
> > > > if
> > > > > Impala cluster does not have executor group set configuration
> > (default
> > > > pool
> > > > > only).
> > > > > I'd like to include it in the 4.4.0 release if possible.
> > > > >
> > > > > There are also few patches related with Workload Management and
> Query
> > > > Live
> > > > > Table that is nice to have:
> > > > > https://gerrit.cloudera.org/c/21302/
> > > > > https://gerrit.cloudera.org/c/21351/
> > > > > https://gerrit.cloudera.org/c/21358/
> > > > > I'll defer to Michael if these can land soon or not.
> > > > >
> > > > > Regards,
> > > > > Riza
> > > > >
> > > > >
> > > > > On Tue, Apr 9, 2024 at 3:28 AM Zoltán Borók-Nagy <
> > > > boroknagyz@cloudera.com>
> > > > > wrote:
> > > > >
> > > > > > Thanks everyone for the feedback!
> > > > > >
> > > > > > If there's any work in progress that you want me to include in
> the
> > > 4.4
> > > > > > release, please let me know.
> > > > > >
> > > > > > Quanlong, OK, I'll take a look into how to build RPM/DEB
> packages,
> > > and
> > > > > > share them on https://impala.apache.org/downloads.html if I
> > succeed.
> > > > > > First 3 CRs are already merged, the last one is WIP:
> > > > > > https://gerrit.cloudera.org/c/20263. I can wait for it if it can
> > be
> > > > > merged
> > > > > > soon.
> > > > > >
> > > > > > Cheers,
> > > > > >     Zoltan
> > > > > >
> > > > > >
> > > > > > On Fri, Apr 5, 2024 at 7:21 AM Quanlong Huang <
> > > huangquanlong@gmail.com
> > > > >
> > > > > > wrote:
> > > > > >
> > > > > > > +1
> > > > > > >
> > > > > > > Thank Zoltan! I think it's also a good chance to release the
> > > binaries
> > > > > > since
> > > > > > > we already support building RPM/DEB packages. We can mark them
> as
> > > > > > > experimental and hopefully get some feedback from the
> community.
> > > > > > >
> > > > > > > Xiang Yang contributed some patches to improve the package
> > support.
> > > > > It'd
> > > > > > be
> > > > > > > nice to get them merged in this release as well:
> > > > > > > https://gerrit.cloudera.org/c/20921
> > > > > > > https://gerrit.cloudera.org/c/20928
> > > > > > > https://gerrit.cloudera.org/c/20929
> > > > > > > https://gerrit.cloudera.org/c/20263
> > > > > > >
> > > > > > > Quanlong
> > > > > > >
> > > > > > > On Thu, Apr 4, 2024 at 6:10 AM Laszlo Gaal <laszlog@apache.org
> >
> > > > wrote:
> > > > > > >
> > > > > > > > +1
> > > > > > > >
> > > > > > > > thank you very much for volunteering to be the release
> manager,
> > > > much
> > > > > > > > appreciated.
> > > > > > > >
> > > > > > > >   - LaszloG
> > > > > > > >
> > > > > > > > On Wed, Apr 3, 2024 at 8:42 PM Riza Suminto <
> > > > > riza.suminto@cloudera.com
> > > > > > >
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > +1
> > > > > > > > >
> > > > > > > > > On Wed, Apr 3, 2024 at 12:55 AM Gabor Kaszab <
> > > > > gaborkaszab@apache.org
> > > > > > >
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > The last release has been a while.. Indeed this is about
> > time
> > > > to
> > > > > > > have a
> > > > > > > > > new
> > > > > > > > > > one. Thanks for bringing this up, Zoltan!
> > > > > > > > > > +1
> > > > > > > > > >
> > > > > > > > > > Let's gather the unfinished items that should make it to
> > this
> > > > > > release
> > > > > > > > if
> > > > > > > > > > there are any!
> > > > > > > > > >
> > > > > > > > > > Gabor
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Tue, Apr 2, 2024 at 8:24 PM Zoltán Borók-Nagy <
> > > > > > > > boroknagyz@apache.org>
> > > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > Our last minor release, 4.3.0, was released ~6 months
> ago
> > > > (Oct
> > > > > > > 2023).
> > > > > > > > > > There
> > > > > > > > > > > have been many new changes since then covering
> > > > > > > > > > > - Iceberg support improvements
> > > > > > > > > > >     - UPDATE and DROP PARTITION statements
> > > > > > > > > > >     - OPTIMIZE statement for table maintenance
> > > > > > > > > > >    - read support for Iceberg tables with equality
> > deletes
> > > > > > > > > > >    - read support for Iceberg metadata tables
> > > > > > > > > > > - Workload management functionalities
> > > > > > > > > > > - Event processor improvements
> > > > > > > > > > > - Improved support for JDK 17, aarch64, Python 3, and
> > > Unicode
> > > > > > names
> > > > > > > > > > > - A graphical timeline view of query execution
> > > > > > > > > > > - Support for querying external RDBMS via JDBC
> > > > > > > > > > > - High availability for Impala's Statestore
> > > > > > > > > > > - Implemented small string optimization for StringValue
> > to
> > > > > speed
> > > > > > > > > > > serialization and lower memory usage
> > > > > > > > > > > - Improved memory tracking for codegen caching
> > > > > > > > > > > - High availability for Impala's Statestore
> > > > > > > > > > > - Improvements to JSON support
> > > > > > > > > > > - Various optimizations
> > > > > > > > > > > - Numerous bug fixes
> > > > > > > > > > >
> > > > > > > > > > > I propose that we release 4.4.0 soon. I'm willing to
> > > > volunteer
> > > > > as
> > > > > > > the
> > > > > > > > > > > release manager. I'm interested to hear what the
> > community
> > > > > thinks
> > > > > > > > about
> > > > > > > > > > > doing a release. All feedback is welcome!
> > > > > > > > > > >
> > > > > > > > > > > Cheers,
> > > > > > > > > > > Zoltan
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: [DISCUSS] Impala 4.4.0 release

Posted by Saurabh Katiyal <sa...@gmail.com>.

A small UI improvement for /hadoop-varz page which will make its UI
consistent with other pages in webUI
https://issues.apache.org/jira/browse/IMPALA-12977
[https://gerrit.cloudera.org/c/21329/]

If possible, I'd like to include it in the 4.4.0 release

Regards,
Saurabh Katiyal

On Tue, May 7, 2024 at 11:26 AM Quanlong Huang <hu...@gmail.com>
wrote:

> Please also include some recent bug fixes like
> https://issues.apache.org/jira/browse/IMPALA-13009
>
> On Tue, Apr 30, 2024 at 7:27 PM Kurt Deschler <kd...@cloudera.com>
> wrote:
>
> > Please include the new toolchain with IMPALA-13020.
> >
> > On Tue, Apr 30, 2024 at 4:46 AM Zoltán Borók-Nagy <boroknagyz@apache.org
> >
> > wrote:
> >
> > > Thanks Riza. This week I'm busy but next week I'll create an RC2.
> > >
> > > If anyone else wants me to add further patches to the release, please
> > reply
> > > to this thread.
> > >
> > > Cheers,
> > >     Zoltán
> > >
> > > Riza Suminto <ri...@cloudera.com> ezt írta (időpont: 2024. ápr.
> > > 26.,
> > > P 16:41):
> > >
> > > > A small bug just found this week and I push a patch for review
> > > > https://gerrit.cloudera.org/c/21340/
> > > > The patch is trivial, but will change behavior of coordinator-only
> > query
> > > if
> > > > Impala cluster does not have executor group set configuration
> (default
> > > pool
> > > > only).
> > > > I'd like to include it in the 4.4.0 release if possible.
> > > >
> > > > There are also few patches related with Workload Management and Query
> > > Live
> > > > Table that is nice to have:
> > > > https://gerrit.cloudera.org/c/21302/
> > > > https://gerrit.cloudera.org/c/21351/
> > > > https://gerrit.cloudera.org/c/21358/
> > > > I'll defer to Michael if these can land soon or not.
> > > >
> > > > Regards,
> > > > Riza
> > > >
> > > >
> > > > On Tue, Apr 9, 2024 at 3:28 AM Zoltán Borók-Nagy <
> > > boroknagyz@cloudera.com>
> > > > wrote:
> > > >
> > > > > Thanks everyone for the feedback!
> > > > >
> > > > > If there's any work in progress that you want me to include in the
> > 4.4
> > > > > release, please let me know.
> > > > >
> > > > > Quanlong, OK, I'll take a look into how to build RPM/DEB packages,
> > and
> > > > > share them on https://impala.apache.org/downloads.html if I
> succeed.
> > > > > First 3 CRs are already merged, the last one is WIP:
> > > > > https://gerrit.cloudera.org/c/20263. I can wait for it if it can
> be
> > > > merged
> > > > > soon.
> > > > >
> > > > > Cheers,
> > > > >     Zoltan
> > > > >
> > > > >
> > > > > On Fri, Apr 5, 2024 at 7:21 AM Quanlong Huang <
> > huangquanlong@gmail.com
> > > >
> > > > > wrote:
> > > > >
> > > > > > +1
> > > > > >
> > > > > > Thank Zoltan! I think it's also a good chance to release the
> > binaries
> > > > > since
> > > > > > we already support building RPM/DEB packages. We can mark them as
> > > > > > experimental and hopefully get some feedback from the community.
> > > > > >
> > > > > > Xiang Yang contributed some patches to improve the package
> support.
> > > > It'd
> > > > > be
> > > > > > nice to get them merged in this release as well:
> > > > > > https://gerrit.cloudera.org/c/20921
> > > > > > https://gerrit.cloudera.org/c/20928
> > > > > > https://gerrit.cloudera.org/c/20929
> > > > > > https://gerrit.cloudera.org/c/20263
> > > > > >
> > > > > > Quanlong
> > > > > >
> > > > > > On Thu, Apr 4, 2024 at 6:10 AM Laszlo Gaal <la...@apache.org>
> > > wrote:
> > > > > >
> > > > > > > +1
> > > > > > >
> > > > > > > thank you very much for volunteering to be the release manager,
> > > much
> > > > > > > appreciated.
> > > > > > >
> > > > > > >   - LaszloG
> > > > > > >
> > > > > > > On Wed, Apr 3, 2024 at 8:42 PM Riza Suminto <
> > > > riza.suminto@cloudera.com
> > > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > > > +1
> > > > > > > >
> > > > > > > > On Wed, Apr 3, 2024 at 12:55 AM Gabor Kaszab <
> > > > gaborkaszab@apache.org
> > > > > >
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > The last release has been a while.. Indeed this is about
> time
> > > to
> > > > > > have a
> > > > > > > > new
> > > > > > > > > one. Thanks for bringing this up, Zoltan!
> > > > > > > > > +1
> > > > > > > > >
> > > > > > > > > Let's gather the unfinished items that should make it to
> this
> > > > > release
> > > > > > > if
> > > > > > > > > there are any!
> > > > > > > > >
> > > > > > > > > Gabor
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Tue, Apr 2, 2024 at 8:24 PM Zoltán Borók-Nagy <
> > > > > > > boroknagyz@apache.org>
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > Our last minor release, 4.3.0, was released ~6 months ago
> > > (Oct
> > > > > > 2023).
> > > > > > > > > There
> > > > > > > > > > have been many new changes since then covering
> > > > > > > > > > - Iceberg support improvements
> > > > > > > > > >     - UPDATE and DROP PARTITION statements
> > > > > > > > > >     - OPTIMIZE statement for table maintenance
> > > > > > > > > >    - read support for Iceberg tables with equality
> deletes
> > > > > > > > > >    - read support for Iceberg metadata tables
> > > > > > > > > > - Workload management functionalities
> > > > > > > > > > - Event processor improvements
> > > > > > > > > > - Improved support for JDK 17, aarch64, Python 3, and
> > Unicode
> > > > > names
> > > > > > > > > > - A graphical timeline view of query execution
> > > > > > > > > > - Support for querying external RDBMS via JDBC
> > > > > > > > > > - High availability for Impala's Statestore
> > > > > > > > > > - Implemented small string optimization for StringValue
> to
> > > > speed
> > > > > > > > > > serialization and lower memory usage
> > > > > > > > > > - Improved memory tracking for codegen caching
> > > > > > > > > > - High availability for Impala's Statestore
> > > > > > > > > > - Improvements to JSON support
> > > > > > > > > > - Various optimizations
> > > > > > > > > > - Numerous bug fixes
> > > > > > > > > >
> > > > > > > > > > I propose that we release 4.4.0 soon. I'm willing to
> > > volunteer
> > > > as
> > > > > > the
> > > > > > > > > > release manager. I'm interested to hear what the
> community
> > > > thinks
> > > > > > > about
> > > > > > > > > > doing a release. All feedback is welcome!
> > > > > > > > > >
> > > > > > > > > > Cheers,
> > > > > > > > > > Zoltan
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>