You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@impala.apache.org by st...@apache.org on 2023/06/23 07:01:57 UTC

[impala] branch master updated (dced8ca27 -> 85e1a3e33)

This is an automated email from the ASF dual-hosted git repository.

stigahuang pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git


    from dced8ca27 IMPALA-12217: Update cgroup-util to handle cgroups v2
     new 4bb705e7c IMPALA-12223: Bump thrift to 0.16.0-p5 to fix THRIFT-5716
     new 85e1a3e33 IMPALA-12218: Exclude Ranger's ORC dependency

The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 bin/impala-config.sh | 8 ++++----
 fe/pom.xml           | 8 ++++++++
 2 files changed, 12 insertions(+), 4 deletions(-)


[impala] 01/02: IMPALA-12223: Bump thrift to 0.16.0-p5 to fix THRIFT-5716

Posted by st...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

stigahuang pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git

commit 4bb705e7ca70dd38fdf97d43a44957fdca809ca5
Author: stiga-huang <hu...@gmail.com>
AuthorDate: Thu Jun 22 16:08:43 2023 +0800

    IMPALA-12223: Bump thrift to 0.16.0-p5 to fix THRIFT-5716
    
    This bumps the toolchain version to add the fix of THRIFT-5716 which
    causes coordinator crashes in serializing large profiles.
    
    Tests:
     - Verified the build on Ubuntu18 and the recently supported Ubuntu22
       and Redhat9.
    
    Change-Id: I2b07843778b160f914d9250c3d1066c09056c198
    Reviewed-on: http://gerrit.cloudera.org:8080/20107
    Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
    Tested-by: Impala Public Jenkins <im...@cloudera.com>
---
 bin/impala-config.sh | 8 ++++----
 1 file changed, 4 insertions(+), 4 deletions(-)

diff --git a/bin/impala-config.sh b/bin/impala-config.sh
index 778f7b9ca..d6b7715f0 100755
--- a/bin/impala-config.sh
+++ b/bin/impala-config.sh
@@ -81,7 +81,7 @@ export USE_APACHE_HIVE=${USE_APACHE_HIVE-false}
 # moving to a different build of the toolchain, e.g. when a version is bumped or a
 # compile option is changed. The build id can be found in the output of the toolchain
 # build jobs, it is constructed from the build number and toolchain git hash prefix.
-export IMPALA_TOOLCHAIN_BUILD_ID=320-33e177225e
+export IMPALA_TOOLCHAIN_BUILD_ID=324-bb64c6ed91
 # Versions of toolchain dependencies.
 # -----------------------------------
 export IMPALA_AVRO_VERSION=1.7.4-p5
@@ -184,7 +184,7 @@ unset IMPALA_CALLONCEHACK_URL
 # If upgrading IMPALA_THRIFT_PY_VERSION, remember to also upgrade thrift version in
 # shell/ext-py and shell/packaging/requirements.txt. IMPALA_THRIFT_PY_VERSION is used
 # with Impyla and for the thrift compiler.
-export IMPALA_THRIFT_CPP_VERSION=0.16.0-p4
+export IMPALA_THRIFT_CPP_VERSION=0.16.0-p5
 unset IMPALA_THRIFT_CPP_URL
 if $USE_APACHE_HIVE; then
   # Apache Hive 3 clients can't run on thrift versions >= 0.14 (IMPALA-11801)
@@ -192,10 +192,10 @@ if $USE_APACHE_HIVE; then
   export IMPALA_THRIFT_JAVA_VERSION=${IMPALA_THRIFT_POM_VERSION}-p5
 else
   export IMPALA_THRIFT_POM_VERSION=0.16.0
-  export IMPALA_THRIFT_JAVA_VERSION=${IMPALA_THRIFT_POM_VERSION}-p4
+  export IMPALA_THRIFT_JAVA_VERSION=${IMPALA_THRIFT_POM_VERSION}-p5
 fi
 unset IMPALA_THRIFT_JAVA_URL
-export IMPALA_THRIFT_PY_VERSION=0.16.0-p4
+export IMPALA_THRIFT_PY_VERSION=0.16.0-p5
 unset IMPALA_THRIFT_PY_URL
 
 # Find system python versions for testing


[impala] 02/02: IMPALA-12218: Exclude Ranger's ORC dependency

Posted by st...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

stigahuang pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git

commit 85e1a3e33b9a3f55684e321f5ad180d4fc04c5ad
Author: Laszlo Gaal <la...@cloudera.com>
AuthorDate: Wed May 31 20:22:31 2023 +0200

    IMPALA-12218: Exclude Ranger's ORC dependency
    
    Since RANGER-1837 Ranger has a dependency on ORC, as it became capable
    of writing audit information in ORC format in addition to the text-based
    formats supported earlier (JSON, CSV).
    The Impala front-end has its own direct ORC dependency, for which
    versioning is driven by the front-end's Iceberg dependency, as Iceberg
    needs quite recent versions of the file formats libraries, including
    ORC.
    
    Since the front-end's Ranger plugin requires only basic functionality
    from ORC, which is expected to be compatible across versions,
    the potential version conflict between the two dependencies is resolved
    by excluding Ranger's transitive ORC dependency from the Impala build.
    
    Tested by building the front-end locally, then passing a core-mode test
    run on Jenkins.
    
    Change-Id: I368489016795020d590ab6d12d656327d7911eb7
    Reviewed-on: http://gerrit.cloudera.org:8080/20081
    Reviewed-by: Joe McDonnell <jo...@cloudera.com>
    Tested-by: Impala Public Jenkins <im...@cloudera.com>
---
 fe/pom.xml | 8 ++++++++
 1 file changed, 8 insertions(+)

diff --git a/fe/pom.xml b/fe/pom.xml
index 6cea36f97..549abf499 100644
--- a/fe/pom.xml
+++ b/fe/pom.xml
@@ -199,6 +199,14 @@ under the License.
           <groupId>org.apache.shiro</groupId>
           <artifactId>shiro-core</artifactId>
         </exclusion>
+        <!-- RANGER-1837 causes Ranger to pull in ORC dependencies.
+        We have a much tighter coupling with the ORC version required by the Iceberg
+        dependency (which is likely to conflict), so the indirect dependency
+        through Ranger is excluded here. -->
+        <exclusion>
+          <groupId>org.apache.orc</groupId>
+          <artifactId>*</artifactId>
+        </exclusion>
         <!--
         We do not explicitly exclude all artifacts in org.eclipse.jetty because
         jetty-client is needed.