You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@impala.apache.org by ta...@apache.org on 2020/03/30 20:45:08 UTC
[impala] branch master updated (2f53783 -> 5bdd3ad)
This is an automated email from the ASF dual-hosted git repository.
tarmstrong pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git.
from 2f53783 IMPALA-9401: primitive include-what-you-use script and mappings
new a09963f Make Hive compactions faster in minicluster env.
new 5bdd3ad IMPALA-9566: Sentry service should not be started after IMPALA-8870
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
fe/src/test/resources/hive-site.xml.py | 6 +++++-
testdata/bin/run-all.sh | 8 +++++---
2 files changed, 10 insertions(+), 4 deletions(-)
[impala] 01/02: Make Hive compactions faster in minicluster env.
Posted by ta...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
tarmstrong pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git
commit a09963f2f7c06ba53397ffbe1095c5cb27a27646
Author: Zoltan Borok-Nagy <bo...@cloudera.com>
AuthorDate: Mon Mar 30 12:17:21 2020 +0200
Make Hive compactions faster in minicluster env.
Due to HIVE-23102 Hive will wait for at least
'hive.compactor.wait.timeout' amount of time for compactions. By
default this value is 5 mins which is way too long.
This commit sets the wait time to 2 secs.
Change-Id: I565e6b454cb256b0de7d390aa6fc235ea44d445a
Reviewed-on: http://gerrit.cloudera.org:8080/15593
Reviewed-by: Zoltan Borok-Nagy <bo...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
---
fe/src/test/resources/hive-site.xml.py | 6 +++++-
1 file changed, 5 insertions(+), 1 deletion(-)
diff --git a/fe/src/test/resources/hive-site.xml.py b/fe/src/test/resources/hive-site.xml.py
index 687303a..3662a12 100644
--- a/fe/src/test/resources/hive-site.xml.py
+++ b/fe/src/test/resources/hive-site.xml.py
@@ -137,7 +137,11 @@ if hive_major_version >= 3:
# are built around populating /test-warehouse, so use /test-warehouse/managed
# to allow that logic to remain the same.
'hive.metastore.warehouse.dir': '${WAREHOUSE_LOCATION_PREFIX}/test-warehouse/managed',
- 'hive.metastore.warehouse.external.dir': '${WAREHOUSE_LOCATION_PREFIX}/test-warehouse'
+ 'hive.metastore.warehouse.external.dir': '${WAREHOUSE_LOCATION_PREFIX}/test-warehouse',
+
+ # Due to HIVE-23102 Hive will wait for at least this amount of time for compactions
+ # (the default value is 5 mins which is way too long). Setting it to 2 seconds.
+ 'hive.compactor.wait.timeout': '2000'
})
else:
if os.environ.get('DISABLE_SENTRY') == "false":
[impala] 02/02: IMPALA-9566: Sentry service should not be started
after IMPALA-8870
Posted by ta...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
tarmstrong pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git
commit 5bdd3adb1aef9729a122d57490fefb521eef8885
Author: Fang-Yu Rao <fa...@cloudera.com>
AuthorDate: Sat Mar 28 11:38:59 2020 -0700
IMPALA-9566: Sentry service should not be started after IMPALA-8870
Due to the incompatibility between different versions of the Guava
libraries, after bumping up Guava in IMPALA-8870, our build script is
not supposed to start up the Sentry service when starting the
minicluster because Sentry has not had its Guava bumped up yet. However,
the patch for IMPALA-8870 did not take this into consideration when
$TARGET_FILESYSTEM is s3 and thus run-all.sh still attempts to start
up Sentry in this case. This patch fixes the bug.
Testing:
- Verified that this patch passes the core tests in the DEBUG build when
$TARGET_FILESYSTEM is s3.
Change-Id: If81846f4251fb2aa752ba8c33615cae0ab513a62
Reviewed-on: http://gerrit.cloudera.org:8080/15590
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Reviewed-by: Csaba Ringhofer <cs...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
---
testdata/bin/run-all.sh | 8 +++++---
1 file changed, 5 insertions(+), 3 deletions(-)
diff --git a/testdata/bin/run-all.sh b/testdata/bin/run-all.sh
index a37c333..2fbeaf5 100755
--- a/testdata/bin/run-all.sh
+++ b/testdata/bin/run-all.sh
@@ -99,9 +99,11 @@ else
$IMPALA_HOME/testdata/bin/run-hive-server.sh -only_metastore 2>&1 | \
tee ${IMPALA_CLUSTER_LOGS_DIR}/run-hive-server.log
- echo " --> Starting the Sentry Policy Server"
- $IMPALA_HOME/testdata/bin/run-sentry-service.sh 2>&1 | \
- tee ${IMPALA_CLUSTER_LOGS_DIR}/run-sentry-service.log
+ if [[ "$DISABLE_SENTRY" != true ]]; then
+ echo " --> Starting the Sentry Policy Server"
+ $IMPALA_HOME/testdata/bin/run-sentry-service.sh 2>&1 | \
+ tee ${IMPALA_CLUSTER_LOGS_DIR}/run-sentry-service.log
+ fi
fi
echo " --> Starting Ranger Server"