You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Tianyi Wang (JIRA)" <ji...@apache.org> on 2018/06/21 02:57:00 UTC
[jira] [Resolved] (IMPALA-7169)
TestHdfsEncryption::()::test_drop_partition_encrypt fails to find file
[ https://issues.apache.org/jira/browse/IMPALA-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tianyi Wang resolved IMPALA-7169.
---------------------------------
Resolution: Fixed
Fix Version/s: Impala 3.1.0
IMPALA-7169: Prevent HDFS from checkpointing trash until 3000 AD
HDFS trash checkpointing renames files in the trash folder and breaks
impala tests. Impala set the trash checkpointing interval to 1440 to try
to postpone it for 24 hours. Unfortunately that told HDFS to do it when
the UNIX time is a multiple of 1440 * 60 and it broke trash-related
tests run around midnight in GMT. This patch sets the interval to
541728000 so that HDFS won't do the checkpointing until Jan 1st 3000,
and HDFS will checkpoint every 1030 years after that.
Change-Id: I9452f7e44c7679f86a947cd20115c078757223d8
Reviewed-on: http://gerrit.cloudera.org:8080/10742
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <impal
> TestHdfsEncryption::()::test_drop_partition_encrypt fails to find file
> ----------------------------------------------------------------------
>
> Key: IMPALA-7169
> URL: https://issues.apache.org/jira/browse/IMPALA-7169
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 2.13.0
> Reporter: Lars Volker
> Assignee: Tianyi Wang
> Priority: Critical
> Labels: broken-build, flaky
> Fix For: Impala 3.1.0
>
>
> {noformat}
> F metadata/test_hdfs_encryption.py::TestHdfsEncryption::()::test_drop_partition_encrypt
> metadata/test_hdfs_encryption.py:202: in test_drop_partition_encrypt
> assert self.hdfs_client.exists(
> E assert <bound method PyWebHdfsClientWithChmod.exists of <tests.util.hdfs_util.PyWebHdfsClientWithChmod object at 0xba6ee90>>('/user/jenkins/.Trash/Current/test-warehouse/test_encryption_db.db/t1/j=1/j1.txt')
> E + where <bound method PyWebHdfsClientWithChmod.exists of <tests.util.hdfs_util.PyWebHdfsClientWithChmod object at 0xba6ee90>> = <tests.util.hdfs_util.PyWebHdfsClientWithChmod object at 0xba6ee90>.exists
> E + where <tests.util.hdfs_util.PyWebHdfsClientWithChmod object at 0xba6ee90> = <test_hdfs_encryption.TestHdfsEncryption object at 0xba6ed50>.hdfs_client
> E + and '/user/jenkins/.Trash/Current/test-warehouse/test_encryption_db.db/t1/j=1/j1.txt' = <built-in method format of str object at 0x3d6f780>('jenkins', 'test_encryption_db')
> E + where <built-in method format of str object at 0x3d6f780> = '/user/{0}/.Trash/Current/test-warehouse/{1}.db/t1/j=1/j1.txt'.format
> E + and 'jenkins' = <function getuser at 0xb722a8>()
> E + where <function getuser at 0xb722a8> = getpass.getuser
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org