You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@impala.apache.org by ta...@apache.org on 2018/05/23 17:15:19 UTC
[3/3] impala git commit: IMPALA-7048: Failed test:
test_write_index_many_columns_tables
IMPALA-7048: Failed test: test_write_index_many_columns_tables
The test in the title fails when the local filesystem is used.
Looking at the error message it seems that the determined
Parquet file size is too small when the local filesystem
is used. There is already an annotation for that:
'SkipIfLocal.parquet_file_size'
I added this annotation to the TestHdfsParquetTableIndexWriter
class, therefore these tests won't be executed when the
test-warehouse directory of Impala resides on the local
filesystem.
Change-Id: Idd3be70fb654a49dda44309a8914fe1f2b48a1af
Reviewed-on: http://gerrit.cloudera.org:8080/10476
Reviewed-by: Zoltan Borok-Nagy <bo...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
Project: http://git-wip-us.apache.org/repos/asf/impala/repo
Commit: http://git-wip-us.apache.org/repos/asf/impala/commit/710b08bf
Tree: http://git-wip-us.apache.org/repos/asf/impala/tree/710b08bf
Diff: http://git-wip-us.apache.org/repos/asf/impala/diff/710b08bf
Branch: refs/heads/master
Commit: 710b08bfd84b24f478582364a3077a01f4a7700b
Parents: c4b214b
Author: Zoltan Borok-Nagy <bo...@cloudera.com>
Authored: Tue May 22 18:13:45 2018 +0200
Committer: Impala Public Jenkins <im...@cloudera.com>
Committed: Wed May 23 15:19:27 2018 +0000
----------------------------------------------------------------------
tests/query_test/test_parquet_page_index.py | 2 ++
1 file changed, 2 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/impala/blob/710b08bf/tests/query_test/test_parquet_page_index.py
----------------------------------------------------------------------
diff --git a/tests/query_test/test_parquet_page_index.py b/tests/query_test/test_parquet_page_index.py
index 51632e5..0ee5d37 100644
--- a/tests/query_test/test_parquet_page_index.py
+++ b/tests/query_test/test_parquet_page_index.py
@@ -24,6 +24,7 @@ from subprocess import check_call
from parquet.ttypes import BoundaryOrder, ColumnIndex, OffsetIndex, PageHeader, PageType
from tests.common.impala_test_suite import ImpalaTestSuite
+from tests.common.skip import SkipIfLocal
from tests.util.filesystem_utils import get_fs_path
from tests.util.get_parquet_metadata import (
decode_stats_value,
@@ -34,6 +35,7 @@ from tests.util.get_parquet_metadata import (
PAGE_INDEX_MAX_STRING_LENGTH = 64
+@SkipIfLocal.parquet_file_size
class TestHdfsParquetTableIndexWriter(ImpalaTestSuite):
"""Since PARQUET-922 page statistics can be written before the footer.
The tests in this class checks if Impala writes the page indices correctly.