You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2022/06/20 18:51:00 UTC

[jira] [Commented] (IMPALA-11356) CDP_BUILD_NUMBER 27992803 failing because of new Hive behaviour

    [ https://issues.apache.org/jira/browse/IMPALA-11356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17556510#comment-17556510 ] 

ASF subversion and git services commented on IMPALA-11356:
----------------------------------------------------------

Commit d12d4c9b077392f58701af2e343dd927fe516846 in impala's branch refs/heads/master from Joe McDonnell
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=d12d4c9b0 ]

IMPALA-11356: Fix test_sfs.py to account for new Hive behavior

Hive changed behavior in HIVE-24920 to allow external SFS tables to
point to locations in managed tables. test_sfs.py had a test case for
the previous failure, so it broke with this change.

This changes test_sfs.py to verify the new behavior where an external
SFS table can point to a managed location.

Testing:
 - Ran test_sfs.py locally with recent GBN

Change-Id: I426aacdba7afba3f3a747a4e02632d15e38c63c9
Reviewed-on: http://gerrit.cloudera.org:8080/18618
Reviewed-by: Csaba Ringhofer <cs...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> CDP_BUILD_NUMBER 27992803 failing because of new Hive behaviour
> ---------------------------------------------------------------
>
>                 Key: IMPALA-11356
>                 URL: https://issues.apache.org/jira/browse/IMPALA-11356
>             Project: IMPALA
>          Issue Type: Sub-task
>          Components: Infrastructure
>    Affects Versions: Impala 4.1.0
>            Reporter: Tamas Mate
>            Assignee: Tamas Mate
>            Priority: Major
>              Labels: iceberg, impala-iceberg
>
> HIVE-24920 results in the change in HMS' behavior. Specifically, after this Hive commit, creation of an external table under the managed directory will be allowed if the HMS configuration of 'hive.metastore.warehouse.external.dir' is not explicitly set, i.e., isExternalWarehouseSet() evaluates to false.
> test_sfs is failing with:
> {code:none}
> query_test/test_sfs.py:52: in test_sfs
>     self.run_test_case('QueryTest/sfs', vector, unique_database)
> common/impala_test_suite.py:741: in run_test_case
>     expected_str, query)
> E   AssertionError: Expected exception: An external table's location should not be located within managed warehouse root directory
> E   
> E   when running:
> E   
> E   CREATE EXTERNAL TABLE test_tbl_03 (s STRING, i INT) STORED AS PARQUET
> E   LOCATION 'sfs+hdfs://localhost:20500/test-warehouse/managed/test_sfs_833dc94f.db/sfs_d3.parq/#SINGLEFILE#' 
> {code}



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org