[jira] [Resolved] (IMPALA-11671) run-all-tests.sh with Ozone fails listing DFS files

["Michael Smith (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IMPALA-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael Smith resolved IMPALA-11671.
------------------------------------
    Fix Version/s: Impala 4.2.0
       Resolution: Fixed

> run-all-tests.sh with Ozone fails listing DFS files
> ---------------------------------------------------
>
>                 Key: IMPALA-11671
>                 URL: https://issues.apache.org/jira/browse/IMPALA-11671
>             Project: IMPALA
>          Issue Type: Bug
>    Affects Versions: Impala 4.1.0
>            Reporter: Michael Smith
>            Assignee: Michael Smith
>            Priority: Critical
>              Labels: ci-failure
>             Fix For: Impala 4.2.0
>
>
> {code}
> hdfs dfs -ls -R ${FILESYSTEM_PREFIX}/test-warehouse \
>       > ${IMPALA_LOGS_DIR}/file-list-end-${i}.log 2>&1
> {code}
> in run-all-tests.sh fails when testing with Ozone. Errors like
> {code}
> ls: Unable to get file status: volume: impala bucket: test-warehouse key: .Trash/jenkins/Current/impala/test-warehouse/test_insert_select_exprs_5162abf6.db/overflowed_decimal_tbl_2/_impala_insert_staging/c94353a630109577_202e902000000000
> ls: Unable to get file status: volume: impala bucket: test-warehouse key: .Trash/jenkins/Current/impala/test-warehouse/tpch.db/ctas_cancel/_impala_insert_staging/454c6614d6c20d17_94fac58c00000000
> ls: Unable to get file status: volume: impala bucket: test-warehouse key: .Trash/jenkins/Current/impala/test-warehouse/tpch.db/ctas_cancel1665933223846/_impala_insert_staging/7a46352d463f457e_fcabb6e000000000
> ls: Unable to get file status: volume: impala bucket: test-warehouse key: .Trash/jenkins/Current/impala/test-warehouse/tpch.db/ctas_cancel1665933261855/_impala_insert_staging/d24d1c35c2a9360c_90e32ce200000000
> {code}
> are visible in file-list-end-1.log. Current theory is that Ozone is cleaning up trash files while we list them.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)