You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2023/03/02 22:30:00 UTC

[jira] [Commented] (IMPALA-11633) Create table as select (CTAS) tests occasionally timeout for S3, Ozone

    [ https://issues.apache.org/jira/browse/IMPALA-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17695916#comment-17695916 ] 

ASF subversion and git services commented on IMPALA-11633:
----------------------------------------------------------

Commit 6ebf35cd5d9d8762147b73bd99b53fd2ffc426d3 in impala's branch refs/heads/master from Michael Smith
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=6ebf35cd5 ]

IMPALA-11633: Use longer ctas timeout for S3/Ozone

File reads can be slower with S3 and Ozone in minicluster because
they're not using shortcircuiting to directly access the file on disk.
Allow more time for CTAS operations to complete when using a non-HDFS
filesystem.

Change-Id: I7a49cd44fc0fdc238313b92341467818a8f37fd1
Reviewed-on: http://gerrit.cloudera.org:8080/19497
Reviewed-by: Andrew Sherman <as...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> Create table as select (CTAS) tests occasionally timeout for S3, Ozone
> ----------------------------------------------------------------------
>
>                 Key: IMPALA-11633
>                 URL: https://issues.apache.org/jira/browse/IMPALA-11633
>             Project: IMPALA
>          Issue Type: Bug
>            Reporter: Kurt Deschler
>            Assignee: Michael Smith
>            Priority: Major
>             Fix For: Impala 4.3.0
>
>
> Several instances of this have been observed:
> * metadata.test_ddl.TestAsyncDDL.test_get_operation_status_for_async_ddl, where {{create table test_get_operation_status_for_async_ddl_f3067b3f.alltypes_clone as select * from functional_parquet.alltypes;}} takes more than the allowed 3 seconds
> * metadata/test_ddl.TestAsyncDDL.test_ctas times out in {{wait_for_state}} (20 seconds)
> * metadata.test_load.TestAsyncLoadData.test_async_load times out in {{wait_for_state}} (10 seconds)
> Need to check whether there are specific problems, or S3 and Ozone are sufficiently slower that the doubled timing for HDFS is insufficient to allow for environmental load.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org