[jira] [Commented] (IMPALA-11572) TestHdfsScannerSkew.test_mt_dop_skew_lpt is flaky

["ASF subversion and git services (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17606767#comment-17606767 ] 

ASF subversion and git services commented on IMPALA-11572:
----------------------------------------------------------

Commit 190b5e41b1e9d24a91432cc470c91e6fff84a041 in impala's branch refs/heads/master from Zoltan Borok-Nagy
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=190b5e41b ]

IMPALA-11572: deflake test_mt_dop_skew_lpt

test_mt_dop_skew_lpt was flaky. Also, it calculated the
min(bytes_read) / max(bytes_read) globally across all fragment
insteances, not just among the intra-node fragment instances.

To deflake the test, this test:
 * calculate intra-node min(bytes_read) / max(bytes_read) ratios
   instead of global ones
 * print out the ratios so we'll know the numbers when the test fails
 * eliminate compression codec test dimension which is not used anyway

Change-Id: I823542c21fe8f10f43a501fe4175da883eaf2f99
Reviewed-on: http://gerrit.cloudera.org:8080/18970
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> TestHdfsScannerSkew.test_mt_dop_skew_lpt is flaky
> -------------------------------------------------
>
>                 Key: IMPALA-11572
>                 URL: https://issues.apache.org/jira/browse/IMPALA-11572
>             Project: IMPALA
>          Issue Type: Bug
>            Reporter: Zoltán Borók-Nagy
>            Assignee: Zoltán Borók-Nagy
>            Priority: Major
>              Labels: broken-build
>
> The test can fail with:
> {noformat}
> query_test/test_scanners.py:428: in test_mt_dop_skew_lpt
>     assert cnt_fail < 3
> E   assert 3 < 3
> {noformat}
> We need to fine-tune the test to deflake it.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org