You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@impala.apache.org by "Bikramjeet Vig (Code Review)" <ge...@cloudera.org> on 2018/08/08 18:25:44 UTC

[Impala-ASF-CR] IMPALA-7361: Fix flakiness in test heterogeneous proc mem limit

Bikramjeet Vig has uploaded this change for review. ( http://gerrit.cloudera.org:8080/11166


Change subject: IMPALA-7361: Fix flakiness in test_heterogeneous_proc_mem_limit
......................................................................

IMPALA-7361: Fix flakiness in test_heterogeneous_proc_mem_limit

This patch fixes flakiness in test_heterogeneous_proc_mem_limit wherein
one of the fragments on a host from a previous query lingers and holds
on to resources which causes the next query to fail the test since it
expects the cluster to be idle at that point.

Change-Id: I3e5c9b0c6a99d7157640c02e6b3c808b4ae9e73c
---
M tests/custom_cluster/test_admission_controller.py
1 file changed, 3 insertions(+), 0 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/66/11166/1
-- 
To view, visit http://gerrit.cloudera.org:8080/11166
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I3e5c9b0c6a99d7157640c02e6b3c808b4ae9e73c
Gerrit-Change-Number: 11166
Gerrit-PatchSet: 1
Gerrit-Owner: Bikramjeet Vig <bi...@cloudera.com>

[Impala-ASF-CR] IMPALA-7361: Fix flakiness in test heterogeneous proc mem limit

Posted by "Bikramjeet Vig (Code Review)" <ge...@cloudera.org>.
Bikramjeet Vig has posted comments on this change. ( http://gerrit.cloudera.org:8080/11166 )

Change subject: IMPALA-7361: Fix flakiness in test_heterogeneous_proc_mem_limit
......................................................................


Patch Set 1:

(1 comment)

http://gerrit.cloudera.org:8080/#/c/11166/1/tests/custom_cluster/test_admission_controller.py
File tests/custom_cluster/test_admission_controller.py:

http://gerrit.cloudera.org:8080/#/c/11166/1/tests/custom_cluster/test_admission_controller.py@504
PS1, Line 504:       for impalad in self.cluster.impalads:
> I kind of wonder if this should be a helper function, I think we've used th
yup, I used it in my query cancellation tests. including this, its used only at 2 places. If this becomes a common occurrence, we can definitely create a helper function



-- 
To view, visit http://gerrit.cloudera.org:8080/11166
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I3e5c9b0c6a99d7157640c02e6b3c808b4ae9e73c
Gerrit-Change-Number: 11166
Gerrit-PatchSet: 1
Gerrit-Owner: Bikramjeet Vig <bi...@cloudera.com>
Gerrit-Reviewer: Bikramjeet Vig <bi...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <ta...@cloudera.com>
Gerrit-Comment-Date: Wed, 08 Aug 2018 19:09:55 +0000
Gerrit-HasComments: Yes

[Impala-ASF-CR] IMPALA-7361: Fix flakiness in test heterogeneous proc mem limit

Posted by "Tim Armstrong (Code Review)" <ge...@cloudera.org>.
Tim Armstrong has posted comments on this change. ( http://gerrit.cloudera.org:8080/11166 )

Change subject: IMPALA-7361: Fix flakiness in test_heterogeneous_proc_mem_limit
......................................................................


Patch Set 1:

(1 comment)

http://gerrit.cloudera.org:8080/#/c/11166/1/tests/custom_cluster/test_admission_controller.py
File tests/custom_cluster/test_admission_controller.py:

http://gerrit.cloudera.org:8080/#/c/11166/1/tests/custom_cluster/test_admission_controller.py@504
PS1, Line 504:       for impalad in self.cluster.impalads:
I kind of wonder if this should be a helper function, I think we've used this elsewhere too. Not a big deal since its two lines but worth thinking about



-- 
To view, visit http://gerrit.cloudera.org:8080/11166
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I3e5c9b0c6a99d7157640c02e6b3c808b4ae9e73c
Gerrit-Change-Number: 11166
Gerrit-PatchSet: 1
Gerrit-Owner: Bikramjeet Vig <bi...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <ta...@cloudera.com>
Gerrit-Comment-Date: Wed, 08 Aug 2018 18:52:38 +0000
Gerrit-HasComments: Yes

[Impala-ASF-CR] IMPALA-7361: Fix flakiness in test heterogeneous proc mem limit

Posted by "Impala Public Jenkins (Code Review)" <ge...@cloudera.org>.
Impala Public Jenkins has posted comments on this change. ( http://gerrit.cloudera.org:8080/11166 )

Change subject: IMPALA-7361: Fix flakiness in test_heterogeneous_proc_mem_limit
......................................................................


Patch Set 2: Code-Review+2


-- 
To view, visit http://gerrit.cloudera.org:8080/11166
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I3e5c9b0c6a99d7157640c02e6b3c808b4ae9e73c
Gerrit-Change-Number: 11166
Gerrit-PatchSet: 2
Gerrit-Owner: Bikramjeet Vig <bi...@cloudera.com>
Gerrit-Reviewer: Bikramjeet Vig <bi...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <ta...@cloudera.com>
Gerrit-Comment-Date: Wed, 08 Aug 2018 23:50:49 +0000
Gerrit-HasComments: No

[Impala-ASF-CR] IMPALA-7361: Fix flakiness in test heterogeneous proc mem limit

Posted by "Impala Public Jenkins (Code Review)" <ge...@cloudera.org>.
Impala Public Jenkins has posted comments on this change. ( http://gerrit.cloudera.org:8080/11166 )

Change subject: IMPALA-7361: Fix flakiness in test_heterogeneous_proc_mem_limit
......................................................................


Patch Set 2:

Build started: https://jenkins.impala.io/job/gerrit-verify-dryrun/2962/ DRY_RUN=false


-- 
To view, visit http://gerrit.cloudera.org:8080/11166
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I3e5c9b0c6a99d7157640c02e6b3c808b4ae9e73c
Gerrit-Change-Number: 11166
Gerrit-PatchSet: 2
Gerrit-Owner: Bikramjeet Vig <bi...@cloudera.com>
Gerrit-Reviewer: Bikramjeet Vig <bi...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <ta...@cloudera.com>
Gerrit-Comment-Date: Wed, 08 Aug 2018 23:50:50 +0000
Gerrit-HasComments: No

[Impala-ASF-CR] IMPALA-7361: Fix flakiness in test heterogeneous proc mem limit

Posted by "Impala Public Jenkins (Code Review)" <ge...@cloudera.org>.
Impala Public Jenkins has posted comments on this change. ( http://gerrit.cloudera.org:8080/11166 )

Change subject: IMPALA-7361: Fix flakiness in test_heterogeneous_proc_mem_limit
......................................................................


Patch Set 1: Verified-1

Build failed: https://jenkins.impala.io/job/gerrit-verify-dryrun/2955/


-- 
To view, visit http://gerrit.cloudera.org:8080/11166
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I3e5c9b0c6a99d7157640c02e6b3c808b4ae9e73c
Gerrit-Change-Number: 11166
Gerrit-PatchSet: 1
Gerrit-Owner: Bikramjeet Vig <bi...@cloudera.com>
Gerrit-Reviewer: Bikramjeet Vig <bi...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <ta...@cloudera.com>
Gerrit-Comment-Date: Wed, 08 Aug 2018 22:23:52 +0000
Gerrit-HasComments: No

[Impala-ASF-CR] IMPALA-7361: Fix flakiness in test heterogeneous proc mem limit

Posted by "Impala Public Jenkins (Code Review)" <ge...@cloudera.org>.
Impala Public Jenkins has posted comments on this change. ( http://gerrit.cloudera.org:8080/11166 )

Change subject: IMPALA-7361: Fix flakiness in test_heterogeneous_proc_mem_limit
......................................................................


Patch Set 1:

Build started: https://jenkins.impala.io/job/gerrit-verify-dryrun/2955/ DRY_RUN=false


-- 
To view, visit http://gerrit.cloudera.org:8080/11166
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I3e5c9b0c6a99d7157640c02e6b3c808b4ae9e73c
Gerrit-Change-Number: 11166
Gerrit-PatchSet: 1
Gerrit-Owner: Bikramjeet Vig <bi...@cloudera.com>
Gerrit-Reviewer: Bikramjeet Vig <bi...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <ta...@cloudera.com>
Gerrit-Comment-Date: Wed, 08 Aug 2018 19:10:42 +0000
Gerrit-HasComments: No

[Impala-ASF-CR] IMPALA-7361: Fix flakiness in test heterogeneous proc mem limit

Posted by "Bikramjeet Vig (Code Review)" <ge...@cloudera.org>.
Bikramjeet Vig has posted comments on this change. ( http://gerrit.cloudera.org:8080/11166 )

Change subject: IMPALA-7361: Fix flakiness in test_heterogeneous_proc_mem_limit
......................................................................


Patch Set 1: Code-Review+2

GVO failed due to unrelated flaky test. Filed a jira for that IMPALA-7415


-- 
To view, visit http://gerrit.cloudera.org:8080/11166
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I3e5c9b0c6a99d7157640c02e6b3c808b4ae9e73c
Gerrit-Change-Number: 11166
Gerrit-PatchSet: 1
Gerrit-Owner: Bikramjeet Vig <bi...@cloudera.com>
Gerrit-Reviewer: Bikramjeet Vig <bi...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <ta...@cloudera.com>
Gerrit-Comment-Date: Wed, 08 Aug 2018 23:50:15 +0000
Gerrit-HasComments: No

[Impala-ASF-CR] IMPALA-7361: Fix flakiness in test heterogeneous proc mem limit

Posted by "Impala Public Jenkins (Code Review)" <ge...@cloudera.org>.
Impala Public Jenkins has posted comments on this change. ( http://gerrit.cloudera.org:8080/11166 )

Change subject: IMPALA-7361: Fix flakiness in test_heterogeneous_proc_mem_limit
......................................................................


Patch Set 2: Verified+1


-- 
To view, visit http://gerrit.cloudera.org:8080/11166
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I3e5c9b0c6a99d7157640c02e6b3c808b4ae9e73c
Gerrit-Change-Number: 11166
Gerrit-PatchSet: 2
Gerrit-Owner: Bikramjeet Vig <bi...@cloudera.com>
Gerrit-Reviewer: Bikramjeet Vig <bi...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <ta...@cloudera.com>
Gerrit-Comment-Date: Thu, 09 Aug 2018 03:04:33 +0000
Gerrit-HasComments: No

[Impala-ASF-CR] IMPALA-7361: Fix flakiness in test heterogeneous proc mem limit

Posted by "Impala Public Jenkins (Code Review)" <ge...@cloudera.org>.
Impala Public Jenkins has posted comments on this change. ( http://gerrit.cloudera.org:8080/11166 )

Change subject: IMPALA-7361: Fix flakiness in test_heterogeneous_proc_mem_limit
......................................................................


Patch Set 1:

Build Successful 

https://jenkins.impala.io/job/gerrit-code-review-checks/249/ : Initial code review checks passed. Use gerrit-verify-dryrun-external or gerrit-verify-dryrun to run full precommit tests.


-- 
To view, visit http://gerrit.cloudera.org:8080/11166
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I3e5c9b0c6a99d7157640c02e6b3c808b4ae9e73c
Gerrit-Change-Number: 11166
Gerrit-PatchSet: 1
Gerrit-Owner: Bikramjeet Vig <bi...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <ta...@cloudera.com>
Gerrit-Comment-Date: Wed, 08 Aug 2018 18:51:59 +0000
Gerrit-HasComments: No

[Impala-ASF-CR] IMPALA-7361: Fix flakiness in test heterogeneous proc mem limit

Posted by "Tim Armstrong (Code Review)" <ge...@cloudera.org>.
Tim Armstrong has posted comments on this change. ( http://gerrit.cloudera.org:8080/11166 )

Change subject: IMPALA-7361: Fix flakiness in test_heterogeneous_proc_mem_limit
......................................................................


Patch Set 1: Code-Review+2


-- 
To view, visit http://gerrit.cloudera.org:8080/11166
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I3e5c9b0c6a99d7157640c02e6b3c808b4ae9e73c
Gerrit-Change-Number: 11166
Gerrit-PatchSet: 1
Gerrit-Owner: Bikramjeet Vig <bi...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <ta...@cloudera.com>
Gerrit-Comment-Date: Wed, 08 Aug 2018 18:51:43 +0000
Gerrit-HasComments: No

[Impala-ASF-CR] IMPALA-7361: Fix flakiness in test heterogeneous proc mem limit

Posted by "Impala Public Jenkins (Code Review)" <ge...@cloudera.org>.
Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/11166 )

Change subject: IMPALA-7361: Fix flakiness in test_heterogeneous_proc_mem_limit
......................................................................

IMPALA-7361: Fix flakiness in test_heterogeneous_proc_mem_limit

This patch fixes flakiness in test_heterogeneous_proc_mem_limit wherein
one of the fragments on a host from a previous query lingers and holds
on to resources which causes the next query to fail the test since it
expects the cluster to be idle at that point.

Change-Id: I3e5c9b0c6a99d7157640c02e6b3c808b4ae9e73c
Reviewed-on: http://gerrit.cloudera.org:8080/11166
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
---
M tests/custom_cluster/test_admission_controller.py
1 file changed, 3 insertions(+), 0 deletions(-)

Approvals:
  Impala Public Jenkins: Looks good to me, approved; Verified

-- 
To view, visit http://gerrit.cloudera.org:8080/11166
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: merged
Gerrit-Change-Id: I3e5c9b0c6a99d7157640c02e6b3c808b4ae9e73c
Gerrit-Change-Number: 11166
Gerrit-PatchSet: 3
Gerrit-Owner: Bikramjeet Vig <bi...@cloudera.com>
Gerrit-Reviewer: Bikramjeet Vig <bi...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <ta...@cloudera.com>