You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@impala.apache.org by "Csaba Ringhofer (Code Review)" <ge...@cloudera.org> on 2020/03/31 17:35:53 UTC

[Impala-ASF-CR] IMPALA-9584: remove flaky avg(TIMESTAMP) aggregates from test analytic fns

Csaba Ringhofer has uploaded this change for review. ( http://gerrit.cloudera.org:8080/15621


Change subject: IMPALA-9584: remove flaky avg(TIMESTAMP) aggregates from test_analytic_fns
......................................................................

IMPALA-9584: remove flaky avg(TIMESTAMP) aggregates from test_analytic_fns

AVG(TIMESTAMP) is not deterministic, because it uses a double to sum
the timestamps, and adding doubles in different order can lead to
different results. This does not cause problems for DOUBLE columns,
because the test framework does not require exact match if the result
is double. As AVG is the only function for TIMESTAMP with this problem,
reducing the precision of all timestamps checks seemed like an
overkill.

As a short term solution I removed the problematic aggregates from the
tests.

Testing:
- ran only the related tests

Change-Id: I10e0027a64a4e430b7db3ed7c8d0cc8cdcb202e0
---
M testdata/workloads/functional-query/queries/QueryTest/analytic-fns.test
1 file changed, 34 insertions(+), 63 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/21/15621/1
-- 
To view, visit http://gerrit.cloudera.org:8080/15621
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I10e0027a64a4e430b7db3ed7c8d0cc8cdcb202e0
Gerrit-Change-Number: 15621
Gerrit-PatchSet: 1
Gerrit-Owner: Csaba Ringhofer <cs...@cloudera.com>

[Impala-ASF-CR] IMPALA-9584: remove flaky avg(TIMESTAMP) aggregates from test analytic fns

Posted by "Impala Public Jenkins (Code Review)" <ge...@cloudera.org>.
Impala Public Jenkins has posted comments on this change. ( http://gerrit.cloudera.org:8080/15621 )

Change subject: IMPALA-9584: remove flaky avg(TIMESTAMP) aggregates from test_analytic_fns
......................................................................


Patch Set 1:

Build started: https://jenkins.impala.io/job/gerrit-verify-dryrun/5589/ DRY_RUN=false


-- 
To view, visit http://gerrit.cloudera.org:8080/15621
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I10e0027a64a4e430b7db3ed7c8d0cc8cdcb202e0
Gerrit-Change-Number: 15621
Gerrit-PatchSet: 1
Gerrit-Owner: Csaba Ringhofer <cs...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <ta...@cloudera.com>
Gerrit-Comment-Date: Tue, 31 Mar 2020 17:41:35 +0000
Gerrit-HasComments: No

[Impala-ASF-CR] IMPALA-9584: remove flaky avg(TIMESTAMP) aggregates from test analytic fns

Posted by "Impala Public Jenkins (Code Review)" <ge...@cloudera.org>.
Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/15621 )

Change subject: IMPALA-9584: remove flaky avg(TIMESTAMP) aggregates from test_analytic_fns
......................................................................

IMPALA-9584: remove flaky avg(TIMESTAMP) aggregates from test_analytic_fns

AVG(TIMESTAMP) is not deterministic, because it uses a double to sum
the timestamps, and adding doubles in different order can lead to
different results. This does not cause problems for DOUBLE columns,
because the test framework does not require exact match if the result
is double. As AVG is the only function for TIMESTAMP with this problem,
reducing the precision of all timestamps checks seemed like an
overkill.

As a short term solution I removed the problematic aggregates from the
tests.

Testing:
- ran only the related tests

Change-Id: I10e0027a64a4e430b7db3ed7c8d0cc8cdcb202e0
Reviewed-on: http://gerrit.cloudera.org:8080/15621
Reviewed-by: Tim Armstrong <ta...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
---
M testdata/workloads/functional-query/queries/QueryTest/analytic-fns.test
1 file changed, 34 insertions(+), 63 deletions(-)

Approvals:
  Tim Armstrong: Looks good to me, approved
  Impala Public Jenkins: Verified

-- 
To view, visit http://gerrit.cloudera.org:8080/15621
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: merged
Gerrit-Change-Id: I10e0027a64a4e430b7db3ed7c8d0cc8cdcb202e0
Gerrit-Change-Number: 15621
Gerrit-PatchSet: 2
Gerrit-Owner: Csaba Ringhofer <cs...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <ta...@cloudera.com>

[Impala-ASF-CR] IMPALA-9584: remove flaky avg(TIMESTAMP) aggregates from test analytic fns

Posted by "Tim Armstrong (Code Review)" <ge...@cloudera.org>.
Tim Armstrong has posted comments on this change. ( http://gerrit.cloudera.org:8080/15621 )

Change subject: IMPALA-9584: remove flaky avg(TIMESTAMP) aggregates from test_analytic_fns
......................................................................


Patch Set 1: Code-Review+2


-- 
To view, visit http://gerrit.cloudera.org:8080/15621
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I10e0027a64a4e430b7db3ed7c8d0cc8cdcb202e0
Gerrit-Change-Number: 15621
Gerrit-PatchSet: 1
Gerrit-Owner: Csaba Ringhofer <cs...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <ta...@cloudera.com>
Gerrit-Comment-Date: Tue, 31 Mar 2020 17:37:13 +0000
Gerrit-HasComments: No

[Impala-ASF-CR] IMPALA-9584: remove flaky avg(TIMESTAMP) aggregates from test analytic fns

Posted by "Impala Public Jenkins (Code Review)" <ge...@cloudera.org>.
Impala Public Jenkins has posted comments on this change. ( http://gerrit.cloudera.org:8080/15621 )

Change subject: IMPALA-9584: remove flaky avg(TIMESTAMP) aggregates from test_analytic_fns
......................................................................


Patch Set 1:

Build Successful 

https://jenkins.impala.io/job/gerrit-code-review-checks/5661/ : Initial code review checks passed. Use gerrit-verify-dryrun-external or gerrit-verify-dryrun to run full precommit tests.


-- 
To view, visit http://gerrit.cloudera.org:8080/15621
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I10e0027a64a4e430b7db3ed7c8d0cc8cdcb202e0
Gerrit-Change-Number: 15621
Gerrit-PatchSet: 1
Gerrit-Owner: Csaba Ringhofer <cs...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <ta...@cloudera.com>
Gerrit-Comment-Date: Tue, 31 Mar 2020 18:17:12 +0000
Gerrit-HasComments: No

[Impala-ASF-CR] IMPALA-9584: remove flaky avg(TIMESTAMP) aggregates from test analytic fns

Posted by "Impala Public Jenkins (Code Review)" <ge...@cloudera.org>.
Impala Public Jenkins has posted comments on this change. ( http://gerrit.cloudera.org:8080/15621 )

Change subject: IMPALA-9584: remove flaky avg(TIMESTAMP) aggregates from test_analytic_fns
......................................................................


Patch Set 1: Verified+1


-- 
To view, visit http://gerrit.cloudera.org:8080/15621
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I10e0027a64a4e430b7db3ed7c8d0cc8cdcb202e0
Gerrit-Change-Number: 15621
Gerrit-PatchSet: 1
Gerrit-Owner: Csaba Ringhofer <cs...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <ta...@cloudera.com>
Gerrit-Comment-Date: Tue, 31 Mar 2020 22:56:59 +0000
Gerrit-HasComments: No