You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Alexander Behm (JIRA)" <ji...@apache.org> on 2018/01/18 02:06:00 UTC
[jira] [Resolved] (IMPALA-6402) PlannerTest.testFkPkJoinDetection
failure due to missing partition
[ https://issues.apache.org/jira/browse/IMPALA-6402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alexander Behm resolved IMPALA-6402.
------------------------------------
Resolution: Cannot Reproduce
> PlannerTest.testFkPkJoinDetection failure due to missing partition
> ------------------------------------------------------------------
>
> Key: IMPALA-6402
> URL: https://issues.apache.org/jira/browse/IMPALA-6402
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 2.11.0
> Environment: PlannerTest.testFkPkJoinDetection
> Reporter: Sailesh Mukil
> Assignee: Alexander Behm
> Priority: Blocker
> Labels: broken-build
>
>
> PlannerTest.testFkPkJoinDetection failed recent test run. From the output below, it looks like the test expects 1823 partitions and files to be present, however, there is one extra file erroneously present. This may be due to filesystem flakiness (a file that was supposed to be deleted wasn't, etc.), but we're not certain yet.
>
> {code:java}
> -------------------------------------------------------------------------------
> Test set: org.apache.impala.planner.PlannerTest
> -------------------------------------------------------------------------------
> Tests run: 64, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 62.354 sec <<< FAILURE! - in org.apache.impala.planner.PlannerTest
> testFkPkJoinDetection(org.apache.impala.planner.PlannerTest) Time elapsed: 4.821 sec <<< FAILURE!
> java.lang.AssertionError:
> Section PLAN of query:
> select /* +straight_join */ 1 from
> tpcds_seq_snap.store_sales inner join tpcds.customer
> on ss_customer_sk = c_customer_sk
> Actual does not match expected result:
> F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
> | Per-Host Resources: mem-estimate=177.94MB mem-reservation=1.94MB
> PLAN-ROOT SINK
> | mem-estimate=0B mem-reservation=0B
> |
> 02:HASH JOIN [INNER JOIN]
> | hash predicates: ss_customer_sk = c_customer_sk
> | fk/pk conjuncts: assumed fk/pk
> | runtime filters: RF000[bloom] <- c_customer_sk
> | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB
> | tuple-ids=0,1 row-size=8B cardinality=unavailable
> |
> |--01:SCAN HDFS [tpcds.customer]
> | partitions=1/1 files=1 size=12.60MB
> | stored statistics:
> | table: rows=100000 size=12.60MB
> | columns: all
> | extrapolated-rows=disabled
> | mem-estimate=48.00MB mem-reservation=0B
> | tuple-ids=1 row-size=4B cardinality=100000
> |
> 00:SCAN HDFS [tpcds_seq_snap.store_sales]
> partitions=1823/1823 files=1823 size=207.90MB
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> runtime filters: RF000[bloom] -> ss_customer_sk
> stored statistics:
> table: rows=unavailable size=unavailable
> partitions: 0/1823 rows=unavailable
> columns: unavailable
> extrapolated-rows=disabled
> mem-estimate=128.00MB mem-reservation=0B
> tuple-ids=0 row-size=4B cardinality=unavailable
> Expected:
> F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
> | Per-Host Resources: mem-estimate=177.94MB mem-reservation=1.94MB
> PLAN-ROOT SINK
> | mem-estimate=0B mem-reservation=0B
> |
> 02:HASH JOIN [INNER JOIN]
> | hash predicates: ss_customer_sk = c_customer_sk
> | fk/pk conjuncts: assumed fk/pk
> | runtime filters: RF000[bloom] <- c_customer_sk
> | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB
> | tuple-ids=0,1 row-size=8B cardinality=unavailable
> |
> |--01:SCAN HDFS [tpcds.customer]
> | partitions=1/1 files=1 size=12.60MB
> | stored statistics:
> | table: rows=100000 size=12.60MB
> | columns: all
> | extrapolated-rows=disabled
> | mem-estimate=48.00MB mem-reservation=0B
> | tuple-ids=1 row-size=4B cardinality=100000
> |
> 00:SCAN HDFS [tpcds_seq_snap.store_sales]
> partitions=1824/1824 files=1824 size=207.90MB
> runtime filters: RF000[bloom] -> ss_customer_sk
> stored statistics:
> table: rows=unavailable size=unavailable
> partitions: 0/1824 rows=unavailable
> columns: unavailable
> extrapolated-rows=disabled
> mem-estimate=128.00MB mem-reservation=0B
> tuple-ids=0 row-size=4B cardinality=unavailable
> Verbose plan:
> F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
> Per-Host Resources: mem-estimate=177.94MB mem-reservation=1.94MB
> PLAN-ROOT SINK
> | mem-estimate=0B mem-reservation=0B
> |
> 02:HASH JOIN [INNER JOIN]
> | hash predicates: ss_customer_sk = c_customer_sk
> | fk/pk conjuncts: assumed fk/pk
> | runtime filters: RF000[bloom] <- c_customer_sk
> | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB
> | tuple-ids=0,1 row-size=8B cardinality=unavailable
> |
> |--01:SCAN HDFS [tpcds.customer]
> | partitions=1/1 files=1 size=12.60MB
> | stored statistics:
> | table: rows=100000 size=12.60MB
> | columns: all
> | extrapolated-rows=disabled
> | mem-estimate=48.00MB mem-reservation=0B
> | tuple-ids=1 row-size=4B cardinality=100000
> |
> 00:SCAN HDFS [tpcds_seq_snap.store_sales]
> partitions=1823/1823 files=1823 size=207.90MB
> runtime filters: RF000[bloom] -> ss_customer_sk
> stored statistics:
> table: rows=unavailable size=unavailable
> partitions: 0/1823 rows=unavailable
> columns: unavailable
> extrapolated-rows=disabled
> mem-estimate=128.00MB mem-reservation=0B
> tuple-ids=0 row-size=4B cardinality=unavailable
> at org.junit.Assert.fail(Assert.java:88)
> at org.apache.impala.planner.PlannerTestBase.runPlannerTestFile(PlannerTestBase.java:770)
> at org.apache.impala.planner.PlannerTestBase.runPlannerTestFile(PlannerTestBase.java:729)
> at org.apache.impala.planner.PlannerTestBase.runPlannerTestFile(PlannerTestBase.java:724)
> at org.apache.impala.planner.PlannerTest.testFkPkJoinDetection(PlannerTest.java:150)
>
> {code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)