You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Henry Robinson (JIRA)" <ji...@apache.org> on 2017/05/24 17:52:04 UTC

[jira] [Created] (IMPALA-5358) Off-by-one error in testTableSample

Henry Robinson created IMPALA-5358:
--------------------------------------

             Summary: Off-by-one error in testTableSample
                 Key: IMPALA-5358
                 URL: https://issues.apache.org/jira/browse/IMPALA-5358
             Project: IMPALA
          Issue Type: Bug
          Components: Frontend
    Affects Versions: Impala 2.9.0
            Reporter: Henry Robinson
            Assignee: Alexander Behm
            Priority: Critical


Number of partitions scanned is 12, but expected to be 13. This was in a build with legacy aggs and joins enabled, but it's not obvious if those are related.

{code}
FAILED:  org.apache.impala.planner.PlannerTest.testTableSample

Error Message:

Section PLAN of query:
select * from functional.alltypes tablesample system(50) repeatable(1234)

Actual does not match expected result:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
PLAN-ROOT SINK
|  mem-estimate=0B mem-reservation=0B
|
00:SCAN HDFS [functional.alltypes]
   partitions=13/24 files=13 size=258.44KB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
   table stats: 7300 rows total
   column stats: all
   mem-estimate=96.00MB mem-reservation=0B
   tuple-ids=0 row-size=97B cardinality=3650

Expected:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
PLAN-ROOT SINK
|  mem-estimate=0B mem-reservation=0B
|
00:SCAN HDFS [functional.alltypes]
   partitions=12/24 files=12 size=240.27KB
   table stats: 7300 rows total
   column stats: all
   mem-estimate=80.00MB mem-reservation=0B
   tuple-ids=0 row-size=97B cardinality=3650

Verbose plan:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN HDFS [functional.alltypes]
     partitions=13/24 files=13 size=258.44KB
     table stats: 7300 rows total
     column stats: all
     mem-estimate=96.00MB mem-reservation=0B
     tuple-ids=0 row-size=97B cardinality=3650

Section PLAN of query:
select * from functional.alltypes tablesample system(50) repeatable(1234)
where id < 10

Actual does not match expected result:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
PLAN-ROOT SINK
|  mem-estimate=0B mem-reservation=0B
|
00:SCAN HDFS [functional.alltypes]
   partitions=13/24 files=13 size=258.44KB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
   predicates: id < 10
   table stats: 7300 rows total
   column stats: all
   parquet dictionary predicates: id < 10
   mem-estimate=96.00MB mem-reservation=0B
   tuple-ids=0 row-size=97B cardinality=365

Expected:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
PLAN-ROOT SINK
|  mem-estimate=0B mem-reservation=0B
|
00:SCAN HDFS [functional.alltypes]
   partitions=12/24 files=12 size=239.26KB
   predicates: id < 10
   table stats: 7300 rows total
   column stats: all
   parquet dictionary predicates: id < 10
   mem-estimate=80.00MB mem-reservation=0B
   tuple-ids=0 row-size=97B cardinality=365

Verbose plan:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN HDFS [functional.alltypes]
     partitions=13/24 files=13 size=258.44KB
     predicates: id < 10
     table stats: 7300 rows total
     column stats: all
     parquet dictionary predicates: id < 10
     mem-estimate=96.00MB mem-reservation=0B
     tuple-ids=0 row-size=97B cardinality=365


Stack Trace:
java.lang.AssertionError:
Section PLAN of query:
select * from functional.alltypes tablesample system(50) repeatable(1234)

Actual does not match expected result:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
PLAN-ROOT SINK
|  mem-estimate=0B mem-reservation=0B
|
00:SCAN HDFS [functional.alltypes]
   partitions=13/24 files=13 size=258.44KB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
   table stats: 7300 rows total
   column stats: all
   mem-estimate=96.00MB mem-reservation=0B
   tuple-ids=0 row-size=97B cardinality=3650

Expected:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
PLAN-ROOT SINK
|  mem-estimate=0B mem-reservation=0B
|
00:SCAN HDFS [functional.alltypes]
   partitions=12/24 files=12 size=240.27KB
   table stats: 7300 rows total
   column stats: all
   mem-estimate=80.00MB mem-reservation=0B
   tuple-ids=0 row-size=97B cardinality=3650

Verbose plan:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN HDFS [functional.alltypes]
     partitions=13/24 files=13 size=258.44KB
     table stats: 7300 rows total
     column stats: all
     mem-estimate=96.00MB mem-reservation=0B
     tuple-ids=0 row-size=97B cardinality=3650

Section PLAN of query:
select * from functional.alltypes tablesample system(50) repeatable(1234)
where id < 10

Actual does not match expected result:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
PLAN-ROOT SINK
|  mem-estimate=0B mem-reservation=0B
|
00:SCAN HDFS [functional.alltypes]
   partitions=13/24 files=13 size=258.44KB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
   predicates: id < 10
   table stats: 7300 rows total
   column stats: all
   parquet dictionary predicates: id < 10
   mem-estimate=96.00MB mem-reservation=0B
   tuple-ids=0 row-size=97B cardinality=365

Expected:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
PLAN-ROOT SINK
|  mem-estimate=0B mem-reservation=0B
|
00:SCAN HDFS [functional.alltypes]
   partitions=12/24 files=12 size=239.26KB
   predicates: id < 10
   table stats: 7300 rows total
   column stats: all
   parquet dictionary predicates: id < 10
   mem-estimate=80.00MB mem-reservation=0B
   tuple-ids=0 row-size=97B cardinality=365

Verbose plan:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN HDFS [functional.alltypes]
     partitions=13/24 files=13 size=258.44KB
     predicates: id < 10
     table stats: 7300 rows total
     column stats: all
     parquet dictionary predicates: id < 10
     mem-estimate=96.00MB mem-reservation=0B
     tuple-ids=0 row-size=97B cardinality=365

        at org.junit.Assert.fail(Assert.java:88)
        at org.apache.impala.planner.PlannerTestBase.runPlannerTestFile(PlannerTestBase.java:759)
        at org.apache.impala.planner.PlannerTestBase.runPlannerTestFile(PlannerTestBase.java:721)
        at org.apache.impala.planner.PlannerTestBase.runPlannerTestFile(PlannerTestBase.java:716)
        at org.apache.impala.planner.PlannerTest.testTableSample(PlannerTest.java:414)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)