You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by GitBox <gi...@apache.org> on 2019/07/01 10:11:29 UTC

[GitHub] [drill] arina-ielchiieva commented on issue #1813: DRILL-7306: Disable schema-only batch for new scan framework

arina-ielchiieva commented on issue #1813: DRILL-7306: Disable schema-only batch for new scan framework
URL: https://github.com/apache/drill/pull/1813#issuecomment-507203793
 
 
   @paul-rogers re-run full tests suit for the updated branch. Previous failures have been fixed but new were added:
   ```
   /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/union02.sql
   /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join08-merge.sql
   /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/original/parquet/query4.sql
   /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join09-hash.sql
   /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join08-hash.sql
   /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/union01.sql
   /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/filter01.sql
   /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join01-hash.sql
   /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join09-merge.sql
   /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/failed04.sql
   /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/union03.sql
   ```
   Looks like queries started to return zero results:
   ```
   Data Verification Failures:
   
   Query: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/union02.sql
   SELECT C_CUSTKEY, C_NATIONKEY FROM customer C WHERE C_ACCTBAL BETWEEN 1000 AND 1200 AND C_NATIONKEY IN (1, 3)
   
   Baseline: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/union02.e_tsv
            Expected number of rows: 208
   Actual number of rows from Drill: 0
            Number of matching rows: 0
             Number of rows missing: 208
          Number of rows unexpected: 0
   
   These rows are missing (first 10):
   12282	3 (1 occurence(s))
   6151	1 (1 occurence(s))
   30727	1 (1 occurence(s))
   110087	3 (1 occurence(s))
   70662	3 (1 occurence(s))
   101382	3 (1 occurence(s))
   144393	1 (1 occurence(s))
   95255	3 (1 occurence(s))
   98331	1 (1 occurence(s))
   122904	3 (1 occurence(s))
   Query: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join08-merge.sql
   SELECT COUNT(*)
   FROM (SELECT L.L_ORDERKEY AS X, C.C_CUSTKEY AS Y
   FROM lineitem L
   LEFT OUTER JOIN customer C
   ON L.L_ORDERKEY = C.C_CUSTKEY) AS FOO
   WHERE X < 10000
   
   Baseline: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join08-merge.e_tsv
            Expected number of rows: 1
   Actual number of rows from Drill: 1
            Number of matching rows: 0
             Number of rows missing: 1
          Number of rows unexpected: 1
   
   These rows are not expected (first 10):
   0
   
   These rows are missing (first 10):
   9965 (1 occurence(s))
   Query: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/original/parquet/query4.sql
   SELECT
   O.O_ORDERPRIORITY,
   COUNT(*) AS ORDER_COUNT
   FROM
   orders O
   WHERE
   O.O_ORDERDate >= DATE '1996-10-01'
   AND O.O_ORDERDate < DATE '1996-10-01' + INTERVAL '3' MONTH
   AND
   EXISTS (
   SELECT
   *
   FROM
   lineitem L
   WHERE
   L.L_ORDERKEY = O.O_ORDERKEY
   AND L.L_COMMITDate < L.L_RECEIPTDate
   )
   GROUP BY
   O.O_ORDERPRIORITY
   ORDER BY
   O.O_ORDERPRIORITY
   
   Baseline: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/original/parquet/query4.e_tsv
            Expected number of rows: 5
   Actual number of rows from Drill: 0
            Number of matching rows: 0
             Number of rows missing: 5
          Number of rows unexpected: 0
   
   These rows are missing (first 10):
   1-URGENT	10611 (1 occurence(s))
   2-HIGH	10538 (1 occurence(s))
   3-MEDIUM	10574 (1 occurence(s))
   4-NOT SPECIFIED	10511 (1 occurence(s))
   5-LOW	10568 (1 occurence(s))
   
   Query: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join09-hash.sql
   SELECT COUNT(*)
   FROM (SELECT L.L_ORDERKEY AS X, C.C_CUSTKEY AS Y
   FROM lineitem L
   LEFT OUTER JOIN customer C
   ON L.L_ORDERKEY = C.C_CUSTKEY) AS FOO
   WHERE Y < 10000
   
   Baseline: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join09-hash.e_tsv
            Expected number of rows: 1
   Actual number of rows from Drill: 1
            Number of matching rows: 0
             Number of rows missing: 1
          Number of rows unexpected: 1
   
   These rows are not expected (first 10):
   0
   
   These rows are missing (first 10):
   9965 (1 occurence(s))
   Query: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join08-hash.sql
   SELECT COUNT(*)
   FROM (SELECT L.L_ORDERKEY AS X, C.C_CUSTKEY AS Y
   FROM lineitem L
   LEFT OUTER JOIN customer C
   ON L.L_ORDERKEY = C.C_CUSTKEY) AS FOO
   WHERE X < 10000
   
   Baseline: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join08-hash.e_tsv
            Expected number of rows: 1
   Actual number of rows from Drill: 1
            Number of matching rows: 0
             Number of rows missing: 1
          Number of rows unexpected: 1
   
   These rows are not expected (first 10):
   0
   
   These rows are missing (first 10):
   9965 (1 occurence(s))
   Query: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/union01.sql
   SELECT C_CUSTKEY, C_NATIONKEY FROM customer C WHERE C_ACCTBAL BETWEEN 1000 AND 1200 AND C_NATIONKEY IN (2, 4)
   
   Baseline: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/union01.e_tsv
            Expected number of rows: 228
   Actual number of rows from Drill: 0
            Number of matching rows: 0
             Number of rows missing: 228
          Number of rows unexpected: 0
   
   These rows are missing (first 10):
   139771	4 (1 occurence(s))
   40446	2 (1 occurence(s))
   106495	2 (1 occurence(s))
   60929	4 (1 occurence(s))
   92676	4 (1 occurence(s))
   58372	4 (1 occurence(s))
   43532	4 (1 occurence(s))
   47628	4 (1 occurence(s))
   8207	2 (1 occurence(s))
   108047	4 (1 occurence(s))
   Query: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/filter01.sql
   SELECT C_CUSTKEY, C_NATIONKEY
   FROM customer C
   WHERE C_ACCTBAL BETWEEN 1000 AND 1200
   AND C_NATIONKEY < 10
   OR C_NATIONKEY IN (20, 30)
   AND (C_CUSTKEY < 500 OR C_CUSTKEY > 1000)
   ORDER BY C_CUSTKEY, C_NATIONKEY
   
   Baseline: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/filter01.e_tsv
            Expected number of rows: 6975
   Actual number of rows from Drill: 0
            Number of matching rows: 0
             Number of rows missing: 6975
          Number of rows unexpected: 0
   
   These rows are missing (first 10):
   114665	20 (1 occurence(s))
   65517	20 (1 occurence(s))
   49136	20 (1 occurence(s))
   131069	5 (1 occurence(s))
   32754	20 (1 occurence(s))
   65528	20 (1 occurence(s))
   32765	20 (1 occurence(s))
   16383	20 (1 occurence(s))
   49152	20 (1 occurence(s))
   147457	20 (1 occurence(s))
   Query: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join01-hash.sql
   SELECT P.P_PARTKEY
   FROM part P, partsupp PS
   WHERE P.P_PARTKEY = PS.PS_PARTKEY
   AND P.P_SIZE = 41
   ORDER BY P.P_PARTKEY
   LIMIT 20
   
   Baseline: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join01-hash.e_tsv
            Expected number of rows: 20
   Actual number of rows from Drill: 0
            Number of matching rows: 0
             Number of rows missing: 20
          Number of rows unexpected: 0
   
   These rows are missing (first 10):
   114 (4 occurence(s))
   87 (4 occurence(s))
   8 (4 occurence(s))
   251 (4 occurence(s))
   108 (4 occurence(s))
   Query: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join09-merge.sql
   SELECT COUNT(*)
   FROM (SELECT L.L_ORDERKEY AS X, C.C_CUSTKEY AS Y
   FROM lineitem L
   LEFT OUTER JOIN customer C
   ON L.L_ORDERKEY = C.C_CUSTKEY) AS FOO
   WHERE Y < 10000
   
   Baseline: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join09-merge.e_tsv
            Expected number of rows: 1
   Actual number of rows from Drill: 1
            Number of matching rows: 0
             Number of rows missing: 1
          Number of rows unexpected: 1
   
   These rows are not expected (first 10):
   0
   
   These rows are missing (first 10):
   9965 (1 occurence(s))
   Query: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/failed04.sql
   SELECT PS.PS_PARTKEY, COUNT(*) FROM lineitem L, partsupp PS
   WHERE L.L_PARTKEY = PS.PS_PARTKEY AND PS.PS_PARTKEY = 30 GROUP BY PS.PS_PARTKEY
   
   Baseline: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/failed04.e_tsv
            Expected number of rows: 1
   Actual number of rows from Drill: 0
            Number of matching rows: 0
             Number of rows missing: 1
          Number of rows unexpected: 0
   
   These rows are missing (first 10):
   30	124 (1 occurence(s))
   
   Query: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/union03.sql
   SELECT C_CUSTKEY, C_NATIONKEY FROM customer C WHERE C_ACCTBAL BETWEEN 1000 AND 1200 AND C_NATIONKEY IN (2, 5)
   
   Baseline: /root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/union03.e_tsv
            Expected number of rows: 208
   Actual number of rows from Drill: 0
            Number of matching rows: 0
             Number of rows missing: 208
          Number of rows unexpected: 0
   
   These rows are missing (first 10):
   100857	5 (1 occurence(s))
   40446	2 (1 occurence(s))
   106495	2 (1 occurence(s))
   131069	5 (1 occurence(s))
   58368	5 (1 occurence(s))
   8207	2 (1 occurence(s))
   138765	5 (1 occurence(s))
   140301	5 (1 occurence(s))
   139283	5 (1 occurence(s))
   55830	2 (1 occurence(s))
   ```
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services