You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Vitalii Diravka (Jira)" <ji...@apache.org> on 2021/10/18 11:27:00 UTC

[jira] [Created] (DRILL-8012) Flaky tests TestExtendedTypes and TestNestedDateTimeTimestamp

Vitalii Diravka created DRILL-8012:
--------------------------------------

             Summary: Flaky tests TestExtendedTypes and TestNestedDateTimeTimestamp
                 Key: DRILL-8012
                 URL: https://issues.apache.org/jira/browse/DRILL-8012
             Project: Apache Drill
          Issue Type: Bug
    Affects Versions: 1.19.0
            Reporter: Vitalii Diravka


 
{code:java}
Sometimes these tests fail: TestNestedDateTimeTimestamp.testNestedDateTimeCTASExtendedJson:155
TestExtendedTypes.checkReadWriteExtended:58 {code}
{code:java}
[ERROR]   TestExtendedTypes.checkReadWriteExtended:58 expected:<...date" : "2009-02-23T[08:00:00.000Z"
  },
  "time" : {
    "$time" : "19:20:30.450Z"
  },
  "interval" : {
    "$interval" : "PT26.400S"
  },
  "integer" : {
    "$numberLong" : 4
  },
  "inner" : {
    "bin" : {
      "$binary" : "ZHJpbGw="
    },
    "drill_date" : {
      "$dateDay" : "1997-07-16"
    },
    "drill_timestamp" : {
      "$date" : "2009-02-23T08]:00:00.000Z"
    },
...> but was:<...date" : "2009-02-23T[10:00:00.000Z"
  },
  "time" : {
    "$time" : "19:20:30.450Z"
  },
  "interval" : {
    "$interval" : "PT26.400S"
  },
  "integer" : {
    "$numberLong" : 4
  },
  "inner" : {
    "bin" : {
      "$binary" : "ZHJpbGw="
    },
    "drill_date" : {
      "$dateDay" : "1997-07-16"
    },
    "drill_timestamp" : {
      "$date" : "2009-02-23T10]:00:00.000Z"
    },
...>
[ERROR] Errors: 
[ERROR]   org.apache.drill.common.exceptions.UserRemoteException: INTERNAL_ERROR ERROR: nullFragment: 0:0Please, refer to logs for more information.[Error Id: 7ea92921-6d93-4d57-8e0f-d35650e16b42 on drill:31028]  (java.lang.NullPointerException) null
    org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():234
    org.apache.drill.exec.physical.impl.ScanBatch.internalNext():234
    org.apache.drill.exec.physical.impl.ScanBatch.next():298
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
    org.apache.drill.exec.record.AbstractRecordBatch.next():119
    org.apache.drill.exec.record.AbstractRecordBatch.next():111
    org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():59
    org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():85
    org.apache.drill.exec.record.AbstractRecordBatch.next():170
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
    org.apache.drill.exec.physical.impl.BaseRootExec.next():103
    org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():81
    org.apache.drill.exec.physical.impl.BaseRootExec.next():93
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():323
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():310
    java.security.AccessController.doPrivileged():-2
    javax.security.auth.Subject.doAs():422
    org.apache.hadoop.security.UserGroupInformation.doAs():1762
    org.apache.drill.exec.work.fragment.FragmentExecutor.run():310
    org.apache.drill.common.SelfCleaningRunnable.run():38
    java.util.concurrent.ThreadPoolExecutor.runWorker():1149
    java.util.concurrent.ThreadPoolExecutor$Worker.run():624
    java.lang.Thread.run():748For query: select c_varchar, c_integer, c_bigint, c_float, c_double, c_date, c_time, c_timestamp, c_boolean from cp.`parquet/all_nulls.parquet`
[ERROR]   org.apache.drill.common.exceptions.UserRemoteException: INTERNAL_ERROR ERROR: nullFragment: 0:0Please, refer to logs for more information.[Error Id: 5fb379d5-ebdc-4f10-a173-79427ec8b215 on drill:31028]  (java.lang.NullPointerException) null
    org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():234
    org.apache.drill.exec.physical.impl.ScanBatch.internalNext():234
    org.apache.drill.exec.physical.impl.ScanBatch.next():298
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
    org.apache.drill.exec.record.AbstractRecordBatch.next():119
    org.apache.drill.exec.record.AbstractRecordBatch.next():111
    org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():59
    org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():85
    org.apache.drill.exec.record.AbstractRecordBatch.next():170
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
    org.apache.drill.exec.physical.impl.BaseRootExec.next():103
    org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():81
    org.apache.drill.exec.physical.impl.BaseRootExec.next():93
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():323
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():310
    java.security.AccessController.doPrivileged():-2
    javax.security.auth.Subject.doAs():422
    org.apache.hadoop.security.UserGroupInformation.doAs():1762
    org.apache.drill.exec.work.fragment.FragmentExecutor.run():310
    org.apache.drill.common.SelfCleaningRunnable.run():38
    java.util.concurrent.ThreadPoolExecutor.runWorker():1149
    java.util.concurrent.ThreadPoolExecutor$Worker.run():624
    java.lang.Thread.run():748[ERROR]   org.apache.drill.common.exceptions.UserRemoteException: INTERNAL_ERROR ERROR: nullFragment: 0:0Please, refer to logs for more information.[Error Id: be9f80e5-e7b0-4974-9ae8-c387cf8fb80c on drill:31028]  (java.lang.NullPointerException) null
    org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():234
    org.apache.drill.exec.physical.impl.ScanBatch.internalNext():234
    org.apache.drill.exec.physical.impl.ScanBatch.next():298
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
    org.apache.drill.exec.record.AbstractRecordBatch.next():119
    org.apache.drill.exec.record.AbstractRecordBatch.next():111
    org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():59
    org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():85
    org.apache.drill.exec.record.AbstractRecordBatch.next():170
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
    org.apache.drill.exec.physical.impl.BaseRootExec.next():103
    org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():81
    org.apache.drill.exec.physical.impl.BaseRootExec.next():93
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():323
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():310
    java.security.AccessController.doPrivileged():-2
    javax.security.auth.Subject.doAs():422
    org.apache.hadoop.security.UserGroupInformation.doAs():1762
    org.apache.drill.exec.work.fragment.FragmentExecutor.run():310
    org.apache.drill.common.SelfCleaningRunnable.run():38
    java.util.concurrent.ThreadPoolExecutor.runWorker():1149
    java.util.concurrent.ThreadPoolExecutor$Worker.run():624
    java.lang.Thread.run():748[ERROR]   org.apache.drill.common.exceptions.UserRemoteException: INTERNAL_ERROR ERROR: nullFragment: 0:0Please, refer to logs for more information.[Error Id: 04c9a620-4309-44a5-85d0-ddb092070fbd on drill:31028]  (java.lang.NullPointerException) null
    org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():234
    org.apache.drill.exec.physical.impl.ScanBatch.internalNext():234
    org.apache.drill.exec.physical.impl.ScanBatch.next():298
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
    org.apache.drill.exec.record.AbstractRecordBatch.next():119
    org.apache.drill.exec.record.AbstractRecordBatch.next():111
    org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():59
    org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():85
    org.apache.drill.exec.record.AbstractRecordBatch.next():170
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
    org.apache.drill.exec.physical.impl.BaseRootExec.next():103
    org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():81
    org.apache.drill.exec.physical.impl.BaseRootExec.next():93
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():323
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():310
    java.security.AccessController.doPrivileged():-2
    javax.security.auth.Subject.doAs():422
    org.apache.hadoop.security.UserGroupInformation.doAs():1762
    org.apache.drill.exec.work.fragment.FragmentExecutor.run():310
    org.apache.drill.common.SelfCleaningRunnable.run():38
    java.util.concurrent.ThreadPoolExecutor.runWorker():1149
    java.util.concurrent.ThreadPoolExecutor$Worker.run():624
    java.lang.Thread.run():748For query: select c_varchar, c_integer, c_bigint, c_float, c_double, c_date, c_time, c_timestamp, c_boolean from cp.`parquet/first_page_all_nulls.parquet`
[ERROR]   org.apache.drill.common.exceptions.UserRemoteException: INTERNAL_ERROR ERROR: nullFragment: 0:0Please, refer to logs for more information.[Error Id: 376ca206-99e1-401f-af65-cf1af0fb4681 on drill:31028]  (java.lang.NullPointerException) null
    org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():234
    org.apache.drill.exec.physical.impl.ScanBatch.internalNext():234
    org.apache.drill.exec.physical.impl.ScanBatch.next():298
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
    org.apache.drill.exec.record.AbstractRecordBatch.next():119
    org.apache.drill.exec.record.AbstractRecordBatch.next():111
    org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():59
    org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():85
    org.apache.drill.exec.record.AbstractRecordBatch.next():170
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
    org.apache.drill.exec.physical.impl.BaseRootExec.next():103
    org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():81
    org.apache.drill.exec.physical.impl.BaseRootExec.next():93
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():323
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():310
    java.security.AccessController.doPrivileged():-2
    javax.security.auth.Subject.doAs():422
    org.apache.hadoop.security.UserGroupInformation.doAs():1762
    org.apache.drill.exec.work.fragment.FragmentExecutor.run():310
    org.apache.drill.common.SelfCleaningRunnable.run():38
    java.util.concurrent.ThreadPoolExecutor.runWorker():1149
    java.util.concurrent.ThreadPoolExecutor$Worker.run():624
    java.lang.Thread.run():748For query: select c_varchar, c_integer, c_bigint, c_float, c_double, c_date, c_time, c_timestamp, c_boolean from cp.`parquet/last_page_one_null.parquet`
[ERROR]   TestNestedDateTimeTimestamp.testNestedDateTimeCTASExtendedJson:155 »  at posit...
[INFO] 
[ERROR] Tests run: 5982, Failures: 2, Errors: 6, Skipped: 143
{code}
Looks like the issue is in:
{code:java}
(java.lang.NullPointerException) null  org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():234
{code}
 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)