You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Vitalii Diravka (Jira)" <ji...@apache.org> on 2021/11/03 11:52:00 UTC
[jira] [Closed] (DRILL-8012) Flaky tests TestExtendedTypes and
TestNestedDateTimeTimestamp
[ https://issues.apache.org/jira/browse/DRILL-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vitalii Diravka closed DRILL-8012.
----------------------------------
Resolution: Won't Fix
> Flaky tests TestExtendedTypes and TestNestedDateTimeTimestamp
> -------------------------------------------------------------
>
> Key: DRILL-8012
> URL: https://issues.apache.org/jira/browse/DRILL-8012
> Project: Apache Drill
> Issue Type: Bug
> Affects Versions: 1.19.0
> Reporter: Vitalii Diravka
> Priority: Major
>
>
> {code:java}
> Sometimes these tests fail: TestNestedDateTimeTimestamp.testNestedDateTimeCTASExtendedJson:155
> TestExtendedTypes.checkReadWriteExtended:58 {code}
> {code:java}
> [ERROR] TestExtendedTypes.checkReadWriteExtended:58 expected:<...date" : "2009-02-23T[08:00:00.000Z"
> },
> "time" : {
> "$time" : "19:20:30.450Z"
> },
> "interval" : {
> "$interval" : "PT26.400S"
> },
> "integer" : {
> "$numberLong" : 4
> },
> "inner" : {
> "bin" : {
> "$binary" : "ZHJpbGw="
> },
> "drill_date" : {
> "$dateDay" : "1997-07-16"
> },
> "drill_timestamp" : {
> "$date" : "2009-02-23T08]:00:00.000Z"
> },
> ...> but was:<...date" : "2009-02-23T[10:00:00.000Z"
> },
> "time" : {
> "$time" : "19:20:30.450Z"
> },
> "interval" : {
> "$interval" : "PT26.400S"
> },
> "integer" : {
> "$numberLong" : 4
> },
> "inner" : {
> "bin" : {
> "$binary" : "ZHJpbGw="
> },
> "drill_date" : {
> "$dateDay" : "1997-07-16"
> },
> "drill_timestamp" : {
> "$date" : "2009-02-23T10]:00:00.000Z"
> },
> ...>
> [ERROR] Errors:
> [ERROR] org.apache.drill.common.exceptions.UserRemoteException: INTERNAL_ERROR ERROR: nullFragment: 0:0Please, refer to logs for more information.[Error Id: 7ea92921-6d93-4d57-8e0f-d35650e16b42 on drill:31028] (java.lang.NullPointerException) null
> org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():234
> org.apache.drill.exec.physical.impl.ScanBatch.internalNext():234
> org.apache.drill.exec.physical.impl.ScanBatch.next():298
> org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
> org.apache.drill.exec.record.AbstractRecordBatch.next():119
> org.apache.drill.exec.record.AbstractRecordBatch.next():111
> org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():59
> org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():85
> org.apache.drill.exec.record.AbstractRecordBatch.next():170
> org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
> org.apache.drill.exec.physical.impl.BaseRootExec.next():103
> org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():81
> org.apache.drill.exec.physical.impl.BaseRootExec.next():93
> org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():323
> org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():310
> java.security.AccessController.doPrivileged():-2
> javax.security.auth.Subject.doAs():422
> org.apache.hadoop.security.UserGroupInformation.doAs():1762
> org.apache.drill.exec.work.fragment.FragmentExecutor.run():310
> org.apache.drill.common.SelfCleaningRunnable.run():38
> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
> java.lang.Thread.run():748For query: select c_varchar, c_integer, c_bigint, c_float, c_double, c_date, c_time, c_timestamp, c_boolean from cp.`parquet/all_nulls.parquet`
> [ERROR] org.apache.drill.common.exceptions.UserRemoteException: INTERNAL_ERROR ERROR: nullFragment: 0:0Please, refer to logs for more information.[Error Id: 5fb379d5-ebdc-4f10-a173-79427ec8b215 on drill:31028] (java.lang.NullPointerException) null
> org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():234
> org.apache.drill.exec.physical.impl.ScanBatch.internalNext():234
> org.apache.drill.exec.physical.impl.ScanBatch.next():298
> org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
> org.apache.drill.exec.record.AbstractRecordBatch.next():119
> org.apache.drill.exec.record.AbstractRecordBatch.next():111
> org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():59
> org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():85
> org.apache.drill.exec.record.AbstractRecordBatch.next():170
> org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
> org.apache.drill.exec.physical.impl.BaseRootExec.next():103
> org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():81
> org.apache.drill.exec.physical.impl.BaseRootExec.next():93
> org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():323
> org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():310
> java.security.AccessController.doPrivileged():-2
> javax.security.auth.Subject.doAs():422
> org.apache.hadoop.security.UserGroupInformation.doAs():1762
> org.apache.drill.exec.work.fragment.FragmentExecutor.run():310
> org.apache.drill.common.SelfCleaningRunnable.run():38
> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
> java.lang.Thread.run():748[ERROR] org.apache.drill.common.exceptions.UserRemoteException: INTERNAL_ERROR ERROR: nullFragment: 0:0Please, refer to logs for more information.[Error Id: be9f80e5-e7b0-4974-9ae8-c387cf8fb80c on drill:31028] (java.lang.NullPointerException) null
> org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():234
> org.apache.drill.exec.physical.impl.ScanBatch.internalNext():234
> org.apache.drill.exec.physical.impl.ScanBatch.next():298
> org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
> org.apache.drill.exec.record.AbstractRecordBatch.next():119
> org.apache.drill.exec.record.AbstractRecordBatch.next():111
> org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():59
> org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():85
> org.apache.drill.exec.record.AbstractRecordBatch.next():170
> org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
> org.apache.drill.exec.physical.impl.BaseRootExec.next():103
> org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():81
> org.apache.drill.exec.physical.impl.BaseRootExec.next():93
> org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():323
> org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():310
> java.security.AccessController.doPrivileged():-2
> javax.security.auth.Subject.doAs():422
> org.apache.hadoop.security.UserGroupInformation.doAs():1762
> org.apache.drill.exec.work.fragment.FragmentExecutor.run():310
> org.apache.drill.common.SelfCleaningRunnable.run():38
> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
> java.lang.Thread.run():748[ERROR] org.apache.drill.common.exceptions.UserRemoteException: INTERNAL_ERROR ERROR: nullFragment: 0:0Please, refer to logs for more information.[Error Id: 04c9a620-4309-44a5-85d0-ddb092070fbd on drill:31028] (java.lang.NullPointerException) null
> org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():234
> org.apache.drill.exec.physical.impl.ScanBatch.internalNext():234
> org.apache.drill.exec.physical.impl.ScanBatch.next():298
> org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
> org.apache.drill.exec.record.AbstractRecordBatch.next():119
> org.apache.drill.exec.record.AbstractRecordBatch.next():111
> org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():59
> org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():85
> org.apache.drill.exec.record.AbstractRecordBatch.next():170
> org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
> org.apache.drill.exec.physical.impl.BaseRootExec.next():103
> org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():81
> org.apache.drill.exec.physical.impl.BaseRootExec.next():93
> org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():323
> org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():310
> java.security.AccessController.doPrivileged():-2
> javax.security.auth.Subject.doAs():422
> org.apache.hadoop.security.UserGroupInformation.doAs():1762
> org.apache.drill.exec.work.fragment.FragmentExecutor.run():310
> org.apache.drill.common.SelfCleaningRunnable.run():38
> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
> java.lang.Thread.run():748For query: select c_varchar, c_integer, c_bigint, c_float, c_double, c_date, c_time, c_timestamp, c_boolean from cp.`parquet/first_page_all_nulls.parquet`
> [ERROR] org.apache.drill.common.exceptions.UserRemoteException: INTERNAL_ERROR ERROR: nullFragment: 0:0Please, refer to logs for more information.[Error Id: 376ca206-99e1-401f-af65-cf1af0fb4681 on drill:31028] (java.lang.NullPointerException) null
> org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():234
> org.apache.drill.exec.physical.impl.ScanBatch.internalNext():234
> org.apache.drill.exec.physical.impl.ScanBatch.next():298
> org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
> org.apache.drill.exec.record.AbstractRecordBatch.next():119
> org.apache.drill.exec.record.AbstractRecordBatch.next():111
> org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():59
> org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():85
> org.apache.drill.exec.record.AbstractRecordBatch.next():170
> org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
> org.apache.drill.exec.physical.impl.BaseRootExec.next():103
> org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():81
> org.apache.drill.exec.physical.impl.BaseRootExec.next():93
> org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():323
> org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():310
> java.security.AccessController.doPrivileged():-2
> javax.security.auth.Subject.doAs():422
> org.apache.hadoop.security.UserGroupInformation.doAs():1762
> org.apache.drill.exec.work.fragment.FragmentExecutor.run():310
> org.apache.drill.common.SelfCleaningRunnable.run():38
> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
> java.lang.Thread.run():748For query: select c_varchar, c_integer, c_bigint, c_float, c_double, c_date, c_time, c_timestamp, c_boolean from cp.`parquet/last_page_one_null.parquet`
> [ERROR] TestNestedDateTimeTimestamp.testNestedDateTimeCTASExtendedJson:155 » at posit...
> [INFO]
> [ERROR] Tests run: 5982, Failures: 2, Errors: 6, Skipped: 143
> {code}
> Looks like the issue is in:
> {code:java}
> (java.lang.NullPointerException) null org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():234
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)