You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Jardhel Cachola (JIRA)" <ji...@apache.org> on 2019/03/01 11:41:00 UTC

[jira] [Updated] (DRILL-7067) Querying parquet file with null value field error

     [ https://issues.apache.org/jira/browse/DRILL-7067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jardhel Cachola updated DRILL-7067:
-----------------------------------
    Description: 
When we try to join two parquet tables and one of them has null values on any field, the query doesn't run. It fails showing the following error: 

Error: SYSTEM ERROR: IllegalStateException: Failure while reading vector. Expected vector class of org.apache.drill.exec.vector.NullableIntVector but was holding vector class org.apache.drill.exec.vector.NullableVarDecimalVector, field= [`id_hubbles` (VARDECIMAL(38, 4):OPTIONAL), children=([`$bits$` (UINT1:REQUIRED)], [`id_cub` (VARDECIMAL(38, 4):OPTIONAL), children=([`$offsets$` (UINT4:REQUIRED)])])]

Fragment 2:0

Please, refer to logs for more information.

[Error Id: 48f63255-c771-4809-8252-ef7a78fda31b on ################]

(java.lang.IllegalStateException) Failure while reading vector. Expected vector class of org.apache.drill.exec.vector.NullableIntVector but was holding vector class org.apache.drill.exec.vector.NullableVarDecimalVector, field= [`id_hubbles` (VARDECIMAL(38, 4):OPTIONAL), children=([`$bits$` (UINT1:REQUIRED)], [`id_cub` (VARDECIMAL(38, 4):OPTIONAL), children=([`$offsets$` (UINT4:REQUIRED)])])] 
 org.apache.drill.exec.record.VectorContainer.getValueAccessorById():324
 org.apache.drill.exec.record.RecordBatchLoader.getValueAccessorById():251
 org.apache.drill.exec.physical.impl.unorderedreceiver.UnorderedReceiverBatch.getValueAccessorById():142
 org.apache.drill.exec.test.generated.PartitionerGen1732$OutgoingRecordBatch.doSetup():114
 org.apache.drill.exec.test.generated.PartitionerGen1732$OutgoingRecordBatch.initializeBatch():399
 org.apache.drill.exec.test.generated.PartitionerGen1732.flushOutgoingBatches():185
 org.apache.drill.exec.physical.impl.partitionsender.PartitionerDecorator$FlushBatchesHandlingClass.execute():285
 org.apache.drill.exec.physical.impl.partitionsender.PartitionerDecorator$PartitionerTask.run():340
 java.util.concurrent.ThreadPoolExecutor.runWorker():1149
 java.util.concurrent.ThreadPoolExecutor$Worker.run():624
 java.lang.Thread.run():748 (state=,code=0)

  was:
When we try to join two parquet tables and one of them has null values on any field, the query doesn't run. It fails showing the following error: 

Error: SYSTEM ERROR: IllegalStateException: Failure while reading vector. Expected vector class of org.apache.drill.exec.vector.NullableIntVector but was holding vector class org.apache.drill.exec.vector.NullableVarDecimalVector, field= [`id_cub` (VARDECIMAL(38, 4):OPTIONAL), children=([`$bits$` (UINT1:REQUIRED)], [`id_cub` (VARDECIMAL(38, 4):OPTIONAL), children=([`$offsets$` (UINT4:REQUIRED)])])]

Fragment 2:0

Please, refer to logs for more information.

[Error Id: 48f63255-c771-4809-8252-ef7a78fda31b on ip-172-18-250-4.us-west-2.compute.internal:31010]

(java.lang.IllegalStateException) Failure while reading vector. Expected vector class of org.apache.drill.exec.vector.NullableIntVector but was holding vector class org.apache.drill.exec.vector.NullableVarDecimalVector, field= [`id_cub` (VARDECIMAL(38, 4):OPTIONAL), children=([`$bits$` (UINT1:REQUIRED)], [`id_cub` (VARDECIMAL(38, 4):OPTIONAL), children=([`$offsets$` (UINT4:REQUIRED)])])] 
 org.apache.drill.exec.record.VectorContainer.getValueAccessorById():324
 org.apache.drill.exec.record.RecordBatchLoader.getValueAccessorById():251
 org.apache.drill.exec.physical.impl.unorderedreceiver.UnorderedReceiverBatch.getValueAccessorById():142
 org.apache.drill.exec.test.generated.PartitionerGen1732$OutgoingRecordBatch.doSetup():114
 org.apache.drill.exec.test.generated.PartitionerGen1732$OutgoingRecordBatch.initializeBatch():399
 org.apache.drill.exec.test.generated.PartitionerGen1732.flushOutgoingBatches():185
 org.apache.drill.exec.physical.impl.partitionsender.PartitionerDecorator$FlushBatchesHandlingClass.execute():285
 org.apache.drill.exec.physical.impl.partitionsender.PartitionerDecorator$PartitionerTask.run():340
 java.util.concurrent.ThreadPoolExecutor.runWorker():1149
 java.util.concurrent.ThreadPoolExecutor$Worker.run():624
 java.lang.Thread.run():748 (state=,code=0)


> Querying parquet file with null value field error
> -------------------------------------------------
>
>                 Key: DRILL-7067
>                 URL: https://issues.apache.org/jira/browse/DRILL-7067
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - Parquet
>    Affects Versions: 1.15.0
>         Environment: Ubuntu 18.04.1 LTS 
> Apache Drill 1.15.0 
>            Reporter: Jardhel Cachola
>            Priority: Blocker
>             Fix For: Future
>
>
> When we try to join two parquet tables and one of them has null values on any field, the query doesn't run. It fails showing the following error: 
> Error: SYSTEM ERROR: IllegalStateException: Failure while reading vector. Expected vector class of org.apache.drill.exec.vector.NullableIntVector but was holding vector class org.apache.drill.exec.vector.NullableVarDecimalVector, field= [`id_hubbles` (VARDECIMAL(38, 4):OPTIONAL), children=([`$bits$` (UINT1:REQUIRED)], [`id_cub` (VARDECIMAL(38, 4):OPTIONAL), children=([`$offsets$` (UINT4:REQUIRED)])])]
> Fragment 2:0
> Please, refer to logs for more information.
> [Error Id: 48f63255-c771-4809-8252-ef7a78fda31b on ################]
> (java.lang.IllegalStateException) Failure while reading vector. Expected vector class of org.apache.drill.exec.vector.NullableIntVector but was holding vector class org.apache.drill.exec.vector.NullableVarDecimalVector, field= [`id_hubbles` (VARDECIMAL(38, 4):OPTIONAL), children=([`$bits$` (UINT1:REQUIRED)], [`id_cub` (VARDECIMAL(38, 4):OPTIONAL), children=([`$offsets$` (UINT4:REQUIRED)])])] 
>  org.apache.drill.exec.record.VectorContainer.getValueAccessorById():324
>  org.apache.drill.exec.record.RecordBatchLoader.getValueAccessorById():251
>  org.apache.drill.exec.physical.impl.unorderedreceiver.UnorderedReceiverBatch.getValueAccessorById():142
>  org.apache.drill.exec.test.generated.PartitionerGen1732$OutgoingRecordBatch.doSetup():114
>  org.apache.drill.exec.test.generated.PartitionerGen1732$OutgoingRecordBatch.initializeBatch():399
>  org.apache.drill.exec.test.generated.PartitionerGen1732.flushOutgoingBatches():185
>  org.apache.drill.exec.physical.impl.partitionsender.PartitionerDecorator$FlushBatchesHandlingClass.execute():285
>  org.apache.drill.exec.physical.impl.partitionsender.PartitionerDecorator$PartitionerTask.run():340
>  java.util.concurrent.ThreadPoolExecutor.runWorker():1149
>  java.util.concurrent.ThreadPoolExecutor$Worker.run():624
>  java.lang.Thread.run():748 (state=,code=0)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)