[jira] [Created] (CARBONDATA-2548) When using presto to query a table on carbondata, the "Could not read blocklet details" exception is reported

["Kevin Kong (JIRA)" <ji...@apache.org>]

Kevin Kong created CARBONDATA-2548:
--------------------------------------

             Summary: When using presto to query a table on carbondata, the "Could not read blocklet details" exception is reported
                 Key: CARBONDATA-2548
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2548
             Project: CarbonData
          Issue Type: Bug
          Components: presto-integration
    Affects Versions: 1.4.0
            Reporter: Kevin Kong


I think it may be line 373 in CarbonTableInputFormat.java. When the CarbonInputSplit object was constructed, the detailInfo property was not initialized

 

                  while (((double) bytesRemaining) / splitSize > 1.1) {

                    int blkIndex = getBlockIndex(blkLocations, length - bytesRemaining);

                    splits.add(makeSplit(segment.getSegmentNo(), path, length - bytesRemaining,

                        splitSize, blkLocations[blkIndex].getHosts(),

                        blkLocations[blkIndex].getCachedHosts(), FileFormat.ROW_V1));

 

 

 

The detailed exception is as follows：

 

2018-05-28T00:43:23.903+0800 DEBUG query-execution-11 com.facebook.presto.execution.QueryStateMachine Query 20180527_164323_00008_2xnww failed
java.lang.RuntimeException: Could not read blocklet details
 at org.apache.carbondata.presto.impl.CarbonLocalInputSplit.convertSplit(CarbonLocalInputSplit.java:131)
 at org.apache.carbondata.presto.CarbondataPageSourceProvider.createQueryModel(CarbondataPageSourceProvider.java:139)
 at org.apache.carbondata.presto.CarbondataPageSourceProvider.createReader(CarbondataPageSourceProvider.java:98)
 at org.apache.carbondata.presto.CarbondataPageSourceProvider.createPageSource(CarbondataPageSourceProvider.java:79)
 at com.facebook.presto.spi.connector.classloader.ClassLoaderSafeConnectorPageSourceProvider.createPageSource(ClassLoaderSafeConnectorPageSourceProvider.java:44)
 at com.facebook.presto.split.PageSourceManager.createPageSource(PageSourceManager.java:56)
 at com.facebook.presto.operator.TableScanOperator.getOutput(TableScanOperator.java:259)
 at com.facebook.presto.operator.Driver.processInternal(Driver.java:337)
 at com.facebook.presto.operator.Driver.lambda$processFor$6(Driver.java:241)
 at com.facebook.presto.operator.Driver.tryWithLock(Driver.java:614)
 at com.facebook.presto.operator.Driver.processFor(Driver.java:235)
 at com.facebook.presto.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:622)
 at com.facebook.presto.execution.executor.PrioritizedSplitRunner.process(PrioritizedSplitRunner.java:163)
 at com.facebook.presto.execution.executor.LegacyPrioritizedSplitRunner.process(LegacyPrioritizedSplitRunner.java:23)
 at com.facebook.presto.execution.executor.TaskExecutor$TaskRunner.run(TaskExecutor.java:485)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
 at java.lang.Thread.run(Thread.java:748)

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)