You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Rahul Singha (JIRA)" <ji...@apache.org> on 2018/08/09 11:47:00 UTC
[jira] [Created] (CARBONDATA-2846) compaction is failing for table
created in S3/OBS
Rahul Singha created CARBONDATA-2846:
----------------------------------------
Summary: compaction is failing for table created in S3/OBS
Key: CARBONDATA-2846
URL: https://issues.apache.org/jira/browse/CARBONDATA-2846
Project: CarbonData
Issue Type: Bug
Components: data-query
Reporter: Rahul Singha
_*Steps:*_
1.create table brinjal (imei string,AMSize string,channelsId string,ActiveCountry string, Activecity string,gamePointId double,deviceInformationId double,productionDate Timestamp,deliveryDate timestamp,deliverycharge double) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES('table_blocksize'='1');
2.LOAD DATA INPATH 'hdfs://hacluster/user/rahul/vardhandaterestruct.csv' INTO TABLE brinjal OPTIONS('DELIMITER'=',', 'QUOTECHAR'= '"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'= 'imei,deviceInformationId,AMSize,channelsId,ActiveCountry,Activecity,gamePointId,productionDate,deliveryDate,deliverycharge');
3.LOAD DATA INPATH 'hdfs://hacluster/user/rahul/vardhandaterestruct.csv' INTO TABLE brinjal OPTIONS('DELIMITER'=',', 'QUOTECHAR'= '"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'= 'imei,deviceInformationId,AMSize,channelsId,ActiveCountry,Activecity,gamePointId,productionDate,deliveryDate,deliverycharge');
4.alter table brinjal compact 'major';
_*Expected Result*_:Compaction should be successful
_*Actual Result:*_
alter table brinjal compact 'minor';
Error: org.apache.spark.sql.AnalysisException: Compaction failed. Please check logs for more info. Exception in compaction Job aborted due to stage failure: Task 0 in stage 100.0 failed 4 times, most recent failure: Lost task 0.3 in stage 100.0 (TID 349, BLR1000025336, executor 116): org.apache.spark.sql.AnalysisException: Exception occurred in query execution :: org.apache.carbondata.core.scan.result.iterator.RawResultIterator.<init>(Lorg/apache/carbondata/common/CarbonIterator;Lorg/apache/carbondata/core/datastore/block/SegmentProperties;Lorg/apache/carbondata/core/datastore/block/SegmentProperties;Z)V;
at org.apache.spark.sql.util.CarbonException$.analysisException(CarbonException.scala:23)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.<init>(CarbonMergerRDD.scala:190)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD.internalCompute(CarbonMergerRDD.scala:85)
at org.apache.carbondata.spark.rdd.CarbonRDD.compute(CarbonRDD.scala:78)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
at org.apache.spark.scheduler.Task.run(Task.scala:108)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:338)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Driver stacktrace:; (state=,code=0)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)