You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Zhichao Zhang (JIRA)" <ji...@apache.org> on 2017/08/29 06:29:00 UTC
[jira] [Commented] (CARBONDATA-1421) Auto Compaction Failing in
CarbonData Loading
[ https://issues.apache.org/jira/browse/CARBONDATA-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144817#comment-16144817 ]
Zhichao Zhang commented on CARBONDATA-1421:
--------------------------------------------
Hi, Pallavi Singh, you can try to use this pr(https://github.com/apache/carbondata/pull/1266) to resolve this issue, and please let me know whether it works.
> Auto Compaction Failing in CarbonData Loading
> ---------------------------------------------
>
> Key: CARBONDATA-1421
> URL: https://issues.apache.org/jira/browse/CARBONDATA-1421
> Project: CarbonData
> Issue Type: Bug
> Components: data-load
> Affects Versions: 1.2.0
> Reporter: Pallavi Singh
> Fix For: 1.2.0
>
>
> I ran the create query followed by multiple load queries and the auto-compaction is failing.
> 0: jdbc:hive2://localhost:10000> LOAD DATA inpath 'hdfs://localhost:54310/data/4000_UniqData.csv' INTO table uniqdata options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1');
> +---------+--+
> | Result |
> +---------+--+
> +---------+--+
> No rows selected (1.183 seconds)
> 0: jdbc:hive2://localhost:10000> LOAD DATA inpath 'hdfs://localhost:54310/data/5000_UniqData.csv' INTO table uniqdata options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1');
> Error: java.lang.Exception: Dataload is success. Auto-Compaction has failed. Please check logs. (state=,code=0)
> 0: jdbc:hive2://localhost:10000> LOAD DATA inpath 'hdfs://localhost:54310/data/7000_UniqData.csv' INTO table uniqdata options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1');
> Error: java.lang.Exception: Dataload is success. Auto-Compaction has failed. Please check logs. (state=,code=0)
> 0: jdbc:hive2://localhost:10000>
> 0: jdbc:hive2://localhost:10000>
> 0: jdbc:hive2://localhost:10000>
> 0: jdbc:hive2://localhost:10000>
> 0: jdbc:hive2://localhost:10000>
> 0: jdbc:hive2://localhost:10000>
> 0: jdbc:hive2://localhost:10000>
> 0: jdbc:hive2://localhost:10000> show segments for table uniqdata;
> +--------------------+----------+--------------------------+--------------------------+--+
> | SegmentSequenceId | Status | Load Start Time | Load End Time |
> +--------------------+----------+--------------------------+--------------------------+--+
> | 4 | Success | 2017-08-29 10:37:13.053 | 2017-08-29 10:37:13.888 |
> | 3 | Success | 2017-08-29 10:36:57.851 | 2017-08-29 10:36:59.08 |
> | 2 | Success | 2017-08-29 10:36:49.439 | 2017-08-29 10:36:50.373 |
> | 1 | Success | 2017-08-29 10:36:37.365 | 2017-08-29 10:36:38.768 |
> | 0 | Success | 2017-08-29 10:36:21.011 | 2017-08-29 10:36:26.1 |
> +--------------------+----------+--------------------------+--------------------------+--+
> 5 rows selected (0.099 seconds)
> 0: jdbc:hive2://localhost:10000> LOAD DATA inpath 'hdfs://localhost:54310/data/7000_UniqData.csv' INTO table uniqdata options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1');
> Error: java.lang.Exception: Dataload is success. Auto-Compaction has failed. Please check logs. (state=,code=0)
> 0: jdbc:hive2://localhost:10000> show segments for table uniqdata;
> +--------------------+----------+--------------------------+--------------------------+--+
> | SegmentSequenceId | Status | Load Start Time | Load End Time |
> +--------------------+----------+--------------------------+--------------------------+--+
> | 5 | Success | 2017-08-29 10:38:15.727 | 2017-08-29 10:38:16.548 |
> | 4 | Success | 2017-08-29 10:37:13.053 | 2017-08-29 10:37:13.888 |
> | 3 | Success | 2017-08-29 10:36:57.851 | 2017-08-29 10:36:59.08 |
> | 2 | Success | 2017-08-29 10:36:49.439 | 2017-08-29 10:36:50.373 |
> | 1 | Success | 2017-08-29 10:36:37.365 | 2017-08-29 10:36:38.768 |
> | 0 | Success | 2017-08-29 10:36:21.011 | 2017-08-29 10:36:26.1 |
> +--------------------+----------+--------------------------+--------------------------+--+
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)