You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "xuzhiliang (JIRA)" <ji...@apache.org> on 2017/04/27 08:11:04 UTC
[jira] [Updated] (CARBONDATA-999) use carbondata bulket feature，but it doesn't seem to work?anyone know it?
[ https://issues.apache.org/jira/browse/CARBONDATA-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
xuzhiliang updated CARBONDATA-999:
----------------------------------
Docs Text: (was: 1.CREATE TABLE kd_shop_test(platFormId int,sellerNick string,companyGuid STRING,companyName STRING) STORED BY 'carbondata' TBLPROPERTIES ('BUCKETNUMBER'='2','BUCKETCOLUMNS'='sellerNick')
2. hadoop dfs -lsr /Opt/CarbonStore/default/kd_shop_test
drwxr-xr-x - root supergroup 0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact
drwxr-xr-x - root supergroup 0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0
drwxr-xr-x - root supergroup 0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0/Segment_0
-rw-r--r-- 3 root supergroup 566 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0/Segment_0/0_batchno0-0-1493278648826.carbonindex
-rw-r--r-- 3 root supergroup 891 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0/Segment_0/part-0-0_batchno0-0-1493278648826.carbondata
drwxr-xr-x - root supergroup 0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata
-rw-r--r-- 3 root supergroup 211 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/472c32a7-db92-48d9-b2d8-c3b594a92f16.dict
-rw-r--r-- 3 root supergroup 12 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/472c32a7-db92-48d9-b2d8-c3b594a92f16.dictmeta
-rw-r--r-- 3 root supergroup 31 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/472c32a7-db92-48d9-b2d8-c3b594a92f16_211.sortindex
-rw-r--r-- 3 root supergroup 39 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/7010a4ff-5575-42b9-949c-6456d683da0c.dict
-rw-r--r-- 3 root supergroup 11 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/7010a4ff-5575-42b9-949c-6456d683da0c.dictmeta
-rw-r--r-- 3 root supergroup 11 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/7010a4ff-5575-42b9-949c-6456d683da0c_39.sortindex
-rw-r--r-- 3 root supergroup 73 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/bcdb18a6-ff24-4992-9d43-d39cb46c4034.dict
-rw-r--r-- 3 root supergroup 12 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/bcdb18a6-ff24-4992-9d43-d39cb46c4034.dictmeta
-rw-r--r-- 3 root supergroup 13 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/bcdb18a6-ff24-4992-9d43-d39cb46c4034_73.sortindex
-rw-r--r-- 3 root supergroup 532 2017-04-27 15:36 /Opt/CarbonStore/default/kd_shop_test/Metadata/schema
-rw-r--r-- 3 root supergroup 268 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/tablestatus
3.when loading data
the sorter is type of ParallelReadMergeSorterImpl,not ParallelReadMergeSorterWithBucketingImpl,why configuration.getBucketingInfo is null?What is wrong with that? Can you fix it?)
Request participants: (was: )
Description:
1.CREATE TABLE kd_shop_test(platFormId int,sellerNick string,companyGuid STRING,companyName STRING) STORED BY 'carbondata' TBLPROPERTIES ('BUCKETNUMBER'='2','BUCKETCOLUMNS'='sellerNick')
2. hadoop dfs -lsr /Opt/CarbonStore/default/kd_shop_test
drwxr-xr-x - root supergroup 0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact
drwxr-xr-x - root supergroup 0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0
drwxr-xr-x - root supergroup 0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0/Segment_0
-rw-r--r-- 3 root supergroup 566 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0/Segment_0/0_batchno0-0-1493278648826.carbonindex
-rw-r--r-- 3 root supergroup 891 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0/Segment_0/part-0-0_batchno0-0-1493278648826.carbondata
drwxr-xr-x - root supergroup 0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata
-rw-r--r-- 3 root supergroup 211 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/472c32a7-db92-48d9-b2d8-c3b594a92f16.dict
-rw-r--r-- 3 root supergroup 12 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/472c32a7-db92-48d9-b2d8-c3b594a92f16.dictmeta
-rw-r--r-- 3 root supergroup 31 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/472c32a7-db92-48d9-b2d8-c3b594a92f16_211.sortindex
-rw-r--r-- 3 root supergroup 39 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/7010a4ff-5575-42b9-949c-6456d683da0c.dict
-rw-r--r-- 3 root supergroup 11 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/7010a4ff-5575-42b9-949c-6456d683da0c.dictmeta
-rw-r--r-- 3 root supergroup 11 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/7010a4ff-5575-42b9-949c-6456d683da0c_39.sortindex
-rw-r--r-- 3 root supergroup 73 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/bcdb18a6-ff24-4992-9d43-d39cb46c4034.dict
-rw-r--r-- 3 root supergroup 12 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/bcdb18a6-ff24-4992-9d43-d39cb46c4034.dictmeta
-rw-r--r-- 3 root supergroup 13 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/bcdb18a6-ff24-4992-9d43-d39cb46c4034_73.sortindex
-rw-r--r-- 3 root supergroup 532 2017-04-27 15:36 /Opt/CarbonStore/default/kd_shop_test/Metadata/schema
-rw-r--r-- 3 root supergroup 268 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/tablestatus
3.when loading data
the sorter is type of ParallelReadMergeSorterImpl,not ParallelReadMergeSorterWithBucketingImpl,why configuration.getBucketingInfo is null?What is wrong with that? Can you fix it?
was:use carbondata bulket feature，but it doesn't seem to work?anyone know it?
> use carbondata bulket feature，but it doesn't seem to work?anyone know it?
> -------------------------------------------------------------------------
>
> Key: CARBONDATA-999
> URL: https://issues.apache.org/jira/browse/CARBONDATA-999
> Project: CarbonData
> Issue Type: Bug
> Components: data-load
> Affects Versions: 1.1.0
> Environment: spark 1.6.2，carbondata 1.1.0
> Reporter: xuzhiliang
>
> 1.CREATE TABLE kd_shop_test(platFormId int,sellerNick string,companyGuid STRING,companyName STRING) STORED BY 'carbondata' TBLPROPERTIES ('BUCKETNUMBER'='2','BUCKETCOLUMNS'='sellerNick')
> 2. hadoop dfs -lsr /Opt/CarbonStore/default/kd_shop_test
> drwxr-xr-x - root supergroup 0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact
> drwxr-xr-x - root supergroup 0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0
> drwxr-xr-x - root supergroup 0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0/Segment_0
> -rw-r--r-- 3 root supergroup 566 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0/Segment_0/0_batchno0-0-1493278648826.carbonindex
> -rw-r--r-- 3 root supergroup 891 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0/Segment_0/part-0-0_batchno0-0-1493278648826.carbondata
> drwxr-xr-x - root supergroup 0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata
> -rw-r--r-- 3 root supergroup 211 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/472c32a7-db92-48d9-b2d8-c3b594a92f16.dict
> -rw-r--r-- 3 root supergroup 12 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/472c32a7-db92-48d9-b2d8-c3b594a92f16.dictmeta
> -rw-r--r-- 3 root supergroup 31 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/472c32a7-db92-48d9-b2d8-c3b594a92f16_211.sortindex
> -rw-r--r-- 3 root supergroup 39 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/7010a4ff-5575-42b9-949c-6456d683da0c.dict
> -rw-r--r-- 3 root supergroup 11 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/7010a4ff-5575-42b9-949c-6456d683da0c.dictmeta
> -rw-r--r-- 3 root supergroup 11 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/7010a4ff-5575-42b9-949c-6456d683da0c_39.sortindex
> -rw-r--r-- 3 root supergroup 73 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/bcdb18a6-ff24-4992-9d43-d39cb46c4034.dict
> -rw-r--r-- 3 root supergroup 12 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/bcdb18a6-ff24-4992-9d43-d39cb46c4034.dictmeta
> -rw-r--r-- 3 root supergroup 13 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/bcdb18a6-ff24-4992-9d43-d39cb46c4034_73.sortindex
> -rw-r--r-- 3 root supergroup 532 2017-04-27 15:36 /Opt/CarbonStore/default/kd_shop_test/Metadata/schema
> -rw-r--r-- 3 root supergroup 268 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/tablestatus
> 3.when loading data
> the sorter is type of ParallelReadMergeSorterImpl,not ParallelReadMergeSorterWithBucketingImpl,why configuration.getBucketingInfo is null?What is wrong with that? Can you fix it?
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)