You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "liyang (JIRA)" <ji...@apache.org> on 2017/07/14 08:27:00 UTC
[jira] [Commented] (KYLIN-2712) Hybrid No query results, the direct
filtration
[ https://issues.apache.org/jira/browse/KYLIN-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16087027#comment-16087027 ]
liyang commented on KYLIN-2712:
-------------------------------
This is expected. The query "select *" asks for all dimensions. And the first cube "cube0615new_one" does not have all required dimensions and is skipped. Makes sense to me.
> Hybrid No query results, the direct filtration
> ----------------------------------------------
>
> Key: KYLIN-2712
> URL: https://issues.apache.org/jira/browse/KYLIN-2712
> Project: Kylin
> Issue Type: Test
> Components: Metadata
> Affects Versions: v2.0.0
> Environment: hadoop:cdh2.6 hbase:1.0.0 kylin:2.0.0
> Reporter: Guoliang
> Assignee: Shaofeng SHI
> Labels: test
> Fix For: v2.0.0
>
> Attachments: all_dim_20170615.json, cube0615new_one.json
>
> Original Estimate: 12h
> Remaining Estimate: 12h
>
> (1)To create a Hybrid 。The joint 2 cube。
> [hadoop@yzdmp006061 hybrid]$ cat my_hybrid.json
> {
> "uuid": "glc86464-3612-gl72-gl1e-3330126a205a",
> "name": "my_hybrid",
> "realizations": [ {
> "type": "CUBE",
> "realization": "cube0615new_one"
> }, {
> "type": "CUBE",
> "realization": "all_dim_20170615"
> }
> ]
> }
> [hadoop@yzdmp006061 hybrid]$
> (2) xview.json
> Has been added
> {
> "name":"my_hybrid",
> "type" : "HYBRID",
> "realization" : "my_hybrid"
> }
> (3)*{color:red}But I query, but only one cube to take effect.Log in, according to Exclude cube cube0615new_one because unmatched dimensions,What reason is this{color}*
> 2017-07-05 17:39:25,402 INFO [Query fc2bdc97-90e8-46ae-b5a9-9917bba1e3bd-200] routing.QueryRouter:68 : The realizations remaining: [my_hybrid(HYBRID)] And the final c
> hosen one is the first one
> 2017-07-05 17:39:25,426 DEBUG [Query fc2bdc97-90e8-46ae-b5a9-9917bba1e3bd-200] enumerator.OLAPEnumerator:109 : query storage...
> 2017-07-05 17:39:25,426 INFO [Query fc2bdc97-90e8-46ae-b5a9-9917bba1e3bd-200] cube.CubeCapabilityChecker:109 : Exclude cube cube0615new_one because unmatched dimensio
> ns
> 2017-07-05 17:39:25,427 INFO [Query fc2bdc97-90e8-46ae-b5a9-9917bba1e3bd-200] cube.RawQueryLastHacker:42 : No group by and aggregation found in this query, will hack
> some result for better look of output...
> 2017-07-05 17:39:25,427 WARN [Query fc2bdc97-90e8-46ae-b5a9-9917bba1e3bd-200] cube.RawQueryLastHacker:73 : SUM is not defined for measure column DW.KYLIN_FACT_USER_AD
> SLOT_20170615.GL, output will be meaningless.
> 2017-07-05 17:39:25,429 DEBUG [Query fc2bdc97-90e8-46ae-b5a9-9917bba1e3bd-200] gtrecord.GTCubeStorageQueryBase:253 : Does not need storage aggregation
> 2017-07-05 17:39:25,429 INFO [Query fc2bdc97-90e8-46ae-b5a9-9917bba1e3bd-200] storage.StorageContext:129 : Enable limit (storage push down limit) :4
> 2017-07-05 17:39:25,429 DEBUG [Query fc2bdc97-90e8-46ae-b5a9-9917bba1e3bd-200] gtrecord.GTCubeStorageQueryBase:392 : Aggregate partition results is not beneficial beca
> use no storage aggregation
> 2017-07-05 17:39:25,430 INFO [Query fc2bdc97-90e8-46ae-b5a9-9917bba1e3bd-200] gtrecord.GTCubeStorageQueryBase:151 : Cuboid identified: cube=all_dim_20170615, cuboidId
> =67108863, groupsD=[DW.KYLIN_FACT_USER_ADSLOT_20170615.IS_NATIVE, DW.KYLIN_FACT_USER_ADSLOT_20170615.DOMAIN, DW.KYLIN_FACT_USER_ADSLOT_20170615.IS_RD, DW.KYLIN_FACT_US
> ER_ADSLOT_20170615.ADSLOT_TYPE, DW.KYLIN_FACT_USER_ADSLOT_20170615.DAY_ID, DW.KYLIN_FACT_USER_ADSLOT_20170615.OS_VERSION, DW.KYLIN_FACT_USER_ADSLOT_20170615.HOUR_ID, D
> W.KYLIN_FACT_USER_ADSLOT_20170615.ADSLOT_ID, DW.KYLIN_FACT_USER_ADSLOT_20170615.ADSLOT_SIZE, DW.KYLIN_FACT_USER_ADSLOT_20170615.CHANNEL_ID, DW.KYLIN_FACT_USER_ADSLOT_2
> 0170615.WIRELESS_NETWORK_TYPE, DW.KYLIN_FACT_USER_ADSLOT_20170615.DEVICE_TYPE, DW.KYLIN_FACT_USER_ADSLOT_20170615.CAMPAIGN_DATE_ID, DW.KYLIN_FACT_USER_ADSLOT_20170615.
> MODEL, DW.KYLIN_FACT_USER_ADSLOT_20170615.DOMAIN_CATEGORY_IDS, DW.KYLIN_FACT_USER_ADSLOT_20170615.ADSLOT_POSITION, DW.KYLIN_FACT_USER_ADSLOT_20170615.BROWER, DW.KYLIN_
> FACT_USER_ADSLOT_20170615.TRADE_TYPE, DW.KYLIN_FACT_USER_ADSLOT_20170615.CAMPAIGN_ID, DW.KYLIN_FACT_USER_ADSLOT_20170615.DOMAIN_NAME, DW.KYLIN_FACT_USER_ADSLOT_2017061
> 5.BRAND, DW.KYLIN_FACT_USER_ADSLOT_20170615.CREATIVE_ID, DW.KYLIN_FACT_USER_ADSLOT_20170615.MOBILE_CARRIER_ID, DW.KYLIN_FACT_USER_ADSLOT_20170615.PLATFORM, DW.KYLIN_FA
> CT_USER_ADSLOT_20170615.FLOW_TYPE, DW.KYLIN_FACT_USER_ADSLOT_20170615.PROJECT_ID], filterD=[DW.KYLIN_FACT_USER_ADSLOT_20170615.DAY_ID], limitPushdown=4, storageAggr=fa
> lse
> 2017-07-05 17:39:25,430 INFO [Query fc2bdc97-90e8-46ae-b5a9-9917bba1e3bd-200] gtrecord.CubeSegmentScanner:56 : Init CubeSegmentScanner for segment 20170614000000_2017
> 0615000000
> 2017-07-05 17:39:25,431 ERROR [Query fc2bdc97-90e8-46ae-b5a9-9917bba1e3bd-200] dict.TrieDictionary:152 : Not a valid value: 20170117
> 2017-07-05 17:39:25,432 INFO [Query fc2bdc97-90e8-46ae-b5a9-9917bba1e3bd-200] gtrecord.ScannerWorker:44 : Segment all_dim_20170615[20170614000000_20170615000000] will be skipped
> Attached is my two cube information
> SQL:select * from KYLIN_FACT_USER_ADSLOT_20170615 where day_id=20170117
> Correctly, it should choose to cube cube0615new_one, and load the data
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)