You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by "a773807943@gmail.com" <a7...@gmail.com> on 2020/04/17 03:53:55 UTC

Streaming Table kafka parsing, parsing json string

hi:
    how to parsing extension field to extension_channel, extension_message ?
    my extension field is string but is json

    大家好，请问kylin中怎么解析我下面的json中，extenson字段，能吧extension拆开解析么？

{
    "ip_risk_level":"0",
    "assocAcctType":255,
    "phone_risk_level":"0",
    "risk_level":0,
    "antisdk_risk_level":0,
    "@timestamp":"XXX",
    "antisdk_time_stamp":"XXX",
    "phone":"XXX",
    "uid":"XXX",
    "mapping_rule_name":"",
    "appId":"XXX",
    "ip_country_code":"XXX",
    "antisdk_pcid":"XXX",
    "antisdk_duokai_num":"1",
    "timestamp":1586786095164,
    "assocAcctId":"",
    "device":"XXX",
    "antisdk_ip":"XXX",
    "ip_risk_mask":"0",
    "ip":"XXX",
    "antisdk_intercept_reason":"0",
    "antisdk_mask":"0",
    "tags":[
        "result"
    ],
    "mapping_rule_id":"",
    "mapping_rule_score":"0",
    "extension":"{"channel":"XXX","message":"?","sex":0,"target_uid":XXX,"version":"XXX"}",
    "termType":2,
    "host":"XXX"
}



a773807943@gmail.com

Re:Streaming Table kafka parsing, parsing json string

Posted by Xiaoxiang Yu <xx...@apache.org>.
Hi,
  Both Near Real-time Streaming and Realtime OLAP support such case (data structure: Map) in the latest version, https://issues.apache.org/jira/browse/KYLIN-3942. 







--

Best wishes to you ! 
From ：Xiaoxiang Yu




在 2020-04-17 11:53:55，"a773807943@gmail.com" <a7...@gmail.com> 写道：

hi:
    how to parsing extension field to extension_channel, extension_message ?
    my extension field is string but is json


    大家好，请问kylin中怎么解析我下面的json中，extenson字段，能吧extension拆开解析么？


{
    "ip_risk_level":"0",
    "assocAcctType":255,
    "phone_risk_level":"0",
    "risk_level":0,
    "antisdk_risk_level":0,
    "@timestamp":"XXX",
    "antisdk_time_stamp":"XXX",
    "phone":"XXX",
    "uid":"XXX",
    "mapping_rule_name":"",
    "appId":"XXX",
    "ip_country_code":"XXX",
    "antisdk_pcid":"XXX",
    "antisdk_duokai_num":"1",
    "timestamp":1586786095164,
    "assocAcctId":"",
    "device":"XXX",
    "antisdk_ip":"XXX",
    "ip_risk_mask":"0",
    "ip":"XXX",
    "antisdk_intercept_reason":"0",
    "antisdk_mask":"0",
    "tags":[
        "result"
    ],
    "mapping_rule_id":"",
    "mapping_rule_score":"0",
    "extension":"{"channel":"XXX","message":"?","sex":0,"target_uid":XXX,"version":"XXX"}",
    "termType":2,
    "host":"XXX"
}


a773807943@gmail.com

Re: Streaming Table kafka parsing, parsing json string

Posted by Yaqian Zhang <Ya...@126.com>.
Hi:

You can try add streaming table from this json in kylin, and you can see the parse result.

I paste this JSON to add streaming table in kylin, 

but modify format: 

"extension":"{"channel":"XXX","message":"?","sex":0,"target_uid":XXX,"version":"XXX"}”,
to
“extension”:{"channel":"XXX","message":"?","sex":0,"target_uid”:0,"version":"XXX”},

And kylin parse result of ‘extension’ part as below:




> 在 2020年4月17日，11:53，a773807943@gmail.com 写道：
> 
> hi:
>     how to parsing extension field to extension_channel, extension_message ?
>     my extension field is string but is json
> 
>     大家好，请问kylin中怎么解析我下面的json中，extenson字段，能吧extension拆开解析么？
> 
> {
>     "ip_risk_level":"0",
>     "assocAcctType":255,
>     "phone_risk_level":"0",
>     "risk_level":0,
>     "antisdk_risk_level":0,
>     "@timestamp":"XXX",
>     "antisdk_time_stamp":"XXX",
>     "phone":"XXX",
>     "uid":"XXX",
>     "mapping_rule_name":"",
>     "appId":"XXX",
>     "ip_country_code":"XXX",
>     "antisdk_pcid":"XXX",
>     "antisdk_duokai_num":"1",
>     "timestamp":1586786095164,
>     "assocAcctId":"",
>     "device":"XXX",
>     "antisdk_ip":"XXX",
>     "ip_risk_mask":"0",
>     "ip":"XXX",
>     "antisdk_intercept_reason":"0",
>     "antisdk_mask":"0",
>     "tags":[
>         "result"
>     ],
>     "mapping_rule_id":"",
>     "mapping_rule_score":"0",
>     "extension":"{"channel":"XXX","message":"?","sex":0,"target_uid":XXX,"version":"XXX"}",
>     "termType":2,
>     "host":"XXX"
> }
> 
> a773807943@gmail.com <ma...@gmail.com>