[jira] [Closed] (KYLIN-5699) Support special character for bitmap measure column & computed column

["liyang (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KYLIN-5699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

liyang closed KYLIN-5699.
-------------------------

> Support special character for bitmap measure column & computed column
> ---------------------------------------------------------------------
>
>                 Key: KYLIN-5699
>                 URL: https://issues.apache.org/jira/browse/KYLIN-5699
>             Project: Kylin
>          Issue Type: Improvement
>          Components: Modeling
>    Affects Versions: 5.0-beta
>            Reporter: Yaguang Jia
>            Assignee: Yaguang Jia
>            Priority: Critical
>             Fix For: 5.0.0
>
>
> *Root Cause*
> The Spark org.apache.spark.sql.functions.expr function cannot recognize special characters such as Chinese characters and needs to be enclosed in backticks.
> *Dev Design*
> Identify the places where expr is called and add compatibility handling for special characters:
> Build the computable column 
> {code:java}
> FlatTableAndDictBase#concatCCs{code}
> Build dictionary 
> {code:java}
> DFBuilderHelper#selectColumnsInTable, DFBuilderHelper#chooseSuitableCols{code}
> Build dictionary 
> {code:java}
> DFDictionaryBuilder#wrapCol{code}
>  
> ----
>  
> *Root Cause*
> Spark {{org.apache.spark.sql.functions.expr}} 函数不能识别中文等特殊字符，需要用反引号包裹。
> *Dev Design*
> 找出 expr 调用处，增加对特殊字符的兼容处理：
>  # 构建可计算列 {{FlatTableAndDictBase#concatCCs}}
>  # 构建字典 {{{}DFBuilderHelper#selectColumnsInTable{}}}、{{{}DFBuilderHelper#chooseSuitableCols{}}}
>  # 构建字典 {{DFDictionaryBuilder#wrapCol}}
> {{}}
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)