You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2023/06/13 08:30:00 UTC

[jira] [Commented] (KYLIN-5574) Build model failed if any of the source table schema had been changed, saying deleted unrelated columns.

    [ https://issues.apache.org/jira/browse/KYLIN-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17731969#comment-17731969 ] 

ASF subversion and git services commented on KYLIN-5574:
--------------------------------------------------------

Commit 7ddcd87169d4e5abeb196fbdcc8fce28a5f3466a in kylin's branch refs/heads/kylin5 from Yinghao Lin
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=7ddcd87169 ]

KYLIN-5574 To fix the error of building models when KE's meatadata is inconstent with Hive metastore's.


> Build model failed if any of the source table schema had been changed, saying deleted unrelated columns. 
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: KYLIN-5574
>                 URL: https://issues.apache.org/jira/browse/KYLIN-5574
>             Project: Kylin
>          Issue Type: Bug
>          Components: Modeling
>    Affects Versions: 5.0-alpha
>            Reporter: Guangyuan Feng
>            Priority: Major
>             Fix For: 5.0-beta
>
>
> *How the error occurred?*
> During building a model, KE will construct a new *SELECT* sql from KE's table metadata, to read data from source tables. But if the user had deleted some unused columns from any source table, KE's metadata will be different with Hive's metastore, as a consequence, `SparkSession::sql` will throws validation exceptions because of the mismatched columns found in the *SELECT* sql.
> *How to solve it?*
> Using the intersection between KE's columns and Hive metastore's.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)