You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "weibin0516 (Jira)" <ji...@apache.org> on 2019/09/11 03:32:00 UTC

[jira] [Commented] (KYLIN-741) Read data from SparkSQL

    [ https://issues.apache.org/jira/browse/KYLIN-741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927218#comment-16927218 ] 

weibin0516 commented on KYLIN-741:
----------------------------------

Sounds useful, Spark sql itself already supports a wide variety of data sources and is highly extensible, which helps Kylin read various data sources to build cubes. I will try to achieve this feature.

> Read data from SparkSQL
> -----------------------
>
>                 Key: KYLIN-741
>                 URL: https://issues.apache.org/jira/browse/KYLIN-741
>             Project: Kylin
>          Issue Type: New Feature
>          Components: Job Engine, Spark Engine
>            Reporter: Luke Han
>            Assignee: weibin0516
>            Priority: Major
>              Labels: scope
>             Fix For: Backlog
>
>
> Read data from SparkSQL directly.
> There are some instances enabled SparkSQL interface for data consuming, it will be great if Kylin could read data directly from SparkSQL. 
> This feature does not require Spark Cube Build Engine to be ready. It could continue to leverage existing MR cube build engine and process data on Hadoop cluster then persistent cube to HBase.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)