You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Shao Feng Shi (Jira)" <ji...@apache.org> on 2020/04/29 13:52:00 UTC
[jira] [Updated] (KYLIN-4213) The new build engine with Spark-SQL
[ https://issues.apache.org/jira/browse/KYLIN-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shao Feng Shi updated KYLIN-4213:
---------------------------------
Fix Version/s: v4.0.0-beta
Affects Version/s: (was: Future)
> The new build engine with Spark-SQL
> -----------------------------------
>
> Key: KYLIN-4213
> URL: https://issues.apache.org/jira/browse/KYLIN-4213
> Project: Kylin
> Issue Type: New Feature
> Components: Job Engine
> Reporter: yiming.xu
> Assignee: yiming.xu
> Priority: Major
> Fix For: v4.0.0-beta
>
>
> 1. Use Spark-SQL to compute cuboid, build cuboid A, B, C , Sum(D) is sql "select A B C Sum(D) from table group by A, B, C".
> 2. To void many memory errors or other exceptions, we can auto set spark conf with build job.E.g use adaptive execution.
> 3. The snapshot table will save a table with parquet format.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)