You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Xiaoxiang Yu (Jira)" <ji...@apache.org> on 2020/08/26 06:16:00 UTC
[jira] [Updated] (KYLIN-4719) Refine kylin-defaults.properties for
parquet Storage
[ https://issues.apache.org/jira/browse/KYLIN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xiaoxiang Yu updated KYLIN-4719:
--------------------------------
Description:
A lot of properties is use less now, we should remove some of them, such as:
{code:java}
//
#### FLINK ENGINE CONFIGS ###
#
### Flink conf (default is in flink/conf/flink-conf.yaml)
#kylin.engine.flink-conf.jobmanager.heap.size=2G
#kylin.engine.flink-conf.taskmanager.heap.size=4G
#kylin.engine.flink-conf.taskmanager.numberOfTaskSlots=1
#kylin.engine.flink-conf.taskmanager.memory.preallocate=false
#kylin.engine.flink-conf.job.parallelism=1
#kylin.engine.flink-conf.program.enableObjectReuse=false
#kylin.engine.flink-conf.yarn.queue=
#kylin.engine.flink-conf.yarn.nodelabel=
#
#### QUERY PUSH DOWN ###
#
##kylin.query.pushdown.runner-class-name=org.apache.kylin.query.pushdown.PushDownRunnerSparkImpl
#
##kylin.query.pushdown.update-enabled=false
#
#### JDBC Data Source
##kylin.source.jdbc.connection-url=
##kylin.source.jdbc.driver=
##kylin.source.jdbc.dialect=
##kylin.source.jdbc.user=
##kylin.source.jdbc.pass=
##kylin.source.jdbc.sqoop-home=
##kylin.source.jdbc.filed-delimiter=|
#
#### Livy with Kylin
##kylin.engine.livy-conf.livy-enabled=false
##kylin.engine.livy-conf.livy-url=http://LivyHost:8998
##kylin.engine.livy-conf.livy-key.file=hdfs:///path-to-kylin-job-jar
##kylin.engine.livy-conf.livy-arr.jars=hdfs:///path-to-hadoop-dependency-jar
code placeholder
{code}
was:
A lot of properties is use less now, we should remove some of them, such as:
```
#### FLINK ENGINE CONFIGS ###
#
### Flink conf (default is in flink/conf/flink-conf.yaml)
#kylin.engine.flink-conf.jobmanager.heap.size=2G
#kylin.engine.flink-conf.taskmanager.heap.size=4G
#kylin.engine.flink-conf.taskmanager.numberOfTaskSlots=1
#kylin.engine.flink-conf.taskmanager.memory.preallocate=false
#kylin.engine.flink-conf.job.parallelism=1
#kylin.engine.flink-conf.program.enableObjectReuse=false
#kylin.engine.flink-conf.yarn.queue=
#kylin.engine.flink-conf.yarn.nodelabel=
```
> Refine kylin-defaults.properties for parquet Storage
> ----------------------------------------------------
>
> Key: KYLIN-4719
> URL: https://issues.apache.org/jira/browse/KYLIN-4719
> Project: Kylin
> Issue Type: Sub-task
> Components: Environment
> Reporter: Xiaoxiang Yu
> Priority: Major
> Fix For: v4.0.0-beta
>
>
> A lot of properties is use less now, we should remove some of them, such as:
>
> {code:java}
> //
> #### FLINK ENGINE CONFIGS ###
> #
> ### Flink conf (default is in flink/conf/flink-conf.yaml)
> #kylin.engine.flink-conf.jobmanager.heap.size=2G
> #kylin.engine.flink-conf.taskmanager.heap.size=4G
> #kylin.engine.flink-conf.taskmanager.numberOfTaskSlots=1
> #kylin.engine.flink-conf.taskmanager.memory.preallocate=false
> #kylin.engine.flink-conf.job.parallelism=1
> #kylin.engine.flink-conf.program.enableObjectReuse=false
> #kylin.engine.flink-conf.yarn.queue=
> #kylin.engine.flink-conf.yarn.nodelabel=
> #
> #### QUERY PUSH DOWN ###
> #
> ##kylin.query.pushdown.runner-class-name=org.apache.kylin.query.pushdown.PushDownRunnerSparkImpl
> #
> ##kylin.query.pushdown.update-enabled=false
> #
> #### JDBC Data Source
> ##kylin.source.jdbc.connection-url=
> ##kylin.source.jdbc.driver=
> ##kylin.source.jdbc.dialect=
> ##kylin.source.jdbc.user=
> ##kylin.source.jdbc.pass=
> ##kylin.source.jdbc.sqoop-home=
> ##kylin.source.jdbc.filed-delimiter=|
> #
> #### Livy with Kylin
> ##kylin.engine.livy-conf.livy-enabled=false
> ##kylin.engine.livy-conf.livy-url=http://LivyHost:8998
> ##kylin.engine.livy-conf.livy-key.file=hdfs:///path-to-kylin-job-jar
> ##kylin.engine.livy-conf.livy-arr.jars=hdfs:///path-to-hadoop-dependency-jar
> code placeholder
> {code}
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)