You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "Vsevolod Ostapenko (JIRA)" <ji...@apache.org> on 2017/11/29 22:44:00 UTC

[jira] [Updated] (KYLIN-3068) HiveColumnCardinalityJob.java is using deprecated parameter name for HDFS block size

     [ https://issues.apache.org/jira/browse/KYLIN-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vsevolod Ostapenko updated KYLIN-3068:
--------------------------------------
    Description: 
While setting MR job configuration HiveColumnCardinalityJob.java uses deprecated parameter name for HDFS block size.
Since Hadoop 2.5 (at least) recommended parameter name is dfs.blocksize, while the existing code (2.2.0 and earlier) uses dfs.block.size (please refer to the list of Hadoop deprecated parameters - http://hadoop.apache.org/docs/r2.7.3/hadoop-project-dist/hadoop-common/DeprecatedProperties.html)


  was:
While setting MR job configuration HiveColumnCardinalityJob.java uses deprecated parameter name for HDFS block size.
Since Hadoop 2.5 (at least) recommended parameter name is dfs.blocksize, while the existing code (2.2.0 and earlier) uses dfs.block.size (please refer to the list of Hadoop deprecated parameters - http://hadoop.apache.org/docs/r2.7.3/hadoop-project-dist/hadoop-common/DeprecatedProperties.html)

As the result users have to use deprecated name in kylin.properties, if job parameters need to be tuned.


> HiveColumnCardinalityJob.java is using deprecated parameter name for HDFS block size
> ------------------------------------------------------------------------------------
>
>                 Key: KYLIN-3068
>                 URL: https://issues.apache.org/jira/browse/KYLIN-3068
>             Project: Kylin
>          Issue Type: Bug
>          Components: Job Engine
>    Affects Versions: v2.2.0
>         Environment: HDP 2.5.3, Kylin 2.2.0
>            Reporter: Vsevolod Ostapenko
>            Assignee: Dong Li
>            Priority: Minor
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> While setting MR job configuration HiveColumnCardinalityJob.java uses deprecated parameter name for HDFS block size.
> Since Hadoop 2.5 (at least) recommended parameter name is dfs.blocksize, while the existing code (2.2.0 and earlier) uses dfs.block.size (please refer to the list of Hadoop deprecated parameters - http://hadoop.apache.org/docs/r2.7.3/hadoop-project-dist/hadoop-common/DeprecatedProperties.html)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)