You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by "wenyefbl@163.com" <we...@163.com> on 2016/01/19 13:26:34 UTC

kylin job压缩支持的参数！

因为我使用的hadoop为2.6的版本，为官方的二进制包，测试发现不支持Snappy压缩，kylin在运行job想换个压缩方式，那么mapred.map.output.compression.codec这个参数可以配置为的value有哪些？
我的配置kylin_job_conf.xml：
    <property>
        <name>mapred.map.output.compression.codec</name>
        <value>org.apache.hadoop.io.compress.SnappyCodec</value>
        <description>The compression codec to use for map outputs
        </description>
    </property>


谢谢！





wenyefbl@163.com

Re: kylin job压缩支持的参数！

Posted by Li Yang <li...@apache.org>.
http://kylin.apache.org/docs/install/advance_settings.html

Here you find settings about compression.

On Tue, Jan 19, 2016 at 8:33 PM, hongbin ma <ma...@apache.org> wrote:

> ​you can comment out all entries containing snappy in kylin_hive_conf.xml,
> kylin_job_conf.xml and kylin.properties (find them in $KYLIN_HOME/conf​)
>
> in that case MR will use no compression, and storage in hbase will not use
> any, either.
>
>
>
>
> --
> Regards,
>
> *Bin Mahone | 马洪宾*
> Apache Kylin: http://kylin.io
> Github: https://github.com/binmahone
>

Re: kylin job压缩支持的参数！

Posted by hongbin ma <ma...@apache.org>.
​you can comment out all entries containing snappy in kylin_hive_conf.xml,
kylin_job_conf.xml and kylin.properties (find them in $KYLIN_HOME/conf​)

in that case MR will use no compression, and storage in hbase will not use
any, either.




-- 
Regards,

*Bin Mahone | 马洪宾*
Apache Kylin: http://kylin.io
Github: https://github.com/binmahone