You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Pat Ferrel (JIRA)" <ji...@apache.org> on 2015/11/06 19:42:11 UTC

[jira] [Commented] (MAHOUT-1785) Replace 'spark.kryoserializer.buffer.mb' from Spark config

    [ https://issues.apache.org/jira/browse/MAHOUT-1785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994178#comment-14994178 ] 

Pat Ferrel commented on MAHOUT-1785:
------------------------------------

This happens because Spark is changing the way a conf param is being used. The warning seems to apply into Spark 1.6-SNAPSHOT so if it works, not a blocker and we have to have it for Spark 1.4.1 or below.

So we can't do anything about this until we require 1.5.1, which is not in Mahout 0.11.1 so defer this.

> Replace 'spark.kryoserializer.buffer.mb' from Spark config
> ----------------------------------------------------------
>
>                 Key: MAHOUT-1785
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1785
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Mahout spark shell
>    Affects Versions: 0.11.0
>            Reporter: Suneel Marthi
>            Assignee: Suneel Marthi
>            Priority: Trivial
>             Fix For: 0.12.0
>
>
> 'spark.kryoserializer.buffer.mb' has been deprecated as of spark 1.4 and should be replaced by 'spark.kryoserializer.buffer'



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)