You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Sebastian Schelter (JIRA)" <ji...@apache.org> on 2014/04/29 07:55:15 UTC
[jira] [Commented] (MAHOUT-1529) Finalize abstraction of
distributed logical plans from backend operations
[ https://issues.apache.org/jira/browse/MAHOUT-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984046#comment-13984046 ]
Sebastian Schelter commented on MAHOUT-1529:
--------------------------------------------
a few more points
(4) SparkContext must be set as implicit val
(5) drmBroadcast returns a Spark-specific Broadcast object
> Finalize abstraction of distributed logical plans from backend operations
> -------------------------------------------------------------------------
>
> Key: MAHOUT-1529
> URL: https://issues.apache.org/jira/browse/MAHOUT-1529
> Project: Mahout
> Issue Type: Improvement
> Reporter: Dmitriy Lyubimov
>
> We have a few situations when algorithm-facing API has Spark dependencies creeping in.
> In particular, we know of the following cases:
> (1) checkpoint() accepts Spark constant StorageLevel directly;
> (2) certain things in CheckpointedDRM;
> (3) drmParallelize etc. routines in the "drm" and "sparkbindings" package.
--
This message was sent by Atlassian JIRA
(v6.2#6252)