You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kudu.apache.org by "Todd Lipcon (JIRA)" <ji...@apache.org> on 2016/09/08 02:55:20 UTC

[jira] [Commented] (KUDU-1215) Add integration for Spark map and foreach partition

    [ https://issues.apache.org/jira/browse/KUDU-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472541#comment-15472541 ] 

Todd Lipcon commented on KUDU-1215:
-----------------------------------

I think this isn't relevant anymore given the way the design ended up -- the fact that we made the client "serializable" seems to be sufficient here that you dont need any special methods, right [~ted.m]?

> Add integration for Spark map and foreach partition
> ---------------------------------------------------
>
>                 Key: KUDU-1215
>                 URL: https://issues.apache.org/jira/browse/KUDU-1215
>             Project: Kudu
>          Issue Type: New Feature
>          Components: integration
>            Reporter: Ted Malaska
>
> This jira will add two implicit method to Spark RDD
> 1. kuduForeachPartition
> 2. kuduMapPartitions
> These method will act like the basic foreach/map partition but they will provide the developer a live client to interact with Kudu
> These methods will be accessable from two different call points.
> 1. Scala RDD
> 2. KuduContext (which will work for Java)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)