You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kudu.apache.org by "Jean-Daniel Cryans (Code Review)" <ge...@ip-10-146-233-104.ec2.internal> on 2016/01/15 02:07:47 UTC

[kudu-CR] Spark connectors for Kudu

Jean-Daniel Cryans has uploaded a new change for review.

  http://gerrit.cloudera.org:8080/1788

Change subject: Spark connectors for Kudu
......................................................................

Spark connectors for Kudu

This is a cleanup of Ted Malaska's "SparkOnKudu":

https://github.com/tmalaska/SparkOnKudu

Even if this patch is very simple and unfinished, the goal is to
provide a platform for others to add more functionality.

It contains wrappers around common Spark operators that make it easy
to use Kudu. It also has a Data Source implementation.

A single unit test, that uses scalatest, proves that kuduRDD basically
works.

Change-Id: Ic187513ef9724d50024f7401d7ecd19d53554245
---
A java/kudu-spark/pom.xml
A java/kudu-spark/src/main/scala/org/kududb/spark/DefaultSource.scala
A java/kudu-spark/src/main/scala/org/kududb/spark/KuduContext.scala
A java/kudu-spark/src/main/scala/org/kududb/spark/KuduDStreamFunctions.scala
A java/kudu-spark/src/test/scala/org/kududb/spark/KuduContextSuite.scala
M java/pom.xml
6 files changed, 809 insertions(+), 0 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/88/1788/1
-- 
To view, visit http://gerrit.cloudera.org:8080/1788
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: newchange
Gerrit-Change-Id: Ic187513ef9724d50024f7401d7ecd19d53554245
Gerrit-PatchSet: 1
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-Owner: Jean-Daniel Cryans