Writing RDDs from Python Spark progrma (pyspark) to HBase

["gaurav.dasgupta" <ga...@gmail.com>]

Hi,

I am unable to understand how to write data directly on HBase table from a
Spark (pyspark) Python program. Is this possible in the current Spark
releases? If so, can someone provide an example code snippet to do this?

Thanks in advance.

Regards,
Gaurav



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Writing-RDDs-from-Python-Spark-progrma-pyspark-to-HBase-tp6469.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Writing RDDs from Python Spark progrma (pyspark) to HBase

[Nick Pentreath <ni...@gmail.com>]

It's not possible currently to write anything other than text (or pickle
files I think in 1.0.0 or if not then in 1.0.1) from PySpark.

I have an outstanding pull request to add READING any InputFormat from
PySpark, and after that is in I will look into OutputFormat too.

What does your data look like? Any details about your use case that you
could share would aid the design of this feature.

N


On Wed, May 28, 2014 at 3:00 PM, gaurav.dasgupta <ga...@gmail.com>wrote:

> Hi,
>
> I am unable to understand how to write data directly on HBase table from a
> Spark (pyspark) Python program. Is this possible in the current Spark
> releases? If so, can someone provide an example code snippet to do this?
>
> Thanks in advance.
>
> Regards,
> Gaurav
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Writing-RDDs-from-Python-Spark-progrma-pyspark-to-HBase-tp6469.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>