You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@spark.apache.org by Suraj Shetiya <su...@gmail.com> on 2015/04/16 12:11:48 UTC

Dataframe from mysql database in pyspark

Hi,

Is there any means of transforming mysql databases into dataframes from
pyspark.
Iwas about to find a document that converts mysql database to dataframe in
spark-shell(http://www.infoobjects.com/spark-sql-jdbcrdd/) using jdbc. I
had been through the official documentation and can't find any pointers in
this regard.

-- 
Regards,
Suraj

Re: Dataframe from mysql database in pyspark

Posted by Reynold Xin <rx...@databricks.com>.

There is a jdbc in the SQLContext scala doc:

https://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.sql.SQLContext

Note that this is more of a user list question ....

On Thu, Apr 16, 2015 at 5:11 AM, Suraj Shetiya <su...@gmail.com>
wrote:

> Hi,
>
> Is there any means of transforming mysql databases into dataframes from
> pyspark.
> Iwas about to find a document that converts mysql database to dataframe in
> spark-shell(http://www.infoobjects.com/spark-sql-jdbcrdd/) using jdbc. I
> had been through the official documentation and can't find any pointers in
> this regard.
>
> --
> Regards,
> Suraj
>