You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Michael Armbrust (JIRA)" <ji...@apache.org> on 2015/02/18 22:36:11 UTC
[jira] [Created] (SPARK-5898) Can't create DataFrame from Pandas
data frame
Michael Armbrust created SPARK-5898:
---------------------------------------
Summary: Can't create DataFrame from Pandas data frame
Key: SPARK-5898
URL: https://issues.apache.org/jira/browse/SPARK-5898
Project: Spark
Issue Type: Bug
Components: SQL
Reporter: Michael Armbrust
Assignee: Davies Liu
Priority: Critical
{code}
data = sqlContext.table("sparkCommits")
p = data.toPandas()
sqlContext.createDataFrame(p)
{code}
{code}
---------------------------------------------------------------------------
AttributeError Traceback (most recent call last)
<ipython-input-12-fb4f1895bd2f> in <module>()
1 data = sqlContext.table("sparkCommits")
2 p = data.toPandas()
----> 3 sqlContext.createDataFrame(p)
/home/ubuntu/databricks/spark/python/pyspark/sql/context.pyc in createDataFrame(self, data, schema, samplingRatio)
385 data = self._sc.parallelize(data.to_records(index=False))
386 if schema is None:
--> 387 schema = list(data.columns)
388
389 if not isinstance(data, RDD):
AttributeError: 'RDD' object has no attribute 'columns'
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org