You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by rx...@apache.org on 2015/05/12 05:04:39 UTC

spark git commit: [SPARK-7509][SQL] DataFrame.drop in Python for dropping columns.

Repository: spark
Updated Branches:
  refs/heads/master 4b5e1fe94 -> 028ad4bd2


[SPARK-7509][SQL] DataFrame.drop in Python for dropping columns.

Author: Reynold Xin <rx...@databricks.com>

Closes #6068 from rxin/drop-column and squashes the following commits:

9d7d5ec [Reynold Xin] [SPARK-7509][SQL] DataFrame.drop in Python for dropping columns.


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/028ad4bd
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/028ad4bd
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/028ad4bd

Branch: refs/heads/master
Commit: 028ad4bd29106747089bb9a863e9a8dee738770e
Parents: 4b5e1fe
Author: Reynold Xin <rx...@databricks.com>
Authored: Mon May 11 20:04:36 2015 -0700
Committer: Reynold Xin <rx...@databricks.com>
Committed: Mon May 11 20:04:36 2015 -0700

----------------------------------------------------------------------
 python/pyspark/sql/dataframe.py | 14 +++++++++++++-
 1 file changed, 13 insertions(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/028ad4bd/python/pyspark/sql/dataframe.py
----------------------------------------------------------------------
diff --git a/python/pyspark/sql/dataframe.py b/python/pyspark/sql/dataframe.py
index 4eaa8d9..72180f6 100644
--- a/python/pyspark/sql/dataframe.py
+++ b/python/pyspark/sql/dataframe.py
@@ -1014,7 +1014,7 @@ class DataFrame(object):
 
     @ignore_unicode_prefix
     def withColumnRenamed(self, existing, new):
-        """REturns a new :class:`DataFrame` by renaming an existing column.
+        """Returns a new :class:`DataFrame` by renaming an existing column.
 
         :param existing: string, name of the existing column to rename.
         :param col: string, new name of the column.
@@ -1027,6 +1027,18 @@ class DataFrame(object):
                 for c in self.columns]
         return self.select(*cols)
 
+    @ignore_unicode_prefix
+    def drop(self, colName):
+        """Returns a new :class:`DataFrame` that drops the specified column.
+
+        :param colName: string, name of the column to drop.
+
+        >>> df.drop('age').collect()
+        [Row(name=u'Alice'), Row(name=u'Bob')]
+        """
+        jdf = self._jdf.drop(colName)
+        return DataFrame(jdf, self.sql_ctx)
+
     def toPandas(self):
         """Returns the contents of this :class:`DataFrame` as Pandas ``pandas.DataFrame``.
 


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org