You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by da...@apache.org on 2016/06/29 20:32:07 UTC
spark git commit: [TRIVIAL] [PYSPARK] Clean up orc compression option
as well
Repository: spark
Updated Branches:
refs/heads/master 64132a14f -> d8a87a3ed
[TRIVIAL] [PYSPARK] Clean up orc compression option as well
## What changes were proposed in this pull request?
This PR corrects ORC compression option for PySpark as well. I think this was missed mistakenly in https://github.com/apache/spark/pull/13948.
## How was this patch tested?
N/A
Author: hyukjinkwon <gu...@gmail.com>
Closes #13963 from HyukjinKwon/minor-orc-compress.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d8a87a3e
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d8a87a3e
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d8a87a3e
Branch: refs/heads/master
Commit: d8a87a3ed211dd08f06eeb9560661b8f11ce82fa
Parents: 64132a1
Author: hyukjinkwon <gu...@gmail.com>
Authored: Wed Jun 29 13:32:03 2016 -0700
Committer: Davies Liu <da...@gmail.com>
Committed: Wed Jun 29 13:32:03 2016 -0700
----------------------------------------------------------------------
python/pyspark/sql/readwriter.py | 3 +--
1 file changed, 1 insertion(+), 2 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/d8a87a3e/python/pyspark/sql/readwriter.py
----------------------------------------------------------------------
diff --git a/python/pyspark/sql/readwriter.py b/python/pyspark/sql/readwriter.py
index 44bf744..78d992e 100644
--- a/python/pyspark/sql/readwriter.py
+++ b/python/pyspark/sql/readwriter.py
@@ -695,8 +695,7 @@ class DataFrameWriter(OptionUtils):
self.mode(mode)
if partitionBy is not None:
self.partitionBy(partitionBy)
- if compression is not None:
- self.option("compression", compression)
+ self._set_opts(compression=compression)
self._jwrite.orc(path)
@since(1.4)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org