diff options
| author | hyukjinkwon <gurwls223@gmail.com> | 2016-06-29 13:32:03 -0700 |
|---|---|---|
| committer | Davies Liu <davies.liu@gmail.com> | 2016-06-29 13:32:03 -0700 |
| commit | d8a87a3ed211dd08f06eeb9560661b8f11ce82fa (patch) | |
| tree | 44116cb74d88ccf4415250fbae3bc8ee7acdde38 /python/pyspark | |
| parent | 64132a14fb7a7255feeb5847a54f541fe551bf23 (diff) | |
| download | spark-d8a87a3ed211dd08f06eeb9560661b8f11ce82fa.tar.gz spark-d8a87a3ed211dd08f06eeb9560661b8f11ce82fa.tar.bz2 spark-d8a87a3ed211dd08f06eeb9560661b8f11ce82fa.zip | |
[TRIVIAL] [PYSPARK] Clean up orc compression option as well
## What changes were proposed in this pull request?
This PR corrects ORC compression option for PySpark as well. I think this was missed mistakenly in https://github.com/apache/spark/pull/13948.
## How was this patch tested?
N/A
Author: hyukjinkwon <gurwls223@gmail.com>
Closes #13963 from HyukjinKwon/minor-orc-compress.
Diffstat (limited to 'python/pyspark')
| -rw-r--r-- | python/pyspark/sql/readwriter.py | 3 |
1 files changed, 1 insertions, 2 deletions
diff --git a/python/pyspark/sql/readwriter.py b/python/pyspark/sql/readwriter.py index 44bf74476b..78d992e415 100644 --- a/python/pyspark/sql/readwriter.py +++ b/python/pyspark/sql/readwriter.py @@ -695,8 +695,7 @@ class DataFrameWriter(OptionUtils): self.mode(mode) if partitionBy is not None: self.partitionBy(partitionBy) - if compression is not None: - self.option("compression", compression) + self._set_opts(compression=compression) self._jwrite.orc(path) @since(1.4) |