Skip to content

Commit d8a87a3

Browse files
HyukjinKwondavies
authored andcommitted
[TRIVIAL] [PYSPARK] Clean up orc compression option as well
## What changes were proposed in this pull request? This PR corrects ORC compression option for PySpark as well. I think this was missed mistakenly in #13948. ## How was this patch tested? N/A Author: hyukjinkwon <gurwls223@gmail.com> Closes #13963 from HyukjinKwon/minor-orc-compress.
1 parent 64132a1 commit d8a87a3

File tree

1 file changed

+1
-2
lines changed

1 file changed

+1
-2
lines changed

python/pyspark/sql/readwriter.py

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -695,8 +695,7 @@ def orc(self, path, mode=None, partitionBy=None, compression=None):
695695
self.mode(mode)
696696
if partitionBy is not None:
697697
self.partitionBy(partitionBy)
698-
if compression is not None:
699-
self.option("compression", compression)
698+
self._set_opts(compression=compression)
700699
self._jwrite.orc(path)
701700

702701
@since(1.4)

0 commit comments

Comments
 (0)