Skip to content

Commit ea1b82e

Browse files
committed
Adding notes about to_csv compression. #308
1 parent e9fdf69 commit ea1b82e

File tree

1 file changed

+11
-0
lines changed

1 file changed

+11
-0
lines changed

awswrangler/s3/_write.py

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -236,6 +236,17 @@ def to_csv( # pylint: disable=too-many-arguments,too-many-locals
236236
`wr.catalog.sanitize_table_name` and `wr.catalog.sanitize_column_name`.
237237
Please, pass `sanitize_columns=True` to force the same behaviour for `dataset=False`.
238238
239+
Note
240+
----
241+
If `dataset=True`, `pandas_kwargs` will be ignored due
242+
restrictive quoting, date_format, escapechar, encoding, etc required by Athena/Glue Catalog.
243+
244+
Note
245+
----
246+
By now Pandas does not support in-memory CSV compression.
247+
https://github.com/pandas-dev/pandas/issues/22555
248+
So the `compression` will not be supported on Wrangler too.
249+
239250
Note
240251
----
241252
On `append` mode, the `parameters` will be upsert on an existing table.

0 commit comments

Comments
 (0)