Skip to content

SqlToS3Operator do not add the suffix .parquet when load to #53976

@RamesChan

Description

@RamesChan

Apache Airflow Provider(s)

amazon

Versions of Apache Airflow Providers

apache-airflow-providers-amazon==9.8.0

Apache Airflow version

3.0.2

Operating System

PRETTY_NAME="Debian GNU/Linux 12 (bookworm)" NAME="Debian GNU/Linux" VERSION_ID="12" VERSION="12 (bookworm)" VERSION_CODENAME=bookworm ID=debian HOME_URL="https://www.debian.org/" SUPPORT_URL="https://www.debian.org/support" BUG_REPORT_URL="https://bugs.debian.org/"

Deployment

Docker-Compose

Deployment details

docker 4.43.1

What happened

dag code:
explain : I try to load data from postgres to s3 in parquet format and group by sales_date
Image

the results or s3
problem: it load the files are dont have any format.
Image

What you think should happen instead

all of the file should be .parquet

How to reproduce

just suggest me or review me code correct or not.

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

Labels

area:providerskind:bugThis is a clearly a bugpriority:lowBug with a simple workaround that would not block a releaseprovider:amazonAWS/Amazon - related issues

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions