-
Notifications
You must be signed in to change notification settings - Fork 14.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Added chunk_size parameter to LocalFilesystemToGCSOperator #40379
Conversation
Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contributors' Guide (https://github.com/apache/airflow/blob/main/contributing-docs/README.rst)
|
Some spell-check issue. |
It seems like the spell-check detects 'KiB' as an invalid term, even tough it should be valid. I have removed it. |
There is a list of allowed words. KiB is not on it. you can add it there, or you can |
I wasn't aware of the list of allowed words. Let me add it to the list. Thanks for letting me know. |
Awesome work, congrats on your first merged pull request! You are invited to check our Issue Tracker for additional contributions. |
And merged :) |
closes: #38958
related: #38958
This PR added a chunk_size parameter to the LocalFilesystemToGCSOperator. This parameter is already implemented in the GCSHook.upload function. This change ensures that the chunk_size is passed to the upload function.
^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named
{pr_number}.significant.rst
or{issue_number}.significant.rst
, in newsfragments.