Add create_intermediate_dirs option to GCSToSFTPOperator

[hlakki31-arch]

Description

Proposal

Add a create_intermediate_dirs parameter to GCSToSFTPOperator, similar to SFTPOperator, to allow skipping automatic directory creation.

Problem:
Currently, GCSToSFTPOperator always calls create_directory() on the remote SFTP path, which can fail with permission errors when uploading to existing folders (e.g., /landing_folder/) where users don’t have permission to create new directories.

Proposed Solution:

• Add a boolean parameter create_intermediate_dirs (default=True).
• When set to False, skip the create_directory() call and upload directly to the specified folder.

Benefits:

• Allows uploading to existing folders without needing to modify SFTP permissions.
• Matches behavior of SFTPOperator, making the API more consistent.

Use case/motivation

The goal is to upload files from GCS to SFTP reliably even when the target folder exists and directory creation permissions are restricted. This prevents PermissionError failures and makes GCSToSFTPOperator more consistent with other SFTP operators.

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[boring-cyborg]

Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.

[jroachgolf84]

@hlakki31-arch, would you like this assigned? If not, I'm happy to work on this today.

[hlakki31-arch]

@hlakki31-arch, would you like this assigned? If not, I'm happy to work on this today.

Thanks
I'm currently busy with some ongoing workflow tasks, so please feel free to take this one forward.
Really appreciate your help on this! 🚀