[Feature][Module Name]is sftpfile and ftpfile source connectors can add deletePolicy

[18859108815]

Search before asking

• I had searched in the feature and found no similar feature requirement.

Description

is sftpfile and ftpfile source connectors can add deletePolicy，flume has the feature. The description is "When to delete completed files: never or immediate".
https://flume.apache.org/releases/content/1.11.0/FlumeUserGuide.html
By the way, if the sftpfile/ftpfile source connector has parititoned by date, and the path type “/path/yyyyMMdd/filename.csv”, for example "/path/20250120/filename.csv" and "/path/20250124/filename.csv", when source connector has collected the data in "/path/20250120/filename.csv" and deletePolicy has been set as immediate, it will delete both the file "filename.csv" and the directory“20250120”.

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct