[Feature][connector-v2] Support file path with wildcard for source connectors like SFTP/FTP

[voyagertanyao]

Search before asking

• I had searched in the feature and found no similar feature requirement.

Description

Seatunnel source connector sftp/ftp ,file path do not support wildcard format , e.g /dir1/dir2/.csv. /dir1/prifix_.txt

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[FlechazoW]

Can you provide more detail?

[voyagertanyao]

Can you provide more detail?

like this:
NOW, for sftp/ftp source, the config parameter "path" can only be a single file or a directory, e.g.
A: path = "/tmp/user/2023-07-21/"
B: path = "/tmp/user/upload/00000_0.csv"
scene A, we can get all files under path "/tmp/user/2023-07-21/",
scene B, we can get this csv file only under path "/tmp/user/upload/00000_0.csv"

BUT, when I want to get files with format csv(whatever) under a directory, e.g.

I can not config the path parameter like : path = "/tmp/user/2023-07-21/*.csv"
this will lead to error , no such file found xxxxxx

THIS Idea comes from this scene: I just want to get part of files under a certain directory, not all

[FlechazoW]

I got it. I'll follow this issue. Please assign to me.

[chenhaonan313]

I'm also looking for a way to do this scene

[FlechazoW]

PR merged.

[voyagertanyao]

PR merged.

Thanks So much