Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extending "AWS S3 Plugin" functionality. #1313

Closed
AliakseiTsiarnouski opened this issue Jan 6, 2021 · 0 comments · Fixed by #1350
Closed

Extending "AWS S3 Plugin" functionality. #1313

AliakseiTsiarnouski opened this issue Jan 6, 2021 · 0 comments · Fixed by #1350
Assignees
Labels
feature New feature or request
Milestone

Comments

@AliakseiTsiarnouski
Copy link

AliakseiTsiarnouski commented Jan 6, 2021

I would like to have a new steps, that will wait for newFile appearance with predefined path in S3 folders or time.

1 step for file finding:

  • possibility to set time frame that predict when file appeared in the "expected folder" (ex. I upload a new file in 14:40 and expect that file should be in another folder in 14:40 or 41 min)
    when such file appearc -> file should be downloaded and filename saved as a variable/might be parsed by another steps.

2 step for file finding:

  • it might be possible to set waitTime and do checks weather it already exists or not (ex. every 5 sec or not more than 60 times)
  • would be great to have possibilities to concretize fileName or its part (ex. I wait for the file into the "internal folder"
    Amazon S3
    (full filename = OneBatch.xml)
    would be grate to set part(OneBatch) and find expected file
    and mix name parts for finding (ex. based on fileName above -> contains(HP) and contains (.xml) )
@AliakseiTsiarnouski AliakseiTsiarnouski added the feature New feature or request label Jan 6, 2021
@valfirst valfirst self-assigned this Jan 16, 2021
@valfirst valfirst added this to the 0.3.0 milestone Jan 16, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants