-
Notifications
You must be signed in to change notification settings - Fork 690
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BUG] Configuring ephemeral-storage request/limits for Flyte tasks #494
Comments
Thank you @rstanevich, we will track it for the next release |
This was referenced Aug 3, 2021
This was referenced Aug 9, 2021
20 tasks
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Dec 6, 2022
* Add configurable UTC timezone option for scheduler Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * Add comments for default behavior Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Dec 20, 2022
* fix: support mapped tasks #none Signed-off-by: James <james@union.ai> * fix: fix comments #none Signed-off-by: James <james@union.ai> * fix: fix unit test #none Signed-off-by: James <james@union.ai> * fix: add string constants #none Signed-off-by: James <james@union.ai> * fix: added test for mapInputHelper #none Signed-off-by: James <james@union.ai> * fix: fix test for utils.test.ts #none Signed-off-by: James <james@union.ai> * chore: trigger snyk re-run * fix: multiple keys for mapped types; #none Signed-off-by: James <james@union.ai> * chore: storybook item (flyteorg#530) Signed-off-by: Nastya Rusina <nastya@union.ai> * fix: fix validation for duplicate and fix focus issue Signed-off-by: James <james@union.ai> * chore: provide previous run values on relaunch Signed-off-by: Nastya Rusina <nastya@union.ai> Co-authored-by: Nastya <55718143+anrusina@users.noreply.github.com> Co-authored-by: Nastya Rusina <nastya@union.ai>
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Aug 21, 2023
* Add configurable UTC timezone option for scheduler Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * Add comments for default behavior Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Describe the bug
A Python task has an option to define
storage_request
andstorage_limit
at the arguments: SourceBut these values don't appear in the requests/limits parameters of k8s Pod.
Expected behavior
An option to specify
ephemeral-storage
requests/limits for the Pod running in Kubernetes.https://kubernetes.io/docs/concepts/configuration/manage-resources-containers/#local-ephemeral-storage
Flyte component
To Reproduce
Steps to reproduce the behavior:
storage_request
:FlyteWorkflow
CRD instance has these requests parameters in thetasks
section:nodes
section in theFlyteWorkflow
instance and createdPod
specification don't haveephemeral-storage
requests:Environment
Flyte component
Additional context
Discussed with @kumare3 in the Slack. He suggested to file an issue for storage support.
The use case example: a task in which we expect a huge file with geographic data which is very problematic to split.
The text was updated successfully, but these errors were encountered: