Docs How to Improve performance of flyte #908
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Ketan Umare <ketan.umare@gmail.com>
kumare3
changed the title
Signed-off-by: Ketan Umare <ketan.umare@gmail.com>
EngHabu
reviewed
Apr 13, 2021
| Rule of thumb, for Flytepropeller that has 2GB or memory, should allocate about 512MB-756MB to the input/output cache. | ||
|
|
||
|
|
||
| Scaling out FlyteAdmin |
There was a problem hiding this comment.
When should they scale vertically vs horizontally? maybe link to horizontal autoscaler? is there a good metric to use to scale up horizontally? Maybe request rate?
| Flyteadmin is a stateless service. Often time before needing to scale FlyteAdmin, you need to scale the backing database. Check out the FlyteAdmin Dashboard to see signs of latency degredation and increase the size of backing postgres instance. | ||
| FlyteAdmin is a stateless service and its replicas (in the kubernetes deployment) can be simply increased to allow higher throughput. | ||
|
|
||
| Scaling out Datacatalog |
Comment on lines
+17
to
+19
| #. Round Latency for each workflow increases | ||
| #. Transition latency increases | ||
| #. Workflows take longer to start |
There was a problem hiding this comment.
Links to these metrics in grafana dashboard?
|
|
||
| This is usually because the number of threads in FlytePropeller are not enough to keep up with the number of workflows. This can be resolved by adjusting FlytePropeller config specified `here <https://pkg.go.dev/github.com/flyteorg/flytepropeller@v0.10.3/pkg/controller/config>`_. | ||
|
|
||
| .. list-table:: Important Properties |
There was a problem hiding this comment.
I think for every (most of) property here, we should link to a chart that shows the effect?
There was a problem hiding this comment.
how to link to a chart?
Merged
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this pull request
Dec 20, 2022
* Add blog post links in documentation Signed-off-by: 3t8 <62209650+3t8@users.noreply.github.com> * update configuring_links (flyteorg#905) * update configuring_links Fixes flyteorg#2820 Signed-off-by: SmritiSatyanV smriti@union.ai * update configuring links Changes based on review Signed-off-by: SmritiSatyanV smriti@union.ai Signed-off-by: 3t8 <62209650+3t8@users.noreply.github.com> * Update map_task.py Signed-off-by: 3t8 <62209650+3t8@users.noreply.github.com> * Update cookbook/integrations/external_services/airflow/README.rst Co-authored-by: Samhita Alla <aallasamhita@gmail.com> Signed-off-by: 3t8 <62209650+3t8@users.noreply.github.com> * Update README.rst Signed-off-by: 3t8 <62209650+3t8@users.noreply.github.com> * Update dynamics.py Signed-off-by: 3t8 <62209650+3t8@users.noreply.github.com> * Delete configure_logging_links.py Signed-off-by: 3t8 <62209650+3t8@users.noreply.github.com> * Revert "Delete configure_logging_links.py" This reverts commit 3fda83e4b19340aa930bd22624f8bb2c068031a7. Restore configure_logging_links Signed-off-by: 3t8 <62209650+3t8@users.noreply.github.com> Signed-off-by: 3t8 <62209650+3t8@users.noreply.github.com> Co-authored-by: SmritiSatyanV <94349093+SmritiSatyanV@users.noreply.github.com> Co-authored-by: Samhita Alla <aallasamhita@gmail.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Signed-off-by: Ketan Umare ketan.umare@gmail.com