-
Notifications
You must be signed in to change notification settings - Fork 276
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Python-native typing support #136
Conversation
flytekit/annotated/stuff.py
Outdated
retries=0, | ||
interruptible=None, | ||
deprecated='', | ||
storage_request=None, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
i want to club the requests and limits as structs. This simplifies adding new ones
flytekit/annotated/stuff.py
Outdated
cpu_limit=None, | ||
gpu_limit=None, | ||
memory_limit=None, | ||
cache=False, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
samething for cache?
flytekit/annotated/sample.py
Outdated
@workflow(outputs=["real_b"]) | ||
def my_workflow() -> WorkflowOutputs: | ||
# a = x(s=3) | ||
b = x(s=x(s=3)) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
can we get a little more complex example, where we have 3 nodes, multiple outputs and inputs?
Codecov Report
@@ Coverage Diff @@
## master #136 +/- ##
==========================================
- Coverage 80.88% 80.41% -0.47%
==========================================
Files 225 235 +10
Lines 14669 15441 +772
Branches 1204 1323 +119
==========================================
+ Hits 11865 12417 +552
- Misses 2521 2706 +185
- Partials 283 318 +35
Continue to review full report at Codecov.
|
Codecov Report
@@ Coverage Diff @@
## master #136 +/- ##
=======================================
Coverage 96.00% 96.00%
=======================================
Files 2 2
Lines 75 75
Branches 8 8
=======================================
Hits 72 72
Misses 1 1
Partials 2 2 Continue to review full report at Codecov.
|
* comparison working with operator overloading * Branching work in progress * Complete evaluation * Branches working * All conditional cases * Update flytekit/common/workflow.py Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * fixed one comment * Fixes to execution state Co-authored-by: Ketan Umare <kumare@lyft.com> Co-authored-by: Ketan Umare <16888709+kumare3@users.noreply.github.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Oh My God! Hurrah!
Fixes #3680; this pin was added in flyteorg#136: https://github.com/flyteorg/flytekit/pull/136/files#diff-60f61ab7a8d1910d86d9fda2261620314edcae5894d5aaa236b821c7256badd7R18 ~3 years ago when the latest pandas version was 1.2.1; flytekit is not using any features that have broken any of its tests in upgrading to use pandas >=2.0.0
Fixes #3680; this pin was added in flyteorg#136: https://github.com/flyteorg/flytekit/pull/136/files#diff-60f61ab7a8d1910d86d9fda2261620314edcae5894d5aaa236b821c7256badd7R18 ~3 years ago when the latest pandas version was 1.2.1; flytekit is not using any features that have broken any of its tests in upgrading to use pandas >=2.0.0 Signed-off-by: Matthew Hoffman <matthew@protopia.ai>
TL;DR
Please see the proposal doc at https://docs.google.com/document/d/17rNKg6Uvow8CrECaPff96Tarr87P2fn4ilf_Tv2lYd4
https://flytecookbook.readthedocs.io/en/latest/
Type
Are all requirements met?