-
Notifications
You must be signed in to change notification settings - Fork 61
Conversation
core.QualityOfService quality_of_service = 16; | ||
|
||
// Prefix for where offloaded data from user workflows will be written (ie Blobs, Schema, query data, etc.) | ||
string output_data_prefix = 17; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
can we keep the naming consistent? call it raw_outputdata_prefix
In the docstring it can be, of the format
s3://bucket/key
OR s3://bucket/
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
sure but what's raw about it?
|
||
// Prefix for where offloaded data from user workflows will be written (i.e. Blobs, Schema, query data, etc.) | ||
// e.g. s3://bucket/key or s3://bucket/ | ||
string raw_output_data_prefix = 17; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
on thinking more, maybe this should be a structure. As we may want to add the policy like
Sharding desired: True
etc
...
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
what else would go in?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Lgtm
TL;DR
Please replace this text with a description of what this PR accomplishes.
Type
Are all requirements met?
Complete description
How did you fix the bug, make the feature etc. Link to any design docs etc
Tracking Issue
flyteorg/flyte#211
Follow-up issue
NA