-
Notifications
You must be signed in to change notification settings - Fork 1.7k
Update export/write services for eventual tensor storage #3236
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
I know this will have merge issues with #3234 |
|
Found some issues, removed reviewers while I fix it. |
|
Resolved merge issues post Experiment name/description PR. |
|
|
||
| // Data for the Tensors are stored in a columnar fashion to optimize it for | ||
| // exporting the data into textual formats like JSON. | ||
| // The data for the ith scalar is { steps[i], wall_times[i], values[i] }. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
tensor
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
done
| } | ||
|
|
||
| // Metadata for the TensorPoints stored for one (Experiment, Run, Tag). | ||
| message TensorPointMetadata { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is this used anywhere? It appears forked from ScalarPointMetadata, which is also unused?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Its used in the storage backend, but defined here.
…3236) * Update export/write services to add needed fields & calls for eventual tensor storage
* Update export/write services to add needed fields & calls for eventual tensor storage
Adds fields to experiment, and subsidiary messages for tensor storage issues. Adds the placeholder request/response. I need these definitions to exist for other dependent changes, and hope we can review these in isolation.
This is not adding implementation of these methods.
We may? want to use oneof for the Tag level Scalars or Tensors points