This repository has been archived by the owner on Dec 1, 2021. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 86
Support GCS I/O #1205
Comments
Tasks
Support GCS I/O in each operation
|
This was referenced Sep 14, 2020
bo-mergebot bot
pushed a commit
that referenced
this issue
Sep 15, 2020
## What this patch does to fix the issue. A part of #1205 ## Link to any relevant issues or pull requests.
This was referenced Sep 15, 2020
bo-mergebot bot
pushed a commit
that referenced
this issue
Sep 16, 2020
## What this patch does to fix the issue. Related #1205 * Enable to save pretrain_vars.txt to GCS * Refactor to use file_io module ## Link to any relevant issues or pull requests.
bo-mergebot bot
pushed a commit
that referenced
this issue
Sep 24, 2020
## What this patch does to fix the issue. A part of #1205 ## Link to any relevant issues or pull requests.
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
In Blueoil, we can train with GCS input and save training results to GCS, but other operations (e.g. convert, evaluate...) are not supported with GCS input/output.
Issues
There are many files and operations that depend on input and output directly.
and so on...
We can replace them to support GCS with tensorflow.io.gfile, but some operations need to rewrite several lines. So it is better to add utils of operations of I/O and manage them in a single module.
Targets
There are operations with files/directories directly.
Since it is difficult to manage all of these operations in individual files and manage them separately, it is better to provide a module that aggregates the operations that perform file I/O and change it to use this module for all except special cases.
The text was updated successfully, but these errors were encountered: