Skip to content

Commit

Permalink
Estimator/Keras: use chkpt and logs path in remote store (horovod#3068)
Browse files Browse the repository at this point in the history
Local checkpoint and logs files are pushed into remote store
destination. Print remote store path instead of local path in stdout.

Signed-off-by: Chongxiao Cao <chongxiaoc@uber.com>
  • Loading branch information
chongxiaoc authored Aug 2, 2021
1 parent 4ee6f21 commit 27bdcc9
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion horovod/spark/keras/remote.py
Original file line number Diff line number Diff line change
Expand Up @@ -201,7 +201,7 @@ def train(serialized_model, train_rows, val_rows, avg_row_size):
print(f"Training parameters: Epochs: {epochs}, Scaled lr: {scaled_lr}\n"
f"Train rows: {train_rows}, Train batch size: {batch_size}, Train_steps_per_epoch: {steps_per_epoch}\n"
f"Val rows: {val_rows}, Val batch size: {val_batch_size}, Val_steps_per_epoch: {validation_steps}\n"
f"Checkpoint file: {ckpt_file}, Logs dir: {logs_dir}\n")
f"Checkpoint file: {remote_store.checkpoint_path}, Logs dir: {remote_store.logs_path}\n")
# In general, make_batch_reader is faster than make_reader for reading the dataset.
# However, we found out that make_reader performs data transformations much faster than
# make_batch_reader with parallel worker processes. Therefore, the default reader
Expand Down

0 comments on commit 27bdcc9

Please sign in to comment.