Flush logs to disk as soon as possible

[nguyentanthong]

torchtune/torchtune/utils/metric_logging.py

Lines 98 to 105 in 0c4056a

	def log(self, name: str, data: Scalar, step: int) -> None:
	self._file.write(f"Step {step} | {name}:{data}\n")
	def log_dict(self, payload: Mapping[str, Scalar], step: int) -> None:
	self._file.write(f"Step {step} | ")
	for name, data in payload.items():
	self._file.write(f"{name}:{data} ")
	self._file.write("\n")

Current implementation does not flush the log to disk right away. It is better if we add

self._file.flush()

at the end of these logging methods.

[felipemello1]

hey @nguyentanthong , thanks for bringing this up! I will look at it this week. If you are interested in contributing, please feel free to submit PR + testing, describing the issue and your solution.

[ebsmothers]

Resolved by #1078