You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have the following problem running on ddp mode with cometlogger.
When I detach the logger from the trainer (i.e deletinglogger=comet_logger) the code runs.
Exception has occurred: AttributeError
Can't pickle local object 'SummaryTopic.__init__.<locals>.default'
File "/path/multiprocessing/reduction.py", line 60, in dump
ForkingPickler(file, protocol).dump(obj)
File "/path/multiprocessing/popen_spawn_posix.py", line 47, in _launch
reduction.dump(process_obj, fp)
File "/path/multiprocessing/popen_fork.py", line 20, in __init__
self._launch(process_obj)
File "/path/multiprocessing/popen_spawn_posix.py", line 32, in __init__
super().__init__(process_obj)
File "/path/multiprocessing/context.py", line 284, in _Popen
return Popen(process_obj)
File "/path/multiprocessing/process.py", line 112, in start
self._popen = self._Popen(self)
File "/path/site-packages/torch/multiprocessing/spawn.py", line 162, in spawn
process.start()
File "/path/site-packages/pytorch_lightning/trainer/trainer.py", line 751, in fit
mp.spawn(self.ddp_train, nprocs=self.num_processes, args=(model,))
File "/repo_path/train.py", line 158, in main_train
trainer.fit(model)
File "/repo_path/train.py", line 72, in main
main_train(model_class_pointer, hyperparams, logger)
File "/repo_path/train.py", line 167, in <module>
main()
File "/path/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "/path/runpy.py", line 96, in _run_module_code
mod_name, mod_spec, pkg_name, script_name)
File "/path/runpy.py", line 263, in run_path
pkg_name=pkg_name, script_name=fname)
File "/path/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "/path/runpy.py", line 193, in _run_module_as_main
"__main__", mod_spec)
The text was updated successfully, but these errors were encountered:
I have the following problem running on ddp mode with cometlogger.
When I detach the logger from the trainer (i.e deleting
logger=comet_logger
) the code runs.The text was updated successfully, but these errors were encountered: