Enable models to run on multiple CUDA devices #125

WenjieDu · 2023-05-21T14:56:25Z

What does this PR do?

Fixes #121 and #123.

Was this discussed/approved via a GitHub issue? Please add a link to it if that's the case.
I have commented my code, particularly in hard-to-understand areas.
I have written necessary tests and already run them locally.

# Conflicts: # pypots/imputation/saits/model.py

…given_device();

…g on multiple GPUs;

Enable parallel training on multi GPUs

skip multi-gpu test if not multi-gpu host

WenjieDu and others added 21 commits May 18, 2023 12:59

feat: enable SAITS to run on multiple CUDA devices;

80a792a

fix: put raise error under else;

451bd05

fix: put isinstance at the head of the if statement;

24bfbe7

fix: add func_send_data_to_given_device();

0c4254a

docs: add the error message, work not finished;

d23fe98

Merge branch 'dev' into enable_multiGPU_training

4bca033

# Conflicts: # pypots/imputation/saits/model.py

refactor: add funcs _setup_device() and _setup_path();

48dcc96

feat: balance workload between multiple device in func _send_data_to_…

b58d934

…given_device();

feat: enable all models to run on multiple devices;

fda70a8

fix: device could be type of list;

c684303

fix: errors when running on multiple devices;

ae4e8b9

feat: add python 3.8 to testing_ci workflow;

feb31ce

Merge branch 'dev' into enable_multiGPU_training

2fdfa06

fix: error of tensors not on the same device while parallelly trainin…

895a47f

…g on multiple GPUs;

feat: make BaseNNTask classes not inherit from BaseTask classes;

c7cb426

docs: update the docstring of parameter device;

31d0698

feat: add testing cases for training on multiple GPUs;

7112314

Merge pull request #122 from WenjieDu/enable_multiGPU_training

a49676f

Enable parallel training on multi GPUs

skip multi-gpu test if not multi-gpu host

d0625ca

use 2 as required minimum cuda devices for multi-gpu

ca47365

Merge pull request #124 from MaciejSkrabski/update-tests

fe5a358

skip multi-gpu test if not multi-gpu host

WenjieDu merged commit e256d7e into main May 21, 2023