Discussions

• 1 You must be logged in to vote

  💬

  Elegant way to properly calculate training loss when model uses dropout

  adosar started Jul 11, 2024 in General

  

  

  0
• 2 You must be logged in to vote

  🤖

  Determine main process in distributed training

  PgLoLo asked Feb 2, 2022 in DDP / multi-GPU / multi-node · Unanswered

  

  

  

  

  5
• 4 You must be logged in to vote

  🤖

  rank_zero only logic

  itzsimpl asked Mar 4, 2024 in DDP / multi-GPU / multi-node · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🤖

  Hyperparameter Optimization with DDP

  gojkopero asked Jul 4, 2024 in DDP / multi-GPU / multi-node · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🤖

  Sharded data loading with DDP

  niansong1996 asked Aug 7, 2021 in DDP / multi-GPU / multi-node · Unanswered

  

  

  

  

  2
• 2 You must be logged in to vote

  ⚡

  Running dataloader concurrently in CPU with the model (in GPU) using pytorch lightning

  jmoork asked May 12, 2023 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💡

  Use shtab for CLI completion

  tshu-w started Dec 1, 2021 in Idea pool

  

  

  9
• 3 You must be logged in to vote

  🤖

  [E socket.cpp:922] [c10d] The client socket has timed out after 1800s

  kfoynt asked Jan 10, 2024 in DDP / multi-GPU / multi-node · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🤖

  How to get access to DDP functions before initializing trainer?

  seermer asked Jun 20, 2024 in DDP / multi-GPU / multi-node · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  When using CLI mode, is there any method to save the config.yaml file in the checkpoint dir path?

  zengchang233 started Jun 18, 2024 in General

  

  

  1
• 3 You must be logged in to vote

  ⚡

  Preferred way to freeze a backbone, train for several steps, unfreeze the backbone, and continue training on all parameters.

  isaacgerg asked Jun 20, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ⚡

  How to pass a reference to a function in yaml config file

  lightningcli pl.cli.LightningCLI pl Generic label for PyTorch Lightning package

  kenenbek asked Jul 12, 2022 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  

  

  14
• 1 You must be logged in to vote

  🤖

  How to set up DDP correctly if processes are created externally & CUDA_VISIBLE_DEVICES is set

  yongsiang-fb asked Jul 19, 2022 in DDP / multi-GPU / multi-node · Unanswered

  

  

  

  

  5
• 1 You must be logged in to vote

  ⚡

  How to redefine optimizer for pl.LightningModule?

  Godofnothing asked Sep 7, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  

  

  6
• 1 You must be logged in to vote

  🤖

  seconds/iteration is fast in first epoch, gets slower every subsequent epoch

  angadkalra asked Jul 30, 2021 in DDP / multi-GPU / multi-node · Unanswered

  

  

  

  

  15
• 1 You must be logged in to vote

  ⚡

  Learning rate finder using Lightning CLI

  theja-vanka asked May 23, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Closed · Unanswered

  

  

  

  

  6
• 2 You must be logged in to vote

  ⚡

  LightningCLI - instantiate model from config

  i008 asked Nov 4, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  

  

  15
• 8 You must be logged in to vote

  💬

  lightning vs pytorch-lightning

  adamjstewart started Mar 15, 2023 in General

  

  

  

  

  15
• 2 You must be logged in to vote

  ⚡

  How do I pass metric to tensorboards hparam interface

  mm04926412 asked Dec 11, 2020 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  

  

  7
• 1 You must be logged in to vote

  ⚡

  deterministic torch.random.random_split

  mshooter asked Jun 4, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  1
• 3 You must be logged in to vote

  ⚡

  How to log hyperparams, so they can be viewed in "HPARAMS" tab of Tensorboard?

  adosar asked Jun 8, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  JAX-like / torch.func-style implementations with Lightning ?

  mchagneux started Jun 3, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  💬

  I just want the self.log to print on stdout but do not clear it out

  braindevices started Jun 2, 2024 in General

  

  

  0
• 7 You must be logged in to vote

  ⚡

  Callback for logging forward, backward and update time

  MattMcPartlon asked May 31, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  0
• 3 You must be logged in to vote

  🤖

  DDP, MPIEnv and numdevices

  timocafe asked May 31, 2024 in DDP / multi-GPU / multi-node · Unanswered

  

  

  0