Skip to content

Commit 599d6db

Browse files
edenlightningcarmoccaethanwharris
authored
Fix Grid run commands (#8021)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com> Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
1 parent cdcc483 commit 599d6db

File tree

1 file changed

+22
-11
lines changed

1 file changed

+22
-11
lines changed
Lines changed: 22 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -1,31 +1,42 @@
11
.. _grid:
22

3-
################
4-
AWS/GCP training
5-
################
3+
##############
4+
Cloud Training
5+
##############
6+
67
Lightning has a native solution for training on AWS/GCP at scale.
78
Go to `grid.ai <https://www.grid.ai/>`_ to create an account.
89

9-
We've designed Grid to work for Lightning users without needing to make ANY changes to their code.
10+
We've designed Grid to work seamlessly with Lightning, without needing to make ANY code changes.
1011

11-
To use grid, take your regular command:
12+
To use Grid, replace ``python`` in your regular command:
1213

1314
.. code-block:: bash
1415
1516
python my_model.py --learning_rate 1e-6 --layers 2 --gpus 4
1617
17-
And change it to use the grid train command:
18+
To use the ``grid run`` command:
1819

1920
.. code-block:: bash
2021
21-
grid train --grid_gpus 4 my_model.py --learning_rate 'uniform(1e-6, 1e-1, 20)' --layers '[2, 4, 8, 16]'
22+
grid run --gpus 4 my_model.py --learning_rate 'uniform(1e-6, 1e-1, 20)' --layers '[2, 4, 8, 16]'
2223
23-
The above command will launch (20 * 4) experiments each running on 4 GPUs (320 GPUs!) - by making ZERO changes to
24+
The above command will launch (20 * 4) experiments, each running on 4 GPUs (320 GPUs!) - by making ZERO changes to
2425
your code.
2526

26-
The `uniform` command is part of our new expressive syntax which lets you construct hyperparameter combinations
27+
The ``uniform`` command is part of our new expressive syntax which lets you construct hyperparameter combinations
2728
using over 20+ distributions, lists, etc. Of course, you can also configure all of this using yamls which
2829
can be dynamically assembled at runtime.
2930

30-
31-
.. hint:: Grid supports the search strategy of your choice! (and much more than just sweeps)
31+
***************
32+
Grid Highlights
33+
***************
34+
35+
* Run any public or private repository with Grid, or use an interactive session.
36+
* Grid allocates all the machines and GPUs you need on demand, so you only pay for what you need when you need it.
37+
* Grid handles all the other parts of developing and training at scale: artifacts, logs, metrics, etc.
38+
* Grid works with the experiment manager of your choice, no code changes needed.
39+
* Use Grid Datastores- high-performance, low-latency, versioned datasets.
40+
* Attach Datastores to a Run so you don't have to keep downloading datasets
41+
* Use Grid Sessions for fast prototyping on a cloud machine of your choice
42+
* For more information check the `grid documentation <https://docs.grid.ai/>`_

0 commit comments

Comments
 (0)