|
1 | 1 | .. _grid: |
2 | 2 |
|
3 | | -################ |
4 | | -AWS/GCP training |
5 | | -################ |
| 3 | +############## |
| 4 | +Cloud Training |
| 5 | +############## |
| 6 | + |
6 | 7 | Lightning has a native solution for training on AWS/GCP at scale. |
7 | 8 | Go to `grid.ai <https://www.grid.ai/>`_ to create an account. |
8 | 9 |
|
9 | | -We've designed Grid to work for Lightning users without needing to make ANY changes to their code. |
| 10 | +We've designed Grid to work seamlessly with Lightning, without needing to make ANY code changes. |
10 | 11 |
|
11 | | -To use grid, take your regular command: |
| 12 | +To use Grid, replace ``python`` in your regular command: |
12 | 13 |
|
13 | 14 | .. code-block:: bash |
14 | 15 |
|
15 | 16 | python my_model.py --learning_rate 1e-6 --layers 2 --gpus 4 |
16 | 17 |
|
17 | | -And change it to use the grid train command: |
| 18 | +To use the ``grid run`` command: |
18 | 19 |
|
19 | 20 | .. code-block:: bash |
20 | 21 |
|
21 | | - grid train --grid_gpus 4 my_model.py --learning_rate 'uniform(1e-6, 1e-1, 20)' --layers '[2, 4, 8, 16]' |
| 22 | + grid run --gpus 4 my_model.py --learning_rate 'uniform(1e-6, 1e-1, 20)' --layers '[2, 4, 8, 16]' |
22 | 23 |
|
23 | | -The above command will launch (20 * 4) experiments each running on 4 GPUs (320 GPUs!) - by making ZERO changes to |
| 24 | +The above command will launch (20 * 4) experiments, each running on 4 GPUs (320 GPUs!) - by making ZERO changes to |
24 | 25 | your code. |
25 | 26 |
|
26 | | -The `uniform` command is part of our new expressive syntax which lets you construct hyperparameter combinations |
| 27 | +The ``uniform`` command is part of our new expressive syntax which lets you construct hyperparameter combinations |
27 | 28 | using over 20+ distributions, lists, etc. Of course, you can also configure all of this using yamls which |
28 | 29 | can be dynamically assembled at runtime. |
29 | 30 |
|
30 | | - |
31 | | -.. hint:: Grid supports the search strategy of your choice! (and much more than just sweeps) |
| 31 | +*************** |
| 32 | +Grid Highlights |
| 33 | +*************** |
| 34 | + |
| 35 | +* Run any public or private repository with Grid, or use an interactive session. |
| 36 | +* Grid allocates all the machines and GPUs you need on demand, so you only pay for what you need when you need it. |
| 37 | +* Grid handles all the other parts of developing and training at scale: artifacts, logs, metrics, etc. |
| 38 | +* Grid works with the experiment manager of your choice, no code changes needed. |
| 39 | +* Use Grid Datastores- high-performance, low-latency, versioned datasets. |
| 40 | +* Attach Datastores to a Run so you don't have to keep downloading datasets |
| 41 | +* Use Grid Sessions for fast prototyping on a cloud machine of your choice |
| 42 | +* For more information check the `grid documentation <https://docs.grid.ai/>`_ |
0 commit comments