Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Doc] Add data ingestion clarification for AIR converting existing pytorch code example #32058

Merged
merged 4 commits into from
Feb 13, 2023
Merged

[Doc] Add data ingestion clarification for AIR converting existing pytorch code example #32058

Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
55e066b
Add clarification on data ingestion in converting pytorch code demo
Jan 30, 2023
f8225cf
polish explaination & add links
Jan 30, 2023
be41205
Update doc/source/ray-air/examples/convert_existing_pytorch_code_to_r…
woshiyyya Feb 6, 2023
a59f267
Merge branch 'master' into doc/clarify_pytorch_demo_data_ingest
Feb 10, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 7 additions & 4 deletions doc/source/ray-air/examples/convert_existing_pytorch_code_to_ray_air.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -59,11 +59,14 @@
]
},
{
"attachments": {},
"cell_type": "markdown",
"id": "db36ae56",
"metadata": {},
"source": [
"Then we download the data:"
"Then we download the data: \n",
"\n",
"This tutorial assumes that your existing code is using the `torch.utils.data.Dataset` native to PyTorch. It continues to use `torch.utils.data.Dataset` to allow you to make as few code changes as possible. **This tutorial also runs with Ray Data, which gives you the benefits of efficient parallel preprocessing.** See an example of using Ray Data for the CIFAR-10 dataset {doc}`here </ray-air/examples/torch_image_example>`."
]
},
{
Expand Down Expand Up @@ -1300,7 +1303,7 @@
],
"metadata": {
"kernelspec": {
"display_name": "Python 3.8.10 ('venv': venv)",
"display_name": "Python 3",
"language": "python",
"name": "python3"
},
Expand All @@ -1314,11 +1317,11 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.8.10"
"version": "3.9.6 (default, Oct 18 2022, 12:41:40) \n[Clang 14.0.0 (clang-1400.0.29.202)]"
},
"vscode": {
"interpreter": {
"hash": "3c0d54d489a08ae47a06eae2fd00ff032d6cddb527c382959b7b2575f6a8167f"
"hash": "31f2aee4e71d21fbe5cf8b01ff0e069b9275f58929596ceb00d14d90e3e16cd6"
}
}
},
Expand Down