Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Torch2 #177

Merged
merged 25 commits into from
May 19, 2023
Merged

Torch2 #177

merged 25 commits into from
May 19, 2023

Conversation

vchiley
Copy link
Contributor

@vchiley vchiley commented May 19, 2023

moving work from fork

@vchiley vchiley merged commit ef4d0d8 into mosaicml:vitaliy/torch2 May 19, 2023
mvpatel2000 pushed a commit that referenced this pull request May 19, 2023
* Torch2 (#177)

* make triton attn req mlri tagged triton

* add comment

* updt err

* clean up req / install

* updt

* updt

* exclude HazyR flash attn from pyright

* lint

* exclude flash_attn_triton.py from pyright

* updt torch version

* updt install instructions

* updt

* add extra install instructions for installing CMake

* lint

* updt

* updt torch

* updt

* adding torch1.13 and torch2 testing matrix

* Update pr-gpu.yaml

* Update test_model.py

* Update pr-cpu.yaml

* Update pr-gpu.yaml

* Update test_dataloader.py

* Update pr-gpu.yaml
dakinggg added a commit to dakinggg/llm-foundry that referenced this pull request May 20, 2023
dakinggg added a commit that referenced this pull request May 20, 2023
vchiley added a commit to vchiley/llm-foundry that referenced this pull request May 22, 2023
vchiley added a commit that referenced this pull request May 24, 2023
* fix and test

* Revert "Revert "Torch2 (#177) (#178)" (#181)"

This reverts commit 89f56d2.

* updt import try except

* updt hf model

* updt imports

* lint

* add mpt hf model init / gen test

* updt for temp testing

* lint

* rerun tests

* Update .github/workflows/release.yaml

Co-authored-by: Daniel King <43149077+dakinggg@users.noreply.github.com>

* Update tests/test_hf_mpt_gen.py

Co-authored-by: Daniel King <43149077+dakinggg@users.noreply.github.com>

* add cpu test

* updt tests / cpu img

* updt cpu test install

* rerun tests

* fix hf import structure

* fix test

* pull_request -> pull_request_target

* make onnx test smaller

---------

Co-authored-by: Daniel King <daniel@mosaicml.com>
Co-authored-by: Daniel King <43149077+dakinggg@users.noreply.github.com>
bmosaicml pushed a commit that referenced this pull request Jun 6, 2023
bmosaicml pushed a commit that referenced this pull request Jun 6, 2023
* Torch2 (#177)

* make triton attn req mlri tagged triton

* add comment

* updt err

* clean up req / install

* updt

* updt

* exclude HazyR flash attn from pyright

* lint

* exclude flash_attn_triton.py from pyright

* updt torch version

* updt install instructions

* updt

* add extra install instructions for installing CMake

* lint

* updt

* updt torch

* updt

* adding torch1.13 and torch2 testing matrix

* Update pr-gpu.yaml

* Update test_model.py

* Update pr-cpu.yaml

* Update pr-gpu.yaml

* Update test_dataloader.py

* Update pr-gpu.yaml
bmosaicml pushed a commit that referenced this pull request Jun 8, 2023
bmosaicml pushed a commit that referenced this pull request Jun 8, 2023
* fix and test

* Revert "Revert "Torch2 (#177) (#178)" (#181)"

This reverts commit 601d61a.

* updt import try except

* updt hf model

* updt imports

* lint

* add mpt hf model init / gen test

* updt for temp testing

* lint

* rerun tests

* Update .github/workflows/release.yaml

Co-authored-by: Daniel King <43149077+dakinggg@users.noreply.github.com>

* Update tests/test_hf_mpt_gen.py

Co-authored-by: Daniel King <43149077+dakinggg@users.noreply.github.com>

* add cpu test

* updt tests / cpu img

* updt cpu test install

* rerun tests

* fix hf import structure

* fix test

* pull_request -> pull_request_target

* make onnx test smaller

---------

Co-authored-by: Daniel King <daniel@mosaicml.com>
Co-authored-by: Daniel King <43149077+dakinggg@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant