Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert "Torch2 (#177) (#178)" #181

Merged
merged 1 commit into from
May 20, 2023
Merged

Conversation

dakinggg
Copy link
Collaborator

This reverts commit bb7f8bb.

We are temporarily reverting the change to support torch2, because it needs to be synced with a change to the models on the huggingface hub, otherwise mosaicml/mpt-7b cannot be used after installing foundry from main. Additionally, a change to (and probably a test for) the convert_composer_to_hf.py script is needed, as the new relative import inside a function is not getting parsed properly.

Copy link
Contributor

@vchiley vchiley left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

😢

@dakinggg dakinggg merged commit 89f56d2 into mosaicml:main May 20, 2023
@germanjke
Copy link

i have some problems from you datasets folder and datasets library, i just renamed your folder, it's was circular import error

@germanjke
Copy link

@vchiley what's about use of mpt from your torch2.0 branch? it will be installed right?

vchiley added a commit to vchiley/llm-foundry that referenced this pull request May 22, 2023
vchiley added a commit that referenced this pull request May 24, 2023
* fix and test

* Revert "Revert "Torch2 (#177) (#178)" (#181)"

This reverts commit 89f56d2.

* updt import try except

* updt hf model

* updt imports

* lint

* add mpt hf model init / gen test

* updt for temp testing

* lint

* rerun tests

* Update .github/workflows/release.yaml

Co-authored-by: Daniel King <43149077+dakinggg@users.noreply.github.com>

* Update tests/test_hf_mpt_gen.py

Co-authored-by: Daniel King <43149077+dakinggg@users.noreply.github.com>

* add cpu test

* updt tests / cpu img

* updt cpu test install

* rerun tests

* fix hf import structure

* fix test

* pull_request -> pull_request_target

* make onnx test smaller

---------

Co-authored-by: Daniel King <daniel@mosaicml.com>
Co-authored-by: Daniel King <43149077+dakinggg@users.noreply.github.com>
@dakinggg dakinggg deleted the revert-torch2 branch June 1, 2023 00:11
bmosaicml pushed a commit that referenced this pull request Jun 6, 2023
allow users to set custom groups for finetuning
bmosaicml pushed a commit that referenced this pull request Jun 8, 2023
bmosaicml pushed a commit that referenced this pull request Jun 8, 2023
* fix and test

* Revert "Revert "Torch2 (#177) (#178)" (#181)"

This reverts commit 601d61a.

* updt import try except

* updt hf model

* updt imports

* lint

* add mpt hf model init / gen test

* updt for temp testing

* lint

* rerun tests

* Update .github/workflows/release.yaml

Co-authored-by: Daniel King <43149077+dakinggg@users.noreply.github.com>

* Update tests/test_hf_mpt_gen.py

Co-authored-by: Daniel King <43149077+dakinggg@users.noreply.github.com>

* add cpu test

* updt tests / cpu img

* updt cpu test install

* rerun tests

* fix hf import structure

* fix test

* pull_request -> pull_request_target

* make onnx test smaller

---------

Co-authored-by: Daniel King <daniel@mosaicml.com>
Co-authored-by: Daniel King <43149077+dakinggg@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants