Skip to content
This repository was archived by the owner on Aug 1, 2025. It is now read-only.

Conversation

@bdhirsh
Copy link
Contributor

@bdhirsh bdhirsh commented Aug 26, 2022

fresh PR without ghstack. Before landing, I still need to

(1) rebase on top of #1048
(2) mark the 6 new failing models as skips (and create issues tracking them)

@desertfire
Copy link
Contributor

If you are talking about marking 6 new failing model to the CI skip list, you can wait for my #1040 to land. Also did you test on hf and timm as well?

@bdhirsh
Copy link
Contributor Author

bdhirsh commented Aug 26, 2022

@desertfire thanks, I'll wait for your PR to land and add to the skip list.

Also did you test on hf and timm as well?

Yep - I ran the hf and timm benchmarks locally with the before and after, as a sanity check that functionalization isn't regressing a large number of models. I'm not 100% confident in my results (a few models didn't run at all for some reason), but I counted a total of 8 new failures from HF, and 4 new failures from timm.

Once this PR lands I'll work on triaging the failures and making issues for them.

@bdhirsh bdhirsh force-pushed the turn_on_only_functionalization2 branch from b9afe9d to 98e1fd8 Compare August 26, 2022 21:34
@bdhirsh
Copy link
Contributor Author

bdhirsh commented Aug 26, 2022

looks like CI is getting rate limited

@bdhirsh bdhirsh merged commit 2b6db3b into main Aug 27, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants