Concentrating on extensively testing this. Using Transformers since it has many issues working on Apple Silicon.
- The original TorchDevice has become too large and refactoring before continuing testing.
- Wanted to make this interim release which works with most things available.
- Works with most things, though still finding parameter mismatches and other issues.
- Methodically working through the Transformers Regression tests using TorchDevice to redirect CUDA and CPU to MPS for Apple Silicon
- This is not just for CUDA -> MPS migration, it will spot and log a message when it performs a GPU redirect.
- Should, though I don't have CUDA hardware to work with be compatible with CUDA devices
- Should also allow MPS -> CUDA transition as well.
Project Goal is to ease migration from one hardware architecture to another since it should "just work" and alert developers where code needs to be changed or fixed.