Useful Models To add to MLX Transformers

[ToluClassics]

Creating this issue to keep track of Models that will be nice to have ported:

--> Fuyu : https://huggingface.co/adept/fuyu-8b
--> OpenELM
--> CLIP
--> Whisper
--> SeamlessMT: facebook/seamless-m4t-medium
--> TROCR: microsoft/trocr-large-handwritten
--> LLAVA
--> T5
--> Mistral
--> Idefics: https://huggingface.co/HuggingFaceM4/idefics-9b-instruct/tree/main

[ToluClassics]

Fuyu: #15

[BuildBackBuehler]

Man, I can't believe this wasn't done by the MLX team months ago! Thank you for this, should come in handy. I was going to suggest Mixtral as #1 but then I found this and screamed like a little girl

https://github.com/Goekdeniz-Guelmez/Mixtral-from-scratch-in-MLX

Seems pretty thorough -- sooo if ya see this...thanks @Goekdeniz!

Also donno if there are any tweaks necessary for Llama-3/Mixtral 8x22B but I'd throw those in too. I'll be finding out in a little bit I suppose...and if I catch that/fix it I'll put in a PR

[ToluClassics]

I think Mixtral would be a useful addition for sure!

[ToluClassics]

OpenELM: #17