[WIP] Add mammut

[gpucce]

Initial attempts at adding MaMMuT https://arxiv.org/abs/2303.16839

@mehdidc @JeniaJitsev @rom1504 I don´t know marianna github name can you tag her too?

This is the PR, will add all of you as collaborators.

[JeniaJitsev]

Initial attempts at adding MaMMuT https://arxiv.org/abs/2303.16839

@mehdidc @JeniaJitsev @rom1504 I don´t know marianna github name can you tag her too?

This is the PR, will add all of you as collaborators.

@marianna13 is the tag. We have a version in https://github.com/SLAMPAI/open_clip_all_at_once , can add you there to work on fusing everything we got on Mammut.

[gpucce]

@JeniaJitsev sure!