Add GQA support to MPT (and GPT) models#205

Closed

bheilbrun wants to merge 5 commits intoNVIDIA:mainfrom bheilbrun:bheilbrun/mpt-gqa

+74-188

Commits on Nov 12, 2023

support gqa for mpt
bheilbrun
committed

Commits on Nov 13, 2023

fix mpt run.py multi gpu
bheilbrun
committed

Commits on Nov 14, 2023