Support for BioGPT

[umhau]

I didn't see any prior discussion of this. A few months ago this GPT model was released which seemed to do very well with medical Q&A.

I don't see any indication that it's based on the existing GPT variations. There's a couple demos here: Q&A demo and BioGPT-Large demo.

[PABannier]

@umhau I implemented it here.

@ggerganov Do you want me to open a PR to include BioGPT into the examples? (could be on the ggml repo as well). Note that BioGPT has a few tricks (it's not the exact same as GPT-2), and the tokenizer is different (Moses tokenization + BPE).

[ggerganov]

@PABannier

Sure! Looks great
Let's add it as an example in https://github.com/ggerganov/ggml

[umhau]

Wow, that's awesome. I was totally stuck on that tokenizer.

[evanmiller]

Looks like the example has been added to the docs, closing