Relationship with EleutherAI/GPT-J ?

[tpoisonooo]

Thanks for your open-source model and paper, its great.

llama.cpp hack in one night noticed that it has a very similar architecture to GPT-J .

No offense, are you just train it with trivial modification and multiple opensource dataset ?

[bth5032]

A lot of the llms are extremely similar architecture wise. The training process and resultant model are the novel contributions, not the architecture.

[tpoisonooo]

Ah.. facebook is rich, that is all I read from the LLaMa paper ..