|
1 |
| -<div align="center"> |
2 |
| - |
3 | 1 | # Supported Examples
|
4 | 2 |
|
5 |
| -<div align="left"> |
6 |
| - |
7 | 3 | This document introduces the supported examples of GenAIExamples. The supported Vector Database, LLM models, serving frameworks and hardwares are listed as below.
|
8 | 4 |
|
9 | 5 | ## ChatQnA
|
10 | 6 |
|
11 | 7 | [ChatQnA](./ChatQnA/README.md) is an example of chatbot for question and answering through retrieval augmented generation (RAG).
|
12 | 8 |
|
13 |
| -<table> |
14 |
| - <tbody> |
15 |
| - <tr> |
16 |
| - <td>Framework</td> |
17 |
| - <td>LLM</td> |
18 |
| - <td>Embedding</td> |
19 |
| - <td>Vector Database</td> |
20 |
| - <td>Serving</td> |
21 |
| - <td>HW</td> |
22 |
| - <td>Description</td> |
23 |
| - </tr> |
24 |
| - <tr> |
25 |
| - <td><a href="https://www.langchain.com">LangChain</a>/<a href="https://www.llamaindex.ai">LlamaIndex</a></td> |
26 |
| - <td><a href="https://huggingface.co/Intel/neural-chat-7b-v3-3">NeuralChat-7B</a></td> |
27 |
| - <td><a href="https://huggingface.co/BAAI/bge-base-en">BGE-Base</a></td> |
28 |
| - <td><a href="https://redis.io/">Redis</a></td> |
29 |
| - <td><a href="https://github.com/huggingface/text-generation-inference">TGI</a> <a href="https://github.com/huggingface/text-embeddings-inference">TEI</a></td> |
30 |
| - <td>Xeon/Gaudi2/GPU</td> |
31 |
| - <td>Chatbot</td> |
32 |
| - </tr> |
33 |
| - <tr> |
34 |
| - <td><a href="https://www.langchain.com">LangChain</a>/<a href="https://www.llamaindex.ai">LlamaIndex</a></td> |
35 |
| - <td><a href="https://huggingface.co/Intel/neural-chat-7b-v3-3">NeuralChat-7B</a></td> |
36 |
| - <td><a href="https://huggingface.co/BAAI/bge-base-en">BGE-Base</a></td> |
37 |
| - <td><a href="https://www.trychroma.com/">Chroma</a></td> |
38 |
| - <td><a href="https://github.com/huggingface/text-generation-inference">TGI</a> <a href="https://github.com/huggingface/text-embeddings-inference">TEI</td> |
39 |
| - <td>Xeon/Gaudi2</td> |
40 |
| - <td>Chatbot</td> |
41 |
| - </tr> |
42 |
| - <tr> |
43 |
| - <td><a href="https://www.langchain.com">LangChain</a>/<a href="https://www.llamaindex.ai">LlamaIndex</a></td> |
44 |
| - <td><a href="https://huggingface.co/mistralai/Mistral-7B-v0.1">Mistral-7B</a></td> |
45 |
| - <td><a href="https://huggingface.co/BAAI/bge-base-en">BGE-Base</a></td> |
46 |
| - <td><a href="https://redis.io/">Redis</a></td> |
47 |
| - <td><a href="https://github.com/huggingface/text-generation-inference">TGI</a> <a href="https://github.com/huggingface/text-embeddings-inference">TEI</td> |
48 |
| - <td>Xeon/Gaudi2</td> |
49 |
| - <td>Chatbot</td> |
50 |
| - </tr> |
51 |
| - <tr> |
52 |
| - <td><a href="https://www.langchain.com">LangChain</a>/<a href="https://www.llamaindex.ai">LlamaIndex</a></td> |
53 |
| - <td><a href="https://huggingface.co/mistralai/Mistral-7B-v0.1">Mistral-7B</a></td> |
54 |
| - <td><a href="https://huggingface.co/BAAI/bge-base-en">BGE-Base</a></td> |
55 |
| - <td><a href="https://qdrant.tech/">Qdrant</a></td> |
56 |
| - <td><a href="https://github.com/huggingface/text-generation-inference">TGI</a> <a href="https://github.com/huggingface/text-embeddings-inference">TEI</td> |
57 |
| - <td>Xeon/Gaudi2</td> |
58 |
| - <td>Chatbot</td> |
59 |
| - </tr> |
60 |
| - <tr> |
61 |
| - <td><a href="https://www.langchain.com">LangChain</a>/<a href="https://www.llamaindex.ai">LlamaIndex</a></td> |
62 |
| - <td><a href="https://huggingface.co/Qwen/Qwen2-7B">Qwen2-7B</a></td> |
63 |
| - <td><a href="https://huggingface.co/BAAI/bge-base-en">BGE-Base</a></td> |
64 |
| - <td><a href="https://redis.io/">Redis</a></td> |
65 |
| - <td><a href=<a href="https://github.com/huggingface/text-embeddings-inference">TEI</td> |
66 |
| - <td>Xeon/Gaudi2</td> |
67 |
| - <td>Chatbot</td> |
68 |
| - </tr> |
69 |
| - </tbody> |
70 |
| -</table> |
| 9 | +| Framework | LLM | Embedding | Vector Database | Serving | HW | Description | |
| 10 | +| ------------------------------------------------------------------------------ | ----------------------------------------------------------------- | --------------------------------------------------- | ------------------------------------ | ------------------------------------------------------------------------------------------------------------------------------- | --------------- | ----------- | |
| 11 | +| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [NeuralChat-7B](https://huggingface.co/Intel/neural-chat-7b-v3-3) | [BGE-Base](https://huggingface.co/BAAI/bge-base-en) | [Redis](https://redis.io/) | [TGI](https://github.com/huggingface/text-generation-inference) [TEI](https://github.com/huggingface/text-embeddings-inference) | Xeon/Gaudi2/GPU | Chatbot | |
| 12 | +| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [NeuralChat-7B](https://huggingface.co/Intel/neural-chat-7b-v3-3) | [BGE-Base](https://huggingface.co/BAAI/bge-base-en) | [Chroma](https://www.trychroma.com/) | [TGI](https://github.com/huggingface/text-generation-inference) [TEI](https://github.com/huggingface/text-embeddings-inference) | Xeon/Gaudi2 | Chatbot | |
| 13 | +| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [Mistral-7B](https://huggingface.co/mistralai/Mistral-7B-v0.1) | [BGE-Base](https://huggingface.co/BAAI/bge-base-en) | [Redis](https://redis.io/) | [TGI](https://github.com/huggingface/text-generation-inference) [TEI](https://github.com/huggingface/text-embeddings-inference) | Xeon/Gaudi2 | Chatbot | |
| 14 | +| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [Mistral-7B](https://huggingface.co/mistralai/Mistral-7B-v0.1) | [BGE-Base](https://huggingface.co/BAAI/bge-base-en) | [Qdrant](https://qdrant.tech/) | [TGI](https://github.com/huggingface/text-generation-inference) [TEI](https://github.com/huggingface/text-embeddings-inference) | Xeon/Gaudi2 | Chatbot | |
| 15 | +| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [Qwen2-7B](https://huggingface.co/Qwen/Qwen2-7B) | [BGE-Base](https://huggingface.co/BAAI/bge-base-en) | [Redis](https://redis.io/) | [TEI](https://github.com/huggingface/text-embeddings-inference) | Xeon/Gaudi2 | Chatbot | |
71 | 16 |
|
72 | 17 | ### CodeGen
|
73 | 18 |
|
74 | 19 | [CodeGen](./CodeGen/README.md) is an example of copilot designed for code generation in Visual Studio Code.
|
75 | 20 |
|
76 |
| -<table> |
77 |
| - <tbody> |
78 |
| - <tr> |
79 |
| - <td>Framework</td> |
80 |
| - <td>LLM</td> |
81 |
| - <td>Serving</td> |
82 |
| - <td>HW</td> |
83 |
| - <td>Description</td> |
84 |
| - </tr> |
85 |
| - <tr> |
86 |
| - <td><a href="https://www.langchain.com">LangChain</a>/<a href="https://www.llamaindex.ai">LlamaIndex</a></td> |
87 |
| - <td><a href="https://huggingface.co/meta-llama/CodeLlama-7b-hf">meta-llama/CodeLlama-7b-hf</a></td> |
88 |
| - <td><a href="https://github.com/huggingface/text-generation-inference">TGI</a></td> |
89 |
| - <td>Xeon/Gaudi2</td> |
90 |
| - <td>Copilot</td> |
91 |
| - </tr> |
92 |
| - </tbody> |
93 |
| -</table> |
| 21 | +| Framework | LLM | Serving | HW | Description | |
| 22 | +| ------------------------------------------------------------------------------ | ------------------------------------------------------------------------------- | --------------------------------------------------------------- | ----------- | ----------- | |
| 23 | +| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [meta-llama/CodeLlama-7b-hf](https://huggingface.co/meta-llama/CodeLlama-7b-hf) | [TGI](https://github.com/huggingface/text-generation-inference) | Xeon/Gaudi2 | Copilot | |
94 | 24 |
|
95 | 25 | ### CodeTrans
|
96 | 26 |
|
97 | 27 | [CodeTrans](./CodeTrans/README.md) is an example of chatbot for converting code written in one programming language to another programming language while maintaining the same functionality.
|
98 | 28 |
|
99 |
| -<table> |
100 |
| - <tbody> |
101 |
| - <tr> |
102 |
| - <td>Framework</td> |
103 |
| - <td>LLM</td> |
104 |
| - <td>Serving</td> |
105 |
| - <td>HW</td> |
106 |
| - <td>Description</td> |
107 |
| - </tr> |
108 |
| - <tr> |
109 |
| - <td><a href="https://www.langchain.com">LangChain</a>/<a href="https://www.llamaindex.ai">LlamaIndex</a></td> |
110 |
| - <td><a href="https://huggingface.co/HuggingFaceH4/mistral-7b-grok">HuggingFaceH4/mistral-7b-grok</a></td> |
111 |
| - <td><a href="https://github.com/huggingface/text-generation-inference">TGI</a></td> |
112 |
| - <td>Xeon/Gaudi2</td> |
113 |
| - <td>Code Translation</td> |
114 |
| - </tr> |
115 |
| - </tbody> |
116 |
| -</table> |
| 29 | +| Framework | LLM | Serving | HW | Description | |
| 30 | +| ------------------------------------------------------------------------------ | ------------------------------------------------------------------------------------- | --------------------------------------------------------------- | ----------- | ---------------- | |
| 31 | +| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [HuggingFaceH4/mistral-7b-grok](https://huggingface.co/HuggingFaceH4/mistral-7b-grok) | [TGI](https://github.com/huggingface/text-generation-inference) | Xeon/Gaudi2 | Code Translation | |
117 | 32 |
|
118 | 33 | ### DocSum
|
119 | 34 |
|
120 | 35 | [DocSum](./DocSum/README.md) is an example of chatbot for summarizing the content of documents or reports.
|
121 | 36 |
|
122 |
| -<table> |
123 |
| - <tbody> |
124 |
| - <tr> |
125 |
| - <td>Framework</td> |
126 |
| - <td>LLM</td> |
127 |
| - <td>Serving</td> |
128 |
| - <td>HW</td> |
129 |
| - <td>Description</td> |
130 |
| - </tr> |
131 |
| - <tr> |
132 |
| - <td><a href="https://www.langchain.com">LangChain</a>/<a href="https://www.llamaindex.ai">LlamaIndex</a></td> |
133 |
| - <td><a href="https://huggingface.co/Intel/neural-chat-7b-v3-3">NeuralChat-7B</a></td> |
134 |
| - <td><a href="https://github.com/huggingface/text-generation-inference">TGI</a></td> |
135 |
| - <td>Xeon/Gaudi2</td> |
136 |
| - <td>Chatbot</td> |
137 |
| - </tr> |
138 |
| - <tr> |
139 |
| - <td><a href="https://www.langchain.com">LangChain</a>/<a href="https://www.llamaindex.ai">LlamaIndex</a></td> |
140 |
| - <td><a href="https://huggingface.co/mistralai/Mistral-7B-v0.1">Mistral-7B</a></td> |
141 |
| - <td><a href="https://github.com/huggingface/text-generation-inference">TGI</a></td> |
142 |
| - <td>Xeon/Gaudi2</td> |
143 |
| - <td>Chatbot</td> |
144 |
| - </tr> |
145 |
| - </tbody> |
146 |
| -</table> |
| 37 | +| Framework | LLM | Serving | HW | Description | |
| 38 | +| ------------------------------------------------------------------------------ | ----------------------------------------------------------------- | --------------------------------------------------------------- | ----------- | ----------- | |
| 39 | +| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [NeuralChat-7B](https://huggingface.co/Intel/neural-chat-7b-v3-3) | [TGI](https://github.com/huggingface/text-generation-inference) | Xeon/Gaudi2 | Chatbot | |
| 40 | +| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [Mistral-7B](https://huggingface.co/mistralai/Mistral-7B-v0.1) | [TGI](https://github.com/huggingface/text-generation-inference) | Xeon/Gaudi2 | Chatbot | |
147 | 41 |
|
148 | 42 | ### Language Translation
|
149 | 43 |
|
150 | 44 | [Language Translation](./Translation/README.md) is an example of chatbot for converting a source-language text to an equivalent target-language text.
|
151 | 45 |
|
152 |
| -<table> |
153 |
| - <tbody> |
154 |
| - <tr> |
155 |
| - <td>Framework</td> |
156 |
| - <td>LLM</td> |
157 |
| - <td>Serving</td> |
158 |
| - <td>HW</td> |
159 |
| - <td>Description</td> |
160 |
| - </tr> |
161 |
| - <tr> |
162 |
| - <td><a href="https://www.langchain.com">LangChain</a>/<a href="https://www.llamaindex.ai">LlamaIndex</a></td> |
163 |
| - <td><a href="https://huggingface.co/haoranxu/ALMA-13B">haoranxu/ALMA-13B</a></td> |
164 |
| - <td><a href="https://github.com/huggingface/text-generation-inference">TGI</a></td> |
165 |
| - <td>Xeon/Gaudi2</td> |
166 |
| - <td>Language Translation</td> |
167 |
| - </tr> |
168 |
| - </tbody> |
169 |
| -</table> |
| 46 | +| Framework | LLM | Serving | HW | Description | |
| 47 | +| ------------------------------------------------------------------------------ | ------------------------------------------------------------- | --------------------------------------------------------------- | ----------- | -------------------- | |
| 48 | +| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [haoranxu/ALMA-13B](https://huggingface.co/haoranxu/ALMA-13B) | [TGI](https://github.com/huggingface/text-generation-inference) | Xeon/Gaudi2 | Language Translation | |
170 | 49 |
|
171 | 50 | ### SearchQnA
|
172 | 51 |
|
173 | 52 | [SearchQnA](./SearchQnA/README.md) is an example of chatbot for using search engine to enhance QA quality.
|
174 | 53 |
|
175 |
| -<table> |
176 |
| - <tbody> |
177 |
| - <tr> |
178 |
| - <td>Framework</td> |
179 |
| - <td>LLM</td> |
180 |
| - <td>Serving</td> |
181 |
| - <td>HW</td> |
182 |
| - <td>Description</td> |
183 |
| - </tr> |
184 |
| - <tr> |
185 |
| - <td><a href="https://www.langchain.com">LangChain</a>/<a href="https://www.llamaindex.ai">LlamaIndex</a></td> |
186 |
| - <td><a href="https://huggingface.co/Intel/neural-chat-7b-v3-3">NeuralChat-7B</a></td> |
187 |
| - <td><a href="https://github.com/huggingface/text-generation-inference">TGI</a></td> |
188 |
| - <td>Xeon/Gaudi2</td> |
189 |
| - <td>Chatbot</td> |
190 |
| - </tr> |
191 |
| - <tr> |
192 |
| - <td><a href="https://www.langchain.com">LangChain</a>/<a href="https://www.llamaindex.ai">LlamaIndex</a></td> |
193 |
| - <td><a href="https://huggingface.co/mistralai/Mistral-7B-v0.1">Mistral-7B</a></td> |
194 |
| - <td><a href="https://github.com/huggingface/text-generation-inference">TGI</a></td> |
195 |
| - <td>Xeon/Gaudi2</td> |
196 |
| - <td>Chatbot</td> |
197 |
| - </tr> |
198 |
| - </tbody> |
199 |
| -</table> |
| 54 | +| Framework | LLM | Serving | HW | Description | |
| 55 | +| ------------------------------------------------------------------------------ | ----------------------------------------------------------------- | --------------------------------------------------------------- | ----------- | ----------- | |
| 56 | +| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [NeuralChat-7B](https://huggingface.co/Intel/neural-chat-7b-v3-3) | [TGI](https://github.com/huggingface/text-generation-inference) | Xeon/Gaudi2 | Chatbot | |
| 57 | +| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [Mistral-7B](https://huggingface.co/mistralai/Mistral-7B-v0.1) | [TGI](https://github.com/huggingface/text-generation-inference) | Xeon/Gaudi2 | Chatbot | |
200 | 58 |
|
201 | 59 | ### VisualQnA
|
202 | 60 |
|
203 | 61 | [VisualQnA](./VisualQnA/README.md) is an example of chatbot for question and answering based on the images.
|
204 | 62 |
|
205 |
| -<table> |
206 |
| - <tbody> |
207 |
| - <tr> |
208 |
| - <td>LLM</td> |
209 |
| - <td>HW</td> |
210 |
| - <td>Description</td> |
211 |
| - </tr> |
212 |
| - <tr> |
213 |
| - <td><a href="https://huggingface.co/llava-hf/llava-1.5-7b-hf">LLaVA-1.5-7B</a></td> |
214 |
| - <td>Gaudi2</td> |
215 |
| - <td>Chatbot</td> |
216 |
| - </tr> |
217 |
| - </tbody> |
218 |
| -</table> |
| 63 | +| LLM | HW | Description | |
| 64 | +| --------------------------------------------------------------- | ------ | ----------- | |
| 65 | +| [LLaVA-1.5-7B](https://huggingface.co/llava-hf/llava-1.5-7b-hf) | Gaudi2 | Chatbot | |
219 | 66 |
|
220 | 67 | > **_NOTE:_** The `Language Translation`, `SearchQnA`, `VisualQnA` and other use cases not listing here are in active development. The code structure of these use cases are subject to change.
|
0 commit comments