-
Notifications
You must be signed in to change notification settings - Fork 111
/
Copy path图片转网页.json
276 lines (276 loc) · 6.99 KB
/
图片转网页.json
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
{
"last_node_id": 31,
"last_link_id": 45,
"nodes": [
{
"id": 28,
"type": "LoadImage",
"pos": [
434,
482
],
"size": {
"0": 554.9673461914062,
"1": 386.22503662109375
},
"flags": {},
"order": 0,
"mode": 0,
"inputs": [],
"outputs": [
{
"name": "IMAGE",
"type": "IMAGE",
"links": [
42
],
"shape": 3,
"label": "IMAGE"
},
{
"name": "MASK",
"type": "MASK",
"links": null,
"shape": 3,
"label": "MASK"
}
],
"properties": {
"Node name for S&R": "LoadImage"
},
"widgets_values": [
"1727365635168.png",
"image"
]
},
{
"id": 11,
"type": "show_text_party",
"pos": [
1488,
501
],
"size": {
"0": 546.4871215820312,
"1": 411.0308837890625
},
"flags": {},
"order": 2,
"mode": 0,
"inputs": [
{
"name": "text",
"type": "STRING",
"link": 41,
"widget": {
"name": "text"
},
"label": "text"
}
],
"outputs": [
{
"name": "STRING",
"type": "STRING",
"links": [
43
],
"shape": 6,
"label": "STRING"
}
],
"properties": {
"Node name for S&R": "show_text_party"
},
"widgets_values": [
"",
"Preview\nCode\n238 lines (194 loc) - 24.4 KB\nCode 55\\% faster with GitHub Copilot\n\\title{\n项目综述\n}\nComfyUI LLM Party,从最基础的 LLM 多工具调用、角色设定快速搭建自己的专属AI助手、到可以行业落地的词向量RAG、GraphRAG来本地化的管理行业内知识库;从单一的智能体流水线,到复杂的智能体与智能体辐射状交互模式、环形交互模式的构建从个人用户需要的接入自己的社交 APP(QQ、飞书、Discord),到流媒体工作者需要的一站式LIM+TTS+ComfyUI工作流;从普通学生所需要的第一个LMI应用的简单上手起步,到科研工作者们常用的各类参数调试接口,模型适配。这一切,你都可以在ComfyUI LLM Party中找到答案。\n\\section*{最新更新}\n1. 大幅调整了本地LLM加载器节点,不用自己选择model type了。重新添加了lava加载器节点和GGUF加载器节点。本地LLM模型键节点上的 model type 已改成LLM、VLM-GGUF、LLM-GGUF三个选项,对应了直接加载LLM模型、加载VLM模型和加载GGUF格式的LLM模型。重新支持了VLM模型和GGUF格式的LLM模型。现在本地调用可以兼容更多的模型了! 示例工.作流: LLM local, IJava, GGU\n2. 已加入easyOCR节点,用于识别图中文字和位置,可以生成对应的mask,可以返回一个json字符串供LLM查看,有普通版本和高级版本供大家选择!\n3. 在comfyui LLM party中复现了chatgpt-o1系列模型的草莓系统,参考了Llamaber \\(\\mathrm{m}\\) 的提示词,示例工作流:Strawberry system compared to\n4. 新增了GPT-sovits节点,可以调用GPT-sovits模型,将文字根据你的参考音频转换为语音,也可以将你微调后的模型路径填入 (如果不填充基其虚拟模型进行推理 ),获得你想要的任务意色。使用时,需要下载GPT-sovits项目和对应的基底模型到本地,然后在GPT-sovits项目文件夹下用 runtime|python.exe api_v2.py 启动API服务。此外,chatTTS节点被移动到了comfyui LLM mafia中。原因是chatTTS的依赖库较多,且在 \\(y p\\) 中的许可且CC BY-NC 4.0,这是一个非商用许可证。即使chatTTS的github项目是AGPL协议的,我们还是为了避免不必要的麻烦,将chatTTS节点移到了comfyui LLM mafia中。希望大家能够理解!"
]
},
{
"id": 29,
"type": "mini_party",
"pos": [
2110,
519
],
"size": {
"0": 419.20635986328125,
"1": 291.5276184082031
},
"flags": {},
"order": 3,
"mode": 0,
"inputs": [
{
"name": "input_str",
"type": "STRING",
"link": 43,
"widget": {
"name": "input_str"
},
"label": "input_str"
}
],
"outputs": [
{
"name": "output_str",
"type": "STRING",
"links": [
45
],
"shape": 3,
"label": "output_str"
}
],
"properties": {
"Node name for S&R": "mini_party"
},
"widgets_values": [
"",
"把我的输入转成markdown格式",
"gpt-4o-mini",
"",
"",
true
]
},
{
"id": 27,
"type": "got_ocr",
"pos": [
1079,
537
],
"size": {
"0": 315,
"1": 250
},
"flags": {},
"order": 1,
"mode": 0,
"inputs": [
{
"name": "image",
"type": "IMAGE",
"link": 42,
"label": "image"
}
],
"outputs": [
{
"name": "text",
"type": "STRING",
"links": [
41
],
"slot_index": 0,
"shape": 3,
"label": "text"
}
],
"properties": {
"Node name for S&R": "got_ocr"
},
"widgets_values": [
"E:\\GitHub\\model\\GOT-OCR2_0",
"auto",
"format",
true,
"",
"",
false,
false,
"E:\\GitHub\\ComfyUI_windows_portable_nvidia\\ComfyUI_windows_portable\\ComfyUI\\custom_nodes\\comfyui_LLM_party\\output"
]
},
{
"id": 31,
"type": "Browser_display",
"pos": [
2588,
537
],
"size": {
"0": 315,
"1": 82
},
"flags": {},
"order": 4,
"mode": 0,
"inputs": [
{
"name": "md_or_html",
"type": "STRING",
"link": 45,
"widget": {
"name": "md_or_html"
},
"slot_index": 0
}
],
"outputs": [
{
"name": "log",
"type": "STRING",
"links": null,
"shape": 3,
"label": "log"
}
],
"properties": {
"Node name for S&R": "Browser_display"
},
"widgets_values": [
"",
true
]
}
],
"links": [
[
41,
27,
0,
11,
0,
"STRING"
],
[
42,
28,
0,
27,
0,
"IMAGE"
],
[
43,
11,
0,
29,
0,
"STRING"
],
[
45,
29,
0,
31,
0,
"STRING"
]
],
"groups": [],
"config": {},
"extra": {
"ds": {
"scale": 0.5559917313492456,
"offset": [
-720.3939780128053,
-72.94613307417796
]
}
},
"version": 0.4
}