Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cogVLM模型复现向前推理 #249

Open
chenjjcccc opened this issue Oct 31, 2023 · 0 comments
Open

cogVLM模型复现向前推理 #249

chenjjcccc opened this issue Oct 31, 2023 · 0 comments
Assignees
Labels
HappyOpenSource Pro 快乐开源issue与PR,更具挑战的任务

Comments

@chenjjcccc
Copy link

cogVLM模型复现向前推理

任务描述

任务背景

  • CogVLM 是一个强大的开源视觉语言模型,利用视觉专家模块深度整合语言编码和视觉编码,在10项权威跨模态基准上取得了SOTA性能

完成步骤

  1. 模型、代码已经开源。
  2. 根据开源代码进行网络结构转换,前向推理代码链接
  3. 要求输入相同的图像与prompt,效果与web demo(测试网址)相当。
  4. 提交代码PR到PaddleMIX

提交内容:

  1. 模型脚本提交到paddlemix/models。
  2. 推理脚本提交到paddlemix/examples。
@chenjjcccc chenjjcccc changed the title PaddleMIX ppdiffusers中models模块升级controlnet代码 cogVLM模型复现向前推理 Oct 31, 2023
@shiyutang shiyutang added the HappyOpenSource Pro 快乐开源issue与PR,更具挑战的任务 label Oct 31, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
HappyOpenSource Pro 快乐开源issue与PR,更具挑战的任务
Projects
None yet
Development

No branches or pull requests

3 participants