Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor/citest #257

Merged
merged 5 commits into from
Jan 10, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
64 changes: 64 additions & 0 deletions .github/workflows/citest.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,64 @@
name: citest

on:
push:
branches:
- master
- "release/**"
paths-ignore:
- "setup.*"
- "requirements.txt"
- "apps/**"
- "docs/**"
- "demo/**"
- "config/**"
- "resource/**"
- "README.md"
- "README_zh-CN.md"
- "NOTICE"
- ".github/workflows/lint.yaml"

pull_request:
paths-ignore:
- "setup.*"
- "requirements.txt"
- "apps/**"
- "docs/**"
- "demo/**"
- "config/**"
- "resource/**"
- "README.md"
- "README_zh-CN.md"
- "NOTICE"
- ".github/workflows/lint.yaml"

concurrency:
group: ${{ github.workflow }}-${{ github.ref }}
cancel-in-progress: true

jobs:
unittest:
# The type of runner that the job will run on
runs-on: ubuntu-latest
timeout-minutes: 240
steps:
- uses: actions/checkout@v3

- name: Cache Python dependencies
uses: actions/cache@v3
id: cache
with:
path: ~/.cache/pip
key: ${{ runner.os }}-pip-${{ hashFiles('requirements.txt') }}

- name: Set up Python 3.8
uses: actions/setup-python@v3
with:
python-version: 3.8

- name: Install dependencies
if: steps.cache.outputs.cache-hit != 'true'
run: pip install -r requirements.txt

- name: Run tests
run: pytest
12 changes: 6 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@
- **opensourced LLMs as controllers**: support model training on multiple open-source LLMs of ModelScope Community
- **Diversified and Comprehensive APIs**: enabling seamless integration with both model APIs and common APIs in a unified way.

![image](resource/modelscope-agent.png)
![image](resources/modelscope-agent.png)

To equip the LLMs with tool-use abilities, a comprehensive framework has been proposed spanning over tool-use data collection, tool retrieval, tool registration, memory control, customized model training, and evaluation for practical real-world applications.

Expand Down Expand Up @@ -102,8 +102,8 @@ agent.run('写一篇关于Vision Pro VR眼镜的20字宣传文案,并用女声
```

<div style="display: flex;">
<img src="resource/modelscopegpt_case_single-step.png" alt="Image 1" style="width: 45%;">
<img src="resource/modelscopegpt_case_video-generation.png" alt="Image 2" style="width: 45%;">
<img src="resources/modelscopegpt_case_single-step.png" alt="Image 1" style="width: 45%;">
<img src="resources/modelscopegpt_case_video-generation.png" alt="Image 2" style="width: 45%;">
</div>

- Multi-turn tool-use and knowledge-qa
Expand All @@ -117,8 +117,8 @@ agent.run('给这个故事配一张图', remote=True)
```

<div style="display: flex;">
<img src="resource/modelscopegpt_case_multi-turn.png" alt="Image 1" style="width: 45%;">
<img src="resource/modelscopegpt_case_knowledge-qa.png" alt="Image 2" style="width: 45%;">
<img src="resources/modelscopegpt_case_multi-turn.png" alt="Image 1" style="width: 45%;">
<img src="resources/modelscopegpt_case_knowledge-qa.png" alt="Image 2" style="width: 45%;">
</div>


Expand Down Expand Up @@ -280,7 +280,7 @@ ds = MsDataset.load('damo/MSAgent-Bench', split='train')
one_ds = next(iter(ds))
```

![image](resource/MSAgent-Bench.png)
![image](resources/MSAgent-Bench.png)

### Training

Expand Down
12 changes: 6 additions & 6 deletions README_CN.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@
- **开源LLMs作为核心组件**:支持在 ModelScope 社区的多个开源LLMs上进行模型训练。
- **多样化且全面的API**:以统一的方式实现与模型API和常见的功能API的无缝集成。

![图片](resource/modelscope-agent.png)
![图片](resources/modelscope-agent.png)

为了赋予LLMs工具使用能力,提出了一个全面的框架,涵盖了数据收集、工具检索、工具注册、存储管理、定制模型训练和实际应用的方方面面。

Expand Down Expand Up @@ -106,8 +106,8 @@ agent.run('写一篇关于Vision Pro VR眼镜的20字宣传文案,并用女声
```

<div style="display: flex;">
<img src="resource/modelscopegpt_case_single-step.png" alt="Image 1" style="width: 45%;">
<img src="resource/modelscopegpt_case_video-generation.png" alt="Image 2" style="width: 45%;">
<img src="resources/modelscopegpt_case_single-step.png" alt="Image 1" style="width: 45%;">
<img src="resources/modelscopegpt_case_video-generation.png" alt="Image 2" style="width: 45%;">
</div>

- 多轮工具使用和知识问答
Expand All @@ -121,8 +121,8 @@ agent.run('给这个故事配一张图', remote=True)
```

<div style="display: flex;">
<img src="resource/modelscopegpt_case_multi-turn.png" alt="Image 1" style="width: 45%;">
<img src="resource/modelscopegpt_case_knowledge-qa.png" alt="Image 2" style="width: 45%;">
<img src="resources/modelscopegpt_case_multi-turn.png" alt="Image 1" style="width: 45%;">
<img src="resources/modelscopegpt_case_knowledge-qa.png" alt="Image 2" style="width: 45%;">
</div>

### 主要组件
Expand Down Expand Up @@ -292,7 +292,7 @@ ds = MsDataset.load('damo/MSAgent-Bench', split='train')
one_ds = next(iter(ds))
```

![image](resource/MSAgent-Bench.png)
![image](resources/MSAgent-Bench.png)

### 训练微调

Expand Down
File renamed without changes
File renamed without changes
Loading