Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WeeklyReport] NKNaN 2023.11.27~2023.12.10 #50

Merged
merged 1 commit into from
Dec 11, 2023
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
35 changes: 35 additions & 0 deletions Reports/NKNaN/[WeeklyReport]2023.11.27~2023.12.10.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
### 姓名

NKNaN

### 开发中的快乐开源任务

AudioLDM2模型复现前向推理

### 本双周工作

1. **学习paddle底层kernel的设计方法**

- Paddle API:详细阅读了 paddle 贡献指南中新增 API 时开发 c++ 算子与 python 端 API 的说明。初步学习了 cuda 算子的写法。

- 参考其他同种类关于分布采样的 c++ 算子,以及 binomial 的 torch 实现方法,提交了新增 binomial 算子的 pr :<https://github.com/PaddlePaddle/Paddle/pull/59690>


2. **大模型快乐开源任务**

- 阅读 [AudioLDM2 代码](https://github.com/haoheliu/AudioLDM2),梳理了部分代码的逻辑,并尝试将已经梳理的代码转化为 Paddle 框架,本双周梳理部分主要包括:
1. `latent_diffusion/models/.`
2. `latent_diffusion/modules/diffusionmodules/.`
3. `latent_diffusion/modules/encoders/.`
4. `latent_diffusion/modules/phoneme_encoder/.`
5. `latent_diffusion/modules/attention.py`


3. **问题疑惑与解答**

- 暂无

### 未来双周计划

1. 继续梳理并转换推理代码的框架
2. 需要转换 flan_t5 的模型代码: <https://github.com/google-research/t5x/blob/main/t5x/examples/t5/network.py>