Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Main #3

Merged
merged 27 commits into from
Oct 9, 2024
Merged

Main #3

merged 27 commits into from
Oct 9, 2024

Conversation

zyearw1024
Copy link
Owner

Thanks for your contribution and we appreciate it a lot. The following instructions would make your pull request more healthy and more easily receiving feedbacks. If you do not understand some items, don't worry, just make the pull request and seek help from maintainers.

Motivation

Please describe the motivation of this PR and the goal you want to achieve through this PR.

Modification

Please briefly describe what modification is made in this PR.

BC-breaking (Optional)

Does the modification introduce changes that break the backward-compatibility of the downstream repositories?
If so, please describe how it breaks the compatibility and how the downstream projects should modify their code to keep compatibility with this PR.

Use cases (Optional)

If this PR introduces a new feature, it is better to list some use cases here, and update the documentation.

Checklist

  1. Pre-commit or other linting tools are used to fix the potential lint issues.
  2. The modification is covered by complete unit tests. If not, please add more unit tests to ensure the correctness.
  3. If the modification has a dependency on downstream projects of a newer version, this PR should be tested with all supported versions of downstream projects.
  4. The documentation has been modified accordingly, like docstring or example tutorials.

lvhan028 and others added 27 commits September 18, 2024 14:33
@lvhan028
Support user-sepcified data type (InternLM#2473)
1678dc5 
* support specifying data type

* update

* update

* add dtype in CLI

* add user specified dtype for pytorch engine

* update log

* fix linting & ut

* fix vl

* minor
@zhulinJulia24
[ci] regular update (InternLM#2431)
dd49877 
* update

* update

* update

* update

* update

* update

* update

* update

* update

* updaet

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* updaste

* update
@SeitaroShinagawa
Fix "TypeError: Got unsupported ScalarType BFloat16" (InternLM#2472)
4305ddf
@yao-fengchen
fix ascend atten_mask (InternLM#2483)
a513526
@grimoire
Add silu mul kernel (InternLM#2469)
97449e3 
* add silu kernel, optimize apply rotary kernek

* add ut

* lint

* fix fused moe
@grimoire
adjust schedule to improve TTFT in pytorch engine (InternLM#2477)
82d0c00
@lvhan028
Add max_log_len option to control length of printed log (InternLM#2478)
8b9f6ab 
* check max_batch_size

* add max_log_len option to control length of printed log

* minor fix

* remove autotest/README.md

* missed docstring

* change log format
@AllentDan
Support minicpm3-4b (InternLM#2465)
f3bef7b 
* Support minicpm3-4b

* update doc and fix typo

* comments

* sum -> max

* add TODO

* use pytorch engine's rotary embedding
@lvhan028
set served model name being repo_id from hub before it is downloaded (I…
8173929 
…nternLM#2494)
@irexyc
support Qwen2-VL with pytorch backend (InternLM#2449)
254d90a 
* support qwen2-vl in pytorch backend

* udpate docs

* fix inference

* update docs

* fix Qwen/Qwen2-VL-2B-Instruct

* fix pytorch.chat

* add transformers version check

* update supported models
@AllentDan
Improve proxy server usage (InternLM#2488)
3da9c9a 
* Refine proxy server usage

* fix

* add cli and refine documents

* documents

* api keys
@grimoire
CudaGraph mixin (InternLM#2485)
bf89a01 
* llama demo

* all models
@grimoire
pytorch engine add get_logits (InternLM#2487)
69844ae 
* add get logits

* optimize sampling

* optimize prefill kernel

* rename gather
@grimoire
Refactor lora (InternLM#2466)
0fbb2ee 
* refactor lora tp1

* support baichuan tp=2

* tuning lora

* support awq/w8a8 lora

* update docs

* update pipeline.md

* add download adapters

* fix adapter id fill zero
@lvhan028
Catch exceptions thrown by turbomind inference thread (InternLM#2502)
f012c86 
* log error before throw exception

* add try-exception in forward thread

* update

* update

* update

* miss messages

* fix

* update

* update
@grimoire
support noaligned silu_and_mul (InternLM#2506)
4bcfc18 
* support noaligned silu_and_mul

* remove dist utils

* fix pow2

* minicpm3 cudagraph

* update ut
@zhulinJulia24
[CI] add base model evaluation (InternLM#2490)
2c71f27 
* update

* update

* update

* update

* update

* update

* update

* updatre

* update

* update

* update

* update

* update

* update

* updaste

* update
@jiajie-yang
refactor: optimize performance of ascend backend's update_step_contex…
0323103 
…t() (InternLM#2521)
@AllentDan
Fix chatglm tokenizer failed when transformers>=4.45.0 (InternLM#2520)
bb1dfa6 
* Fix chatglm tokenizer failed when transformers>=4.45.0

* fix chatglm2-6b
@lvhan028
The get_ppl missed the last token of each iteration during multi-it…
4812b5a 
…er prefill (InternLM#2499)

* fix get_ppl

* update

* update

* remove get_ppl from engine.py

* fix according to reviewer comments

* fix

* update

* keep logits.device unchanged

* require input_ids have the same length

* rollback user guide

* update

* split batch dim

* apply torch.cuda.empty_cache()
@irexyc
fix vl gradio (InternLM#2527)
8db20bc
@lvhan028
bump version to v0.6.1 (InternLM#2513)
2e49fc3 
* bump version to v0.6.1

* update
@mouweng
Add argument to disable FastAPI docs (InternLM#2540)
6f34738
@zhulinJulia24
[ci] add oc infer test in stable test (InternLM#2523)
3d38e94 
* updaste

* update

* update

* update

* update

* update

* update

* update
@AllentDan
set outlines<0.1.0 (InternLM#2559)
677207b
@cookieyyds
support downloading models from openmind_hub (InternLM#2563)
a5ee8df
@grimoire
add check for device with cap 7.x (InternLM#2535)
7c6b107 
* add check for device with cap 7.x

* update hint

* update->upgrade
@zyearw1024 zyearw1024 merged commit d8432ae into develop Oct 9, 2024
20 of 25 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.