This repository has been archived by the owner on Dec 6, 2024. It is now read-only.

添加tokens生成速度 #73

Open

OliverQueen1466 opened this issue Jan 22, 2024 · 0 comments

OliverQueen1466 commented Jan 22, 2024

能否添加一个在推理结束之后，输出prefill和decode速度（token/s）的功能，谢谢

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.