New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

每个token耗时呈脉冲式变化 #201

Open

wangheqi987 opened this issue Jul 17, 2023 · 0 comments

wangheqi987 commented Jul 17, 2023

统计了每个token的耗时，发现随着token增长，每个token的耗时呈脉冲式变化。此前统计过6B的变化，除了第一个token耗时较长，其余的token基本上在某个值上下变化。请问造成二者差异的原因在哪里？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment