fix num_kv_heads sharding in uneven autoTP for Falcon-40b #6095

Sign in to view logs

Triggered via pull request December 13, 2023 20:38

synchronize #4712

Yejing-Lai:lyj/fix_falcon40b

Status Success

Total duration 2m 10s

Artifacts –

python.yml

on: pull_request

Matrix: version-check