Skip to content
nv-torch-latest-cpu

fix num_kv_heads sharding in uneven autoTP for Falcon-40b #5550

Sign in to view logs

fix num_kv_heads sharding in uneven autoTP for Falcon-40b

fix num_kv_heads sharding in uneven autoTP for Falcon-40b #5550

Triggered via pull request December 13, 2023 20:38
@tjruwasetjruwase
synchronize #4712
Yejing-Lai:lyj/fix_falcon40b
Status Success
Total duration 5m 18s
Artifacts –

nv-torch-latest-cpu.yml

on: pull_request
unit-tests
5m 9s
unit-tests
Fit to window
Zoom out
Zoom in