Skip to content
This repository has been archived by the owner on Nov 3, 2023. It is now read-only.

Logging token level losses at inference time #4169

Merged
Show file tree
Hide file tree
Changes from 14 commits
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
ea54029
first draft
c-flaherty Nov 11, 2021
1c63fd7
fix
c-flaherty Nov 11, 2021
f4a7d6d
added rank logging and regression-based unit test
c-flaherty Nov 12, 2021
cb761c7
some notes
c-flaherty Nov 12, 2021
ca45cf2
removed unnecessary prefixing in test
c-flaherty Nov 12, 2021
8df50f5
fix callsite
c-flaherty Nov 12, 2021
200cbcb
actually this fixed the callsite
c-flaherty Nov 12, 2021
e74c159
addressed stephens PR feedback
c-flaherty Nov 18, 2021
36dcc73
Merge branch 'main' into add_token_level_probability_logging_TGA
c-flaherty Nov 18, 2021
d5b0ef2
addressed Emilys PR feedback
c-flaherty Nov 29, 2021
449b5e5
fixed linting
c-flaherty Nov 29, 2021
1aeabeb
fix
c-flaherty Nov 29, 2021
a5b2d7c
fix
c-flaherty Nov 29, 2021
1d89ac7
addressed emily pr feedback
c-flaherty Dec 1, 2021
53f7350
addressed Emily PR feedback, adding select_paths unit testing
c-flaherty Dec 7, 2021
9aa7987
address Emily feedback p2
c-flaherty Dec 7, 2021
8b6437e
linting and comments
c-flaherty Dec 7, 2021
22ec560
make code more efficient
c-flaherty Dec 8, 2021
d67a0ee
linting
c-flaherty Dec 9, 2021
0aff113
fix test
c-flaherty Dec 13, 2021
e268c80
Merge remote-tracking branch 'origin' into add_token_level_probabilit…
c-flaherty Dec 14, 2021
80f5a81
fix test
c-flaherty Dec 15, 2021
98adeab
fix broken gpu tests
c-flaherty Dec 16, 2021
e231341
fix more tests
c-flaherty Dec 16, 2021
be52baf
fixed another gpu test
c-flaherty Dec 17, 2021
d56ac13
fix long_gpu_tests + linting
c-flaherty Dec 21, 2021
70c7eba
Merge remote-tracking branch 'origin' into add_token_level_probabilit…
c-flaherty Dec 21, 2021
32d1a0b
try skipping rag tests and see if cache issue resolves
c-flaherty Dec 22, 2021
bde9069
bump cache again to see if skippping rag/fid tests helps
c-flaherty Dec 22, 2021
3381841
Merge remote-tracking branch 'origin' into add_token_level_probabilit…
c-flaherty Dec 22, 2021
254de6c
addressed Emily PR feedback
c-flaherty Jan 3, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading