Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

update examples/FinanceBench #201

Merged
merged 191 commits into from
May 4, 2024
Merged

update examples/FinanceBench #201

merged 191 commits into from
May 4, 2024

Conversation

TheVinhLuong102
Copy link
Collaborator

No description provided.

srag21 and others added 30 commits April 30, 2024 14:09
@srag21
add script for human-like evaluations using GPT-4
be1dec6
@TheVinhLuong102
Merge branch 'examples/FinanceBench' of https://GitHub.com/Aitomatic/…
3a1b06c 
…OpenSSA into auto-eval-script
@TheVinhLuong102
update examples/FinanceBench/expert-knowledge.txt Financial Synonyms …
294acf5 
…section
@TheVinhLuong102
Merge branch 'examples/FinanceBench' of https://GitHub.com/Aitomatic/…
21a3aae 
…OpenSSA into auto-eval-script
@TheVinhLuong102
Merge branch 'main' of https://GitHub.com/Aitomatic/OpenSSA into auto…
72abbdc 
…-eval-script
@TheVinhLuong102
update examples/FinanceBench/eval.py
acb2f15
@TheVinhLuong102
Merge branch 'main' of https://GitHub.com/Aitomatic/OpenSSA into exam…
cc22336 
…ples/FinanceBench
@TheVinhLuong102
Merge branch 'examples/FinanceBench' of https://GitHub.com/Aitomatic/…
38911a6 
…OpenSSA into auto-eval-script
@TheVinhLuong102
minor edit in examples/FinanceBench/eval.py
b99585e
@TheVinhLuong102
Merge pull request #195 from aitomatic/auto-eval-script
6b4a6c5 
add human-like evaluation utils for examples/FinanceBench
@TheVinhLuong102
rename examples/FinanceBench/rag-finetuned-embed-and-lm script
ee6ba83
@TheVinhLuong102
refactor examples/FinanceBench/eval module
18f17a6
@TheVinhLuong102
update examples/FinanceBench/eval module
2640848
@TheVinhLuong102
set low temperature for examples/FinanceBench/eval.get_llm(...)
51ce243
@TheVinhLuong102
update examples/FinanceBench/eval.EVAL_PROMPT_TEMPLATE
1ea84b0
@TheVinhLuong102
update financebench_id_01858 ground truth
4cd7004
@TheVinhLuong102
update financebench_id_01981 ground truth
708de07
@TheVinhLuong102
update financebench_id_00070 ground truth
2a520a6
@TheVinhLuong102
update financebench_id_00288 ground truth
58775a5
@TheVinhLuong102
update financebench_id_01091 ground truth
6f286d0
@TheVinhLuong102
update financebench_id_00464 ground truth
c1cb668
@TheVinhLuong102
update financebench_id_00005 ground truth
d95039a
@TheVinhLuong102
update financebench_id_01091 ground truth
a66c38c
@TheVinhLuong102
update financebench_id_01107 ground truth
518267f
@TheVinhLuong102
update financebench_id_00735 ground truth
d0c385b
@TheVinhLuong102
update financebench_id_01244 ground truth
111f194
@TheVinhLuong102
update financebench_id_00839 ground truth
81c9d81
@TheVinhLuong102
update financebench_id_02049 ground truth
0b1365d
@TheVinhLuong102
update financebench_id_01254 ground truth
9719c65
@TheVinhLuong102
update financebench_id_00080 ground truth
deb5dc7
@TheVinhLuong102
update financebench_id_04481 ground truth
19fe846
@TheVinhLuong102
update financebench_id_00283 ground truth
2e51d7c
@TheVinhLuong102
update financebench_id_00605 ground truth
5bf91e1
@TheVinhLuong102
update financebench_id_06741 ground truth
d6ec84d
@TheVinhLuong102
update financebench_id_01936 ground truth
c07ff70
@TheVinhLuong102
fix examples/FinanceBench/eval.EVAL_PROMPT_TEMPLATE
dffb539
@TheVinhLuong102
refactor examples/FinanceBench/eval imports
a36b144
@TheVinhLuong102
refactor examples/FinanceBench/eval script
e49b295
@TheVinhLuong102
update examples/FinanceBench/eval.EVAL_PROMPT_TEMPLATE
31080bf
@TheVinhLuong102
update financebench_id_00283 ground truth
88746a0
@TheVinhLuong102
update financebench_id_03620 ground truth
1af73af
@TheVinhLuong102
refactor examples/FinanceBench/eval.eval_correctness(...)
bec3a12
@TheVinhLuong102
update examples/FinanceBench/eval.EVAL_PROMPT_TEMPLATE
5b6738b
@TheVinhLuong102
update examples/FinanceBench/eval.EVAL_PROMPT_TEMPLATE
2f7c316
@TheVinhLuong102
update examples/FinanceBench/eval with debug option
87349ae
@TheVinhLuong102
update examples/FinanceBench/eval.eval_correctness(...)
ab9926f
@TheVinhLuong102
update examples/FinanceBench/eval.EVAL_PROMPT_TEMPLATE
77b98a0
@TheVinhLuong102
update examples/FinanceBench/eval.EVAL_PROMPT_TEMPLATE
5e95e84
@TheVinhLuong102
update examples/FinanceBench/eval.EVAL_PROMPT_TEMPLATE
569db6d
@TheVinhLuong102 TheVinhLuong102 self-assigned this May 4, 2024
@TheVinhLuong102 TheVinhLuong102 merged commit 435af50 into main May 4, 2024
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@TheVinhLuong102 TheVinhLuong102

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@TheVinhLuong102 @srag21