Testing scripts

[jsvan]

Discussed in #47

^{Originally posted by jsvan July 3, 2024}
Hello,

Could you please share the testing scripts for the Narrative/QuALITY/Qasper scores? I'd like to run some experiments on how quantization/reducing embedding dimensions affect performance. However running these look non trivial because it's information retrieval/generation etc., and I'm trying to fit this in while procrasting from other work I should be doing.

Thank you!

[piscesfinalizer]

me too

[Ningyu-y]

me too

[Ningyu-y]

Discussed in #47

Originally posted by jsvan July 3, 2024 Hello, 你好,

Could you please share the testing scripts for the Narrative/QuALITY/Qasper scores? I'd like to run some experiments on how quantization/reducing embedding dimensions affect performance. However running these look non trivial because it's information retrieval/generation etc., and I'm trying to fit this in while procrasting from other work I should be doing.你能分享一下关于叙述/质量/Qasper分数的测试脚本吗?我想运行一些关于量化/降低嵌入维数如何影响性能的实验。然而，运行这些看起来不平凡，因为它的信息检索/生成等，我试图适应这在拖延其他工作，我应该做的。

Thank you! 谢谢你！

Did you solve the problem with the experimental script, I need it too