Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Could you provide a example of showing the AUC-PR of your own methods(i.e. the selfcheckgpt) just like the probability-based-baselines? #32

Closed
goatyu3 opened this issue Jun 26, 2024 · 2 comments

Comments

@goatyu3
Copy link

goatyu3 commented Jun 26, 2024

Hi there! Thanks for your awesome works.
Just like what i said in the title:Could you provide a example of showing the AUC-PR of your own methods(i.e. the selfcheckgpt) just like the probability-based-baselines?

@potsawee
Copy link
Owner

Hi @goatyu3

thanks for trying the selfcheckgpt repository! I've added a notebook to show an example of SelfCheckGPT on WikiBio like the one with probability-based baselines. You can find it in the link below.

https://github.com/potsawee/selfcheckgpt/blob/main/demo/experiments/selfcheckgpt-nli-on-wikibio.ipynb

@goatyu3
Copy link
Author

goatyu3 commented Jun 27, 2024

@potsawee Thank you for your reply. I will have a look.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants