FEAT: add xstest dataset #320
Conversation
…d fixed issues across all files.- Updated .gitignore for better exclusion.- Import changes in many_shot_jailbreak.ipynb and .py - Updated datasets initialization and fetching scripts.- Added new seclists_bias_testing notebooks and scripts.
…ed .gitignore to ignore unnecessary files.- Modified many_shot_jailbreak.ipynb and many_shot_jailbreak.py with improvements.- Modified seclists_bias_testing.ipynb and seclists_bias_testing.py for better functionality.- Updated fetch_example_datasets.py for enhanced placeholder management.Next steps:- Write comprehensive unit and integration tests to validate functionality.
…chestrator logic in seclists_bias_testing.ipynb
…chestrator logic in seclists_bias_testing.ipynb
…com/KutalVolkan/PyRIT into feature/add-fetch-function-seclists
|
Hey @KutalVolkan! Thanks for the seclists bias PR, just merged 🎉 Feel free to update this one accordingly. |
…nd apply pre-commit fixes
The updates are ready for your review. Any feedback is welcome, and I'm ready to make any further adjustments as needed. Thank you for your great support! |
romanlutz
changed the title
|
It's showing that there are merge conflicts with main. Still seeing all the seclists bias changes in this one. Happy to take a look when that's resolved since it's a lot of lines otherwise 🙂 |
Hello Roman, Are there still merge conflicts? I tried to fix them by merging with the PyRIT main branch. Let me know if it did not work out. Thank you! |
…e original dataset.
|
@KutalVolkan can you fix the build pipeline issue(s) and merge latest main in? I think we're essentially done. There's the nit-comment about removing copyright but otherwise I'm happy to hit "merge" |
KutalVolkan
force-pushed
the
feature/add-xstest-dataset
branch
from
9e9344c to
9d4adde
Compare
Hello Roman, Merged with the PyRIT main branch and fixed the build pipline issue. Let me know if it did not work out. Thank you :) |
Description:
This PR adds the
fetch_xstest_examplesfunction to thepyrit.datasetspackage, enabling the import of the XSTest dataset as aPromptDataset. It also includes corresponding unit tests to verify the functionality.Changes:
pyrit/datasets/__init__.py: Addedfetch_xstest_examples.pyrit/datasets/fetch_example_datasets.py: Implementedfetch_xstest_examples.tests/test_xstest.py: Added unit tests forfetch_xstest_examples.Related Issue: