Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[INTEGRATION] Open Attack #9

Closed
SoyGema opened this issue Oct 31, 2023 · 1 comment
Closed

[INTEGRATION] Open Attack #9

SoyGema opened this issue Oct 31, 2023 · 1 comment
Labels
classification classification models discussion To research or discuss research important to know more

Comments

@SoyGema
Copy link
Owner

SoyGema commented Oct 31, 2023 •
edited
Loading

Study the capabilities that Open Attack offers for generative models
Currently OpenAttack includes 15 typical attack models against text classification models that cover all attack types , so it doesn´t cover generative models.
@SoyGema SoyGema added discussion To research or discuss classification classification models research important to know more labels Oct 31, 2023
@SoyGema
Copy link
Owner Author

SoyGema commented Nov 3, 2023

Finally Open Attack library won´t be integrated , as Langchain is prefered because is well integrated with hugginface and the feedback nudges towards prioritizing all generative robustness benchmarking efforts VS classification.

If this changes , the issue shall be reopened

@SoyGema SoyGema closed this as completed Nov 3, 2023
This was referenced Nov 3, 2023
Merged
Open
Closed
Closed
Closed
Closed
Closed
Closed
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
classification classification models discussion To research or discuss research important to know more
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@SoyGema