Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Major][pyreft-core] ReFT next release items #104

Open
frankaging opened this issue Jun 7, 2024 · 1 comment
Open

[Major][pyreft-core] ReFT next release items #104

frankaging opened this issue Jun 7, 2024 · 1 comment
Assignees
Labels
engineering enhancement New feature or request

Comments

@frankaging
Copy link
Collaborator

Descriptions:

Based on current priorities, here are a set of items will be released next with experimental results:

  1. layerwise intervention weight sharing to further shrink down #params.
  2. ReFT+LoRA for arithmetic reasoning related steering.
  3. Inference-time intervention manipulations (e.g., clamping, transfer)

Using this ticket to track progress.

@frankaging frankaging added enhancement New feature or request engineering labels Jun 7, 2024
@frankaging frankaging self-assigned this Jun 7, 2024
@frankaging frankaging changed the title [Major] ReFT next release items [Major][pyreft-core] ReFT next release items Jun 7, 2024
@andresckamilo
Copy link

andresckamilo commented Jun 14, 2024

Hi Frankaging! Thanks for the excellent work here. Is it possible to add the functionality to merge the model, not just as a checkpoint, but to have the model completely modified?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
engineering enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants