Skip to content

Commit

Permalink
Add roadmap
Browse files Browse the repository at this point in the history
  • Loading branch information
sharanry committed Oct 28, 2024
1 parent e93de14 commit d4aad15
Showing 1 changed file with 23 additions and 0 deletions.
23 changes: 23 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,26 @@
# ProbeLens
### A framework to enable probing of language models.
![CI](https://github.com/sharanry/probe-lens/actions/workflows/ci.yaml/badge.svg)


## Roadmap
### Functionalities
- [x] Add basic linear probe with tests
- [ ] Add regularization
- [ ] Add sparsity
- [ ] Add other kind of probes
- [ ] Non-linear probes
- [ ] ... ?

### Applications
- [ ] Reproduce results from SAE-Spelling
- [ ] First letter data generation
- [ ] Add more probing experiments
- [ ] ... ?

### Visualization
- [x] Add Confusion Matrix
- [x] Add f2 score and accuracy
- [ ] Add more visualization experiments
- [ ] ... ?

0 comments on commit d4aad15

Please sign in to comment.