Skip to content

HuBERT support rollout #1111

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 80 commits into
base: dev
Choose a base branch
from
Open

HuBERT support rollout #1111

wants to merge 80 commits into from

Conversation

@david-wei-01001
Copy link

@david-wei-01001 david-wei-01001 commented Nov 7, 2025 •
edited
Loading

Description

This add support for the HuBERT model, extending Transformer Lens to speech/audio models. Codes has been thoroughly tested, test codes can be found in demos/HuBERT_test folder. No additional dependencies needed

Fixes # (issue)

Type of change

Please delete options that are not relevant.

  • New feature (non-breaking change which adds functionality)

Checklist:

  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • My changes generate no new warnings
  • I have added tests that prove my fix is effective or that my feature works
  • New and existing unit tests pass locally with my changes
  • I have not rewritten tests relating to key interfaces which would affect backward compatibility

bryce13950 and others added 30 commits June 12, 2025 11:19
@bryce13950
Merge pull request TransformerLensOrg#945 from TransformerLensOrg/dev
e1c7506 
Release 2.16
@bryce13950
Merge pull request TransformerLensOrg#952 from TransformerLensOrg/dev
a634e57 
Release 2.16.1
@bryce13950
Merge pull request TransformerLensOrg#958 from TransformerLensOrg/dev
50ee38b 
Release v2.16.2
@david-wei-01001
Create hubert_block.py
f7e76b6
@david-wei-01001
Delete transformer_lens/components/hubert_block.py
926c1c4
@david-wei-01001
Create HookedAudioEncoder.py
95d50bc
@david-wei-01001
Update HookedAudioEncoder.py
9a29295
@david-wei-01001
Update HookedAudioEncoder.py
48c6efe
@david-wei-01001
Update HookedAudioEncoder.py
1b7559c
@david-wei-01001
Update HookedAudioEncoder.py
94fa33e
@david-wei-01001
Update loading_from_pretrained.py
6e93a5b
@david-wei-01001
Update HookedAudioEncoder.py
4edde8d
@david-wei-01001
Update loading_from_pretrained.py
a5ef321
@david-wei-01001
Update loading_from_pretrained.py
cd930f3
@david-wei-01001
Update loading_from_pretrained.py
4621730
@david-wei-01001
Create hubert.py
548e693
@david-wei-01001
Update HookedAudioEncoder.py
5dc88a1
@david-wei-01001
Update HookedAudioEncoder.py
8282805
@david-wei-01001
Create hubert_test.py
7f0c373
@david-wei-01001
Update hubert_test.py
e8bbf84
@david-wei-01001
Update HookedAudioEncoder.py
86ac1d9
@david-wei-01001
Create hubert_ctc_test.py
8f1b889
@david-wei-01001
Update HookedAudioEncoder.py
afc2a35
@david-wei-01001
Create hubert_hook_test.py
f94fa40
@david-wei-01001
Update hubert_hook_test.py
cff50b3
@david-wei-01001
done
764810a
@david-wei-01001
done
7e844a3
@david-wei-01001
done
9a6bc7a
@david-wei-01001
done
1ddbf7f
@david-wei-01001
done
c646ee5
@david-wei-01001
Copy link
Author

david-wei-01001 commented Nov 7, 2025

I fixed import format to the best of I can.

@david-wei-01001 david-wei-01001 changed the base branch from main to dev November 7, 2025 15:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@david-wei-01001 @bryce13950