Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add example for extracting representation. #19

Merged
merged 3 commits into from
Dec 23, 2023

Conversation

maclandrol
Copy link
Member

Changelogs

This PR has a very minor documentation updates to add example of how to leverage SAFE-GPT representation (see context in #18).


Checklist:

  • Add tests to cover the fixed bug(s) or the new introduced feature(s) (if appropriate).
  • Update the API documentation if a new function is added, or an existing one is deleted. Eventually consider making a new tutorial for new features.
  • Write concise and explanatory changelogs below.
  • If possible, assign one of the following labels to the PR: feature, fix or test (or ask a maintainer to do it for you).

It should be noted that the model was not trained with any representation learning objective. As such using embedding from SAFE-GPT is not recommended. However, I will be happy to contribute to any attempt at building a new pretrained version with a training objective taking that into account.

@maclandrol maclandrol merged commit 87c9c22 into main Dec 23, 2023
@maclandrol maclandrol deleted the chores/tutorial-representation branch January 5, 2024 19:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant