Add example for extracting representation. #19
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Changelogs
This PR has a very minor documentation updates to add example of how to leverage SAFE-GPT representation (see context in #18).
Checklist:
feature
,fix
ortest
(or ask a maintainer to do it for you).It should be noted that the model was not trained with any representation learning objective. As such using embedding from SAFE-GPT is not recommended. However, I will be happy to contribute to any attempt at building a new pretrained version with a training objective taking that into account.