Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deprecate TGI Gaudi fork in favor of the main TGI repo #287

Draft
wants to merge 1 commit into
base: habana-main
Choose a base branch
from

Conversation

baptistecolle
Copy link
Collaborator

@baptistecolle baptistecolle commented Mar 10, 2025

What does this PR do?

This PR adds a notice to the README about the deprecation of this repository and informs users that future development should take place in the main TGI repository.

Context

We are currently in the process of upstreaming this fork into the main TGI repository. As a result, this repository is no longer needed, and all further Gaudi-related development will happen within TGI.

The TGI backend now provides equivalent functionality to tgi-gaudi, as it reuses the server from this repository.

Related PRs
#3055: Introduces the Gaudi backend to TGI. For more details on TGI backends, see this blog post.
#3091: Officially releases the Gaudi backend for TGI.

Next Steps

Three PRs from tgi-gaudi (#284, #285, and #286) have not yet been merged into the upstream Gaudi backend. I will submit a quick PR to add them to the new backend after the release.

@baptistecolle baptistecolle requested a review from regisss March 10, 2025 11:08
@baptistecolle baptistecolle marked this pull request as draft March 10, 2025 11:09
@baptistecolle baptistecolle changed the title Deprecate TGI Gaudi fork Deprecate TGI Gaudi fork in favor of the main TGI repo Mar 10, 2025
@baptistecolle
Copy link
Collaborator Author

baptistecolle commented Mar 10, 2025

@regisss You should also mark this repo as archived

I think we can merge this PR when the latest PR in TGI is merged

@yuanwu2017
Copy link
Collaborator

@baptistecolle @regisss Before marking this repo as archived, we need to finish the last 1.20 release this week. Thanks.

@baptistecolle
Copy link
Collaborator Author

Ok no problem, we can wait for that and then I can upstream the 1.20 release changes in the main TGI repo. Btw the release version will follow TGI. So release 1.20 will be v3.1.2 or something similar

@regisss
Copy link
Collaborator

regisss commented Mar 12, 2025

I think we can wait till the release of Synapse 1.21 before archiving this fork as the release aligned with Synapse 1.20 will be the last one in this repo and still be a valid one.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants