Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added a conversion Python example for the Gemma 7B model. #472

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

kuaashish
Copy link
Contributor

@kuaashish kuaashish commented Oct 24, 2024

Description

The Gemma 7B model conversion was missing, so updated the example for the newly supported model.

Fixes # (issue)

Checklist

Please ensure the following items are complete before submitting a pull request:

  • My code follows the code style of the project.
  • I have updated the documentation (if applicable).
  • I have added tests to cover my changes.

Type of Change

Please check the relevant option below:

  • Bug fix (non-breaking change which fixes an issue)
  • Documentation update (non-breaking change which updates documentation)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)

Screenshots

Added the colab here https://colab.sandbox.google.com/drive/1nYJd20gxvQvgc8-PXQAn-Az9W4exSuxk?resourcekey=0-4e-P6wKuFz4ef8a50yubaQ

Additional Notes

Add any additional information or context about the pull request here.

@kuaashish
Copy link
Contributor Author

kuaashish commented Oct 24, 2024

Hi @schmidt-sebastian, @PaulTR

Could you please review the process for converting the Gemma 7B model using Colab? Additionally, made a few changes: the HF token field will now only appear when a Gemma model from Hugging Face is selected. Also, when the Gemma 7B model is available on GPU, the CPU option has been removed, as the 8-bit Gemma 7B model is compatible only with GPU.

Thank you!!

@schmidt-sebastian
Copy link
Collaborator

@woodyhoko should review this. Thanks for this contribution @kuaashish !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants