-
Notifications
You must be signed in to change notification settings - Fork 305
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
update ollama plugin to reflect API changes #3065
base: master
Are you sure you want to change the base?
Conversation
Signed-off-by: Samhita Alla <aallasamhita@gmail.com>
Code Review Agent Run Status
|
Signed-off-by: Samhita Alla <aallasamhita@gmail.com>
Code Review Agent Run Status
|
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## master #3065 +/- ##
==========================================
- Coverage 79.53% 76.94% -2.59%
==========================================
Files 202 270 +68
Lines 21370 23897 +2527
Branches 2746 2746
==========================================
+ Hits 16997 18388 +1391
- Misses 3603 4737 +1134
- Partials 770 772 +2 ☔ View full report in Codecov by Sentry. |
Signed-off-by: Samhita Alla <aallasamhita@gmail.com>
Signed-off-by: Samhita Alla <aallasamhita@gmail.com>
plugins/flytekit-inference/flytekitplugins/inference/ollama/serve.py
Outdated
Show resolved
Hide resolved
Code Review Agent Run Status
|
Python 3.12 or higher is required due to support for backslashes in f-strings: | ||
https://realpython.com/python312-f-strings/#backslashes-now-allowed-in-f-strings |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think using the NEWLINE
and NEWLINE_ESCAPED
global vars should address this
Code Review Agent Run Status
|
Tracking issue
Why are the changes needed?
The Ollama Python API and backend were updated, necessitating unpinning the version and making adjustments to the plugin to ensure compatibility.
What changes were proposed in this pull request?
Replaced the modelfile field with individual fields that correspond directly to the attributes previously defined in the modelfile.
How was this patch tested?
There's an end-to-end example available, and I've tested it—it works as expected.
Setup process
Screenshots
Check all the applicable boxes
Related PRs
Docs link