Deployment: add local model deployment option #77
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
BeatrixCohere
approved these changes
May 1, 2024
lakshyaag
pushed a commit
to lakshyaag/cohere-toolkit
that referenced
this pull request
May 8, 2024
* Deployment: add local model deployment option * lint * add tests * lint * fix cohere prompts
EnronMusk
pushed a commit
to EnronMusk/HallucinationGPT
that referenced
this pull request
Jul 22, 2024
… and fixes (cohere-ai#76) * readme: add Azure deploy description + single Docker improvements * readme: add Azure deploy description + single Docker improvements * Add Sqlite v.3.45.3 for Chroma DB deployment: add docker compose down command in Makefile. (cohere-ai#65) Signed-off-by: ifuryst <ifuryst@gmail.com> coral_web: Add is_available check to tools (cohere-ai#82) * add is_available check to tools * add tool error message as tooltip * disable unavailable tools, show error message if description does not exist Setup: fix key error (cohere-ai#84) docs: Update README.md links (cohere-ai#83) Update README.md links Some links were still pointing to the old `cohere-ia/toolkit` repository, instead of `cohere-ai/cohere-toolkit`. docs: clarify setup env for development. (cohere-ai#64) Signed-off-by: ifuryst <ifuryst@gmail.com> coral-web: update the starter card options (cohere-ai#73) * add new start options * set start option prompts * clean up * remove welcome message * remove notification message * visual nits * center start options, fade out when convo is populated * remove streaming message check coral-web: include conversationId in file upload (cohere-ai#85) include conversationId in file upload Deployment: add local model deployment option (cohere-ai#77) * Deployment: add local model deployment option * lint * add tests * lint * fix cohere prompts Docs: add env setup instructions (cohere-ai#88) Cli: add dummy tests (cohere-ai#89) * Cli: add dummy tests * move cli to backend backend: Set up next.js to proxy requests to the API (cohere-ai#86) Set up next.js to proxy requests to the API tools: Update default NEXT_PUBLIC_API_HOSTNAME for the new api routing (cohere-ai#94) * Update default NEXT_PUBLIC_API_HOSTNAME for the new api routing * Also update NEXT_PUBLIC_API_HOSTNAME in README and .env-template fix: broken backend URL in cli (cohere-ai#93) Update main.py Co-authored-by: Tianjing Li <tianjinglimail@gmail.com> changed logo and pager header implemented openAI adapter added env variable for oai key implemented working chatgpt 1 fixed fix fixed conversation order bug fixed bugs with incorrect chat history. added exrract script other changes to msgs msgRow has text duplication bug fix? big update pls close! cool cool font change big fixes for message row highlight selection now working perfectly. small fix for code selection (remaining bug in nodes textContent tooltip) big commit big commit HUGE bug fix for laggy composer ! HUGE bug fix for laggy composer ! implemented annotation prompting less spam working annotaiton schema setup WORKING annotation saving! working annotation saving in db huge update, cookies, ua and many fixes for highlights
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description: adds a local model deployment option using llama cpp and updates the docs.