Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tool calling in chat #347

Open
Tracked by #337
samlhuillier opened this issue Aug 12, 2024 · 0 comments
Open
Tracked by #337

Tool calling in chat #347

samlhuillier opened this issue Aug 12, 2024 · 0 comments
Assignees

Comments

@samlhuillier
Copy link
Collaborator

LLM Tool Integration

Description

Implement functionality to allow LLMs to call tools in chat. We can do this now thanks to Ollama's new tool support (https://ollama.com/blog/tool-support)

Examples

  1. User says: "Make a note about X"
    • LLM calls the create file tool (under filesystem) without manual user intervention
  2. LLM uses the search tool to determine if a user query requires searching through notes

Implementation

  • The two main tools will be filesystem API tools like add, modify & delete files + search tools
  • The user will need to be asked whether to execute a tool call if an action is destructive like deleting a file
  • The tools will be callable right from the chat window

Dependencies

Priority

High

@samlhuillier samlhuillier mentioned this issue Aug 12, 2024
62 tasks
@joseplayero joseplayero self-assigned this Sep 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants