Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support oncokb agent and agent selector #20

Merged
merged 6 commits into from
Aug 17, 2024

Conversation

fengsh27
Copy link
Collaborator

@fengsh27 fengsh27 commented Aug 3, 2024

Abstract

This submission is to support OncoKB API agent and Rag Agent selector. To achieve this, this submission introduced the following parameters when requesting chat completion:
1). useKG, kgConfig
2). useRag, ragConfig
3). oncokbConfig
4). useAutoAgent
Regarding individual agents, the rule that determines if the agent is enabled: **Config is not None and (useAutoAgent or useXxx).
For example, in the case KG,

  1. if kgConfig is None, indicating kg is disabled in frontend, kg_agent.use_prompts will be set False
  2. if useKG or useAutoAgent is True, kg_agent.use_prompts will be set True, otherwise, we will set kg_agent.use_prompts to False.

item: ChatCompletionsPostModel,
# request: Request, # ChatCompletionsPostModel,
# item: ChatCompletionsPostModel,
request: Request, # ChatCompletionsPostModel,
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Here we go back to Request due to the connection issue. If we use ChatCompletionsPostModel, biochatter-next can't communicate in this endpoint, which is a bug, and I'll fix it in next PR.

Copy link
Contributor

@slobentanzer slobentanzer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fengsh27 thanks; I merged use_reflexion in biochatter, so it makes sense to merge here as well, right? Should we merge and bump minor version here, or do we need to wait for other changes?

@fengsh27
Copy link
Collaborator Author

@slobentanzer I updated biochatter version to 0.7.3, and now we are ready to merge to main

@slobentanzer slobentanzer merged commit 3153a0b into main Aug 17, 2024
@slobentanzer
Copy link
Contributor

merging, bumping to 0.5.0, pushing to Dockerhub

@slobentanzer slobentanzer deleted the wip/fengsh/oncokb_agent_and_auto_agent branch August 17, 2024 18:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants