Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

off topic request throws error #213710

Closed
meganrogge opened this issue May 28, 2024 · 9 comments
Closed

off topic request throws error #213710

meganrogge opened this issue May 28, 2024 · 9 comments
Assignees
Labels
bug Issue identified by VS Code Team member as probable bug panel-chat verified Verification succeeded
Milestone

Comments

@meganrogge
Copy link
Contributor

meganrogge commented May 28, 2024

Testing #213552

  1. Use unmodified chat extension sample
  2. Run @cat tell me a story
  3. 🐛 see Language model errored (I'd expect to see the off topic filter)
  4. In dev tools:
 ERR [CHAT] extension request ERRORED Error: filtered as off_topic by intent classifier: message was not programming related
    at u2.provideLanguageModelResponse (/Applications/code-insiders-portable-data/extensions/github.copilot-chat-0.16.2024052801/dist/extension.js:1001:3622)
    at processTicksAndRejections (node:internal/process/task_queues:95:5) vscode-samples.chat-sample 496141
log.ts:439   ERR filtered as off_topic by intent classifier: message was not programming related: Error: filtered as off_topic by intent classifier: message was not programming related
    at u2.provideLanguageModelResponse (/Applications/code-insiders-portable-data/extensions/github.copilot-chat-0.16.2024052801/dist/extension.js:1001:3622)
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
Screenshot 2024-05-28 at 11 17 22 AM

Here are the logs, keyword: failed request for the logs that happened around this time
logs.txt

@meganrogge meganrogge changed the title cat: tell me a story throws error off topic request throws error May 28, 2024
@jrieken
Copy link
Member

jrieken commented May 29, 2024

We have two options (and should do both)

  1. update the sample to do proper error handling (@isidorn)
  2. do nicer error printing when invoking a participant fails

@isidorn
Copy link
Contributor

isidorn commented May 29, 2024

I can do 1. I would just log the error. Let me know if there is anything more creative I could do in error handling.

@jrieken
Copy link
Member

jrieken commented May 29, 2024

How about printing a nice message and logging the ugly error to the console/log-file?

@meganrogge
Copy link
Contributor Author

Should this be labeled a bug so it gets verified @jrieken ?

@jrieken
Copy link
Member

jrieken commented May 30, 2024

Should this be labeled a bug so it gets verified @jrieken ?

Sure, sure but I not yet certain that what I have changed is enough ;-)

@jrieken jrieken added the bug Issue identified by VS Code Team member as probable bug label May 30, 2024
@jrieken
Copy link
Member

jrieken commented May 30, 2024

Let's treat this as fixed

@jrieken jrieken closed this as completed May 30, 2024
@alexr00
Copy link
Member

alexr00 commented May 30, 2024

What am I supposed to see? I see this in the console:

image

and this in the chat view:

image

@alexr00 alexr00 added the verification-steps-needed Steps to verify are needed for verification label May 30, 2024
@meganrogge meganrogge added verified Verification succeeded and removed verification-steps-needed Steps to verify are needed for verification labels May 30, 2024
@meganrogge
Copy link
Contributor Author

before, there was just a generic error message. now there's a specific one indicating it was off topic. I believe that's what the fix was

@roblourens
Copy link
Member

Yeah, ugly raw error but at least we expose the real error instead of the wrapper, so I think this is good default behavior.

@microsoft microsoft locked and limited conversation to collaborators Jul 14, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Issue identified by VS Code Team member as probable bug panel-chat verified Verification succeeded
Projects
None yet
Development

No branches or pull requests

5 participants