-
Notifications
You must be signed in to change notification settings - Fork 10.5k
Open
Labels
area/modelskind/customer-issueIssues that were reported by customersIssues that were reported by customerspriority/p2Important but can be addressed in a future release.Important but can be addressed in a future release.
Description
Model Availability and Auth Integration
Summary
Visual agent requires Computer Use model, which may not be available on all auth
tiers. Communicate limitations clearly and fall back gracefully.
Description
The Computer Use model (required for visual delegation) has different
availability depending on authentication mode. When the visual agent is
unavailable, the browser agent should:
- Detect the limitation before attempting visual delegation
- Provide a clear error message explaining why
- Suggest alternatives (e.g., more specific element descriptions)
- Continue operating in semantic-only mode
When delegate_to_visual_agent is called but visual agent unavailable:
Error: Visual agent requires Computer Use model access.
Suggestion: Describe the element more specifically so semantic tools can locate it.
Acceptance Criteria
- Auth mode detection for model availability
- Model availability check before visual delegation
- Clear error message with helpful suggestion
- Semantic-only fallback works correctly
Metadata
Metadata
Assignees
Labels
area/modelskind/customer-issueIssues that were reported by customersIssues that were reported by customerspriority/p2Important but can be addressed in a future release.Important but can be addressed in a future release.