Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature Request] OmniParser visual prompt #31

Open
Tracked by #6
dandansamax opened this issue Sep 5, 2024 · 0 comments
Open
Tracked by #6

[Feature Request] OmniParser visual prompt #31

dandansamax opened this issue Sep 5, 2024 · 0 comments
Labels
enhancement New feature or request visual prompt

Comments

@dandansamax
Copy link
Collaborator

dandansamax commented Sep 5, 2024 •
edited
Loading

OmniParser is a visual prompt method, including a finetuned interactable icon detection model, a finetuned icon description model, and an OCR module. It should be more accurate than GroundingDino.

https://arxiv.org/abs/2408.00203
@dandansamax dandansamax mentioned this issue Sep 5, 2024
Open
5 tasks
@camel-ai camel-ai deleted a comment Sep 5, 2024
@dandansamax dandansamax changed the title OmniParser for Pure Vision Based GUI Agent: https://arxiv.org/abs/2408.00203 [Feature Request] OmniParser visual prompt Sep 5, 2024
@dandansamax dandansamax added enhancement New feature or request visual prompt labels Sep 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request visual prompt
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@dandansamax