Om AI Lab

All

17 repositories

VLM-R1
Public
Solve Visual Understanding with Reinforced VLMs
reinforcement-learning vlm multimodal llm qwen deepseek-r1 grpo r1-zero vlm-r1 multimodal-r1
Python
•
Apache License 2.0
•302•4.9k•89•1•Updated Apr 21, 2025Apr 21, 2025
om-ai-lab.github.io
Public
Official website for the org
HTML
•0•0•0•0•Updated Mar 24, 2025Mar 24, 2025
VLM-R1.github.io
Public
Blog Site for VLM-R1
HTML
•0•1•0•0•Updated Mar 20, 2025Mar 20, 2025
OmAgent
Public
Build multimodal language agents for fast prototype and production
python agent workflow chatbot gemini openai llama gpt gradio vlm
Python
•
Apache License 2.0
•271•2.5k•4•13•Updated Mar 19, 2025Mar 19, 2025
RS5M
Public
RS5M: a large-scale vision language dataset for remote sensing [TGRS]
remote-sensing vision-and-language foundation-models
Python
•
MIT License
•11•256•3•0•Updated Mar 17, 2025Mar 17, 2025
open-agent-leaderboard
Public
Reproducible Language Agent Research
react agent reasoning llm chain-of-thought chatgpt gsm8k program-of-thoughts tree-of-thoughts language-agent
Python
•2•23•0•0•Updated Mar 9, 2025Mar 9, 2025
OmChat
Public
A suite of multimodal language models that are powerful and efficient
Python
•
Apache License 2.0
•3•18•0•0•Updated Jan 13, 2025Jan 13, 2025
OmAgentDocs
Public
HTML
•4•3•0•0•Updated Jan 8, 2025Jan 8, 2025
ZoomEye
Public
ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Exploration
vision-and-language large-language-models reasoning-agent
Python
•3•34•2•0•Updated Jan 1, 2025Jan 1, 2025
OmDet
Public
Real-time and accurate open-vocabulary end-to-end object detection
real-time computer-vision coco object-detection zero-shot vision-and-language lvis zero-shot-object-detection open-vocabulary
Python
•
Apache License 2.0
•110•1.3k•6•0•Updated Dec 18, 2024Dec 18, 2024
VL-CheckList
Public
Evaluating Vision & Language Pretraining Models with Objects, Attributes and Relations. [EMNLP 2022]
evaluation-metrics vision-and-language multimodal-deep-learning
Python
•5•130•8•0•Updated Sep 29, 2024Sep 29, 2024
OmModel
Public
A collection of strong multimodal models for building multimodal AGI agents
Apache License 2.0
•1•42•1•0•Updated Jul 9, 2024Jul 9, 2024
awesome-RSVLM
Public
Collection of Remote Sensing Vision-Language Models
MIT License
•4•135•0•1•Updated May 13, 2024May 13, 2024
OVDEval
Public
A Comprehensive Evaluation Benchmark for Open-Vocabulary Detection (AAAI 2024)
object-detection vision-and-language open-vocabulary-detection
Python
•
Apache License 2.0
•2•48•1•0•Updated May 7, 2024May 7, 2024
GroundVLP
Public
GroundVLP: Harnessing Zero-shot Visual Grounding from Vision-Language Pre-training and Open-Vocabulary Object Detection (AAAI 2024)
object-detection zero-shot-learning multimodal vision-and-language
Jupyter Notebook
•
Apache License 2.0
•4•66•2•0•Updated Jan 2, 2024Jan 2, 2024
habitat-lab
Public
A modular high-level library to train embodied AI agents across a variety of tasks, environments, and simulators.
Python
•
MIT License
•551•1•0•0•Updated Dec 22, 2021Dec 22, 2021
bottom-up-attention.pytorch
Public
An PyTorch reimplementation of bottom-up-attention models
Jupyter Notebook
•
Apache License 2.0
•76•0•0•0•Updated Jun 11, 2021Jun 11, 2021