FoundationVision

All

9 repositories

GLEE
Public
[CVPR2024 Highlight]GLEE: General Object Foundation Model for Images and Videos at Scale
tracking open-world object-detection interactive-segmentation video-object-segmentation referring-expression-segmentation referring-expression-comprehension video-instance-segmentation zero-shot-object-detection referring-video-object-segmentation
Python
•
MIT License
•83•1.1k•34•2•Updated Oct 21, 2024Oct 21, 2024
VAR
Public
[NeurIPS 2024 Oral][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!
transformers generative-model image-generation auto-regressive-model gpt neurips gpt-2 diffusion-models autoregressive-models vision-transformer
Python
•
MIT License
•309•4.2k•30•0•Updated Oct 6, 2024Oct 6, 2024
LlamaGen
Public
Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation
image-generation llama auto-regressive-model diffusion text2image diffusion-models llm
Python
•
MIT License
•54•1.3k•44•0•Updated Aug 15, 2024Aug 15, 2024
OmniTokenizer
Public
OmniTokenizer: one model and one weight for image-video joint tokenization.
vae image-generation auto-regressive-model tokenization video-generation vqvae
Python
•
MIT License
•7•250•8•0•Updated Jul 9, 2024Jul 9, 2024
vaex
Public
🔥stable, simple, state-of-the-art VQVAE toolkit & cookbook
Python
•
MIT License
•0•40•1•0•Updated Jun 23, 2024Jun 23, 2024
Groma
Public
[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization
llama multimodal grounding foundation-models large-language-models llm mllm vision-language-model llama2
Python
•
Apache License 2.0
•58•555•2•0•Updated Jun 7, 2024Jun 7, 2024
GenerateU
Public
[CVPR2024] Generative Region-Language Pretraining for Open-Ended Object Detection
open-world object-detection multimodality open-vocabulary mllm open-vocabulary-detection
Python
•6•135•12•0•Updated Mar 25, 2024Mar 25, 2024
UniRef
Public
[ICCV2023] Segment Every Reference Object in Spatial and Temporal Spaces
object-segmentation unified-model
Python
•
MIT License
•15•235•4•0•Updated Jan 10, 2024Jan 10, 2024
.github
Public
0•0•0•0•Updated Dec 16, 2023Dec 16, 2023