-
Improved Baselines with Visual Instruction Tuning
Paper β’ 2310.03744 β’ Published β’ 37 -
DeepSeek-VL: Towards Real-World Vision-Language Understanding
Paper β’ 2403.05525 β’ Published β’ 40 -
Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities
Paper β’ 2308.12966 β’ Published β’ 7 -
LLaVA-Gemma: Accelerating Multimodal Foundation Models with a Compact Language Model
Paper β’ 2404.01331 β’ Published β’ 25
Collections
Discover the best community collections!
Collections including paper arxiv:2403.11703
-
Improved Baselines with Visual Instruction Tuning
Paper β’ 2310.03744 β’ Published β’ 37 -
DeepSeek-VL: Towards Real-World Vision-Language Understanding
Paper β’ 2403.05525 β’ Published β’ 40 -
Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities
Paper β’ 2308.12966 β’ Published β’ 7 -
LLaVA-Gemma: Accelerating Multimodal Foundation Models with a Compact Language Model
Paper β’ 2404.01331 β’ Published β’ 25
-
LLaVA-OneVision: Easy Visual Task Transfer
Paper β’ 2408.03326 β’ Published β’ 60 -
VILA^2: VILA Augmented VILA
Paper β’ 2407.17453 β’ Published β’ 40 -
PaliGemma: A versatile 3B VLM for transfer
Paper β’ 2407.07726 β’ Published β’ 68 -
openbmb/MiniCPM-V-2_6
Image-Text-to-Text β’ Updated β’ 36.9k β’ 884
-
Woodpecker: Hallucination Correction for Multimodal Large Language Models
Paper β’ 2310.16045 β’ Published β’ 15 -
SILC: Improving Vision Language Pretraining with Self-Distillation
Paper β’ 2310.13355 β’ Published β’ 8 -
To See is to Believe: Prompting GPT-4V for Better Visual Instruction Tuning
Paper β’ 2311.07574 β’ Published β’ 14 -
MyVLM: Personalizing VLMs for User-Specific Queries
Paper β’ 2403.14599 β’ Published β’ 15
-
MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training
Paper β’ 2403.09611 β’ Published β’ 125 -
Evolutionary Optimization of Model Merging Recipes
Paper β’ 2403.13187 β’ Published β’ 50 -
MobileVLM V2: Faster and Stronger Baseline for Vision Language Model
Paper β’ 2402.03766 β’ Published β’ 13 -
LLM Agent Operating System
Paper β’ 2403.16971 β’ Published β’ 65
-
Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset
Paper β’ 2403.09029 β’ Published β’ 54 -
Cleaner Pretraining Corpus Curation with Neural Web Scraping
Paper β’ 2402.14652 β’ Published -
LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Images
Paper β’ 2403.11703 β’ Published β’ 16
-
How Far Are We from Intelligent Visual Deductive Reasoning?
Paper β’ 2403.04732 β’ Published β’ 19 -
MoAI: Mixture of All Intelligence for Large Language and Vision Models
Paper β’ 2403.07508 β’ Published β’ 74 -
DragAnything: Motion Control for Anything using Entity Representation
Paper β’ 2403.07420 β’ Published β’ 13 -
Learning and Leveraging World Models in Visual Representation Learning
Paper β’ 2403.00504 β’ Published β’ 31
-
Veagle: Advancements in Multimodal Representation Learning
Paper β’ 2403.08773 β’ Published β’ 7 -
mPLUG-Owl: Modularization Empowers Large Language Models with Multimodality
Paper β’ 2304.14178 β’ Published β’ 3 -
Chart-based Reasoning: Transferring Capabilities from LLMs to VLMs
Paper β’ 2403.12596 β’ Published β’ 9 -
LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Images
Paper β’ 2403.11703 β’ Published β’ 16
-
FaceChain-SuDe: Building Derived Class to Inherit Category Attributes for One-shot Subject-Driven Generation
Paper β’ 2403.06775 β’ Published β’ 3 -
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Paper β’ 2010.11929 β’ Published β’ 7 -
Data Incubation -- Synthesizing Missing Data for Handwriting Recognition
Paper β’ 2110.07040 β’ Published β’ 2 -
A Mixture of Expert Approach for Low-Cost Customization of Deep Neural Networks
Paper β’ 1811.00056 β’ Published β’ 2