Hugging Face's logo
Straughter Guthrie's picture
3 7

Straughter Guthrie PRO

jmanhype
fullstack's profile picture todosi's profile picture 21world's profile picture
·

AI & ML interests

None yet

Recent Activity

liked a model 17 days ago
GoodiesHere/Apollo-LMMs-Apollo-3B-t32
replied to merve's post 17 days ago
Apollo is a new family of open-source video language models by Meta, where 3B model outperforms most 7B models and 7B outperforms most 30B models 🧶 ✨ the models come in 1.5B https://huggingface.co/Apollo-LMMs/Apollo-1_5B-t32, 3B https://huggingface.co/Apollo-LMMs/Apollo-3B-t32 and 7B https://huggingface.co/Apollo-LMMs/Apollo-7B-t32 with A2.0 license, based on Qwen1.5 & Qwen2 ✨ the authors also release a benchmark dataset https://huggingface.co/spaces/Apollo-LMMs/ApolloBench The paper has a lot of experiments (they trained 84 models!) about what makes the video LMs work ⏯️ Try the demo for best setup here https://huggingface.co/spaces/Apollo-LMMs/Apollo-3B they evaluate sampling strategies, scaling laws for models and datasets, video representation and more! > The authors find out that whatever design decision was applied to small models also scale properly when the model and dataset are scaled 📈 scaling dataset has diminishing returns for smaller models > They evaluate frame sampling strategies, and find that FPS sampling is better than uniform sampling, and they find 8-32 tokens per frame optimal > They also compare image encoders, they try a variation of models from shape optimized SigLIP to DINOv2 they find https://huggingface.co/google/siglip-so400m-patch14-384 to be most powerful 🔥 > they also compare freezing different parts of models, training all stages with some frozen parts give the best yield They eventually release three models, where Apollo-3B outperforms most 7B models and Apollo 7B outperforms 30B models 🔥
liked a model 27 days ago
Qwen/Qwen2.5-Coder-0.5B-Instruct
View all activity

Organizations

ZeroGPU Explorers's profile picture

jmanhype's activity

liked a model 17 days ago
replied to merve's post 17 days ago
view reply

You better know they realized they released something GODLIKE and decided us plebs cant have that ....

liked a model 27 days ago
liked a Space 27 days ago
updated 3 Spaces about 1 month ago