Jia-Ying Lin

linekin

AI & ML interests

None yet

Recent Activity

liked a model about 2 hours ago

AdaptLLM/Adapt-MLLM-to-Domains

reacted to m-ric's post with 👍 12 days ago

After 6 years, BERT, the workhorse of encoder models, finally gets a replacement: 𝗪𝗲𝗹𝗰𝗼𝗺𝗲 𝗠𝗼𝗱𝗲𝗿𝗻𝗕𝗘𝗥𝗧! 🤗 We talk a lot about ✨Generative AI✨, meaning "Decoder version of the Transformers architecture", but this is only one of the ways to build LLMs: encoder models, that turn a sentence in a vector, are maybe even more widely used in industry than generative models. The workhorse for this category has been BERT since its release in 2018 (that's prehistory for LLMs). It's not a fancy 100B parameters supermodel (just a few hundred millions), but it's an excellent workhorse, kind of a Honda Civic for LLMs. Many applications use BERT-family models - the top models in this category cumulate millions of downloads on the Hub. ➡️ Now a collaboration between Answer.AI and LightOn just introduced BERT's replacement: ModernBERT. 𝗧𝗟;𝗗𝗥: 🏛️ Architecture changes: ⇒ First, standard modernizations: - Rotary positional embeddings (RoPE) - Replace GeLU with GeGLU, - Use Flash Attention 2 ✨ The team also introduced innovative techniques like alternating attention instead of full attention, and sequence packing to get rid of padding overhead. 🥇 As a result, the model tops the game of encoder models: It beats previous standard DeBERTaV3 for 1/5th the memory footprint, and runs 4x faster! Read the blog post 👉 https://huggingface.co/blog/modernbert

reacted to m-ric's post with ❤️ 12 days ago

Since I published it on GitHub a few days ago, Hugging Face's new agentic library 𝘀𝗺𝗼𝗹𝗮𝗴𝗲𝗻𝘁𝘀 has gathered nearly 4k stars 🤯 ➡️ But we are just getting started on agents: so we are hiring an ML Engineer to join me and double down on this effort! The plan is to build GUI agents: agents that can act on your computer with mouse & keyboard, like Claude Computer Use. We will make it work better, and fully open. ✨ Sounds like something you'd like to do? Apply here 👉 https://apply.workable.com/huggingface/j/AF1D4E3FEB/

View all activity

Organizations

None yet

linekin's activity

liked a model about 2 hours ago

AdaptLLM/Adapt-MLLM-to-Domains

Updated Dec 14, 2024 • 10

liked 2 models 12 days ago

NousResearch/Hermes-3-Llama-3.2-3B-GGUF

Updated Dec 18, 2024 • 21.2k • 32

NousResearch/Hermes-3-Llama-3.1-8B

Text Generation • Updated Sep 8, 2024 • 49.4k • • 280

liked a model 13 days ago

microsoft/phi-4

Text Generation • Updated 12 days ago • 134k • 1.48k

liked a model 23 days ago

deepseek-ai/DeepSeek-V3

Updated 22 days ago • 162k • 2.1k

liked a dataset about 1 month ago

taide/taide-bench

Viewer • Updated Apr 12, 2024 • 500 • 98 • 13

liked a model about 1 month ago

google/gemma-2-9b

Text Generation • Updated Aug 7, 2024 • 90.8k • 628

liked a model about 2 months ago

HuggingFaceTB/SmolVLM-Instruct

Image-Text-to-Text • Updated Dec 2, 2024 • 42.9k • 329

liked a model 3 months ago

vikhyatk/moondream2

Image-Text-to-Text • Updated 12 days ago • 143k • 992

liked a dataset 3 months ago

aigrant/awesome-taiwan-knowledge

Preview • Updated Nov 16, 2024 • 88 • 16

liked 2 models 3 months ago

thenlper/gte-large

neulab/Pangea-7B

Updated Oct 24, 2024 • 8.16k • 122

liked 4 models 4 months ago

liked 2 models 5 months ago

Qwen/Qwen2-VL-7B-Instruct

Image-Text-to-Text • Updated 9 days ago • 1.7M • • 1.07k

poloclub/UniTable

Updated Apr 2, 2024 • 23

liked a dataset 5 months ago

gyr66/privacy_detection

Viewer • Updated Oct 17, 2023 • 2.52k • 37 • 3

liked a model 5 months ago