Collection by
Mar 12, 2024
Mar 12, 2024
Collections
Discover the best community collections!
Collections including paper arxiv:2110.03742
Collection by
Mar 12, 2024
Mar 12, 2024
Collection by
Mar 15, 2024
Mar 15, 2024
-
Turn Waste into Worth: Rectifying Top-k Router of MoE
Paper • 2402.12399 • Published • 2 -
CompeteSMoE -- Effective Training of Sparse Mixture of Experts via Competition
Paper • 2402.02526 • Published • 3 -
Buffer Overflow in Mixture of Experts
Paper • 2402.05526 • Published • 8 -
OpenMoE: An Early Effort on Open Mixture-of-Experts Language Models
Paper • 2402.01739 • Published • 27
Collection by
about 1 month ago
about 1 month ago
-
Non-asymptotic oracle inequalities for the Lasso in high-dimensional mixture of experts
Paper • 2009.10622 • Published • 1 -
MoE-LLaVA: Mixture of Experts for Large Vision-Language Models
Paper • 2401.15947 • Published • 50 -
MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts
Paper • 2401.04081 • Published • 70 -
MoE-Infinity: Activation-Aware Expert Offloading for Efficient MoE Serving
Paper • 2401.14361 • Published • 2
Collection by
Jul 18, 2024
Jul 18, 2024
-
FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Models
Paper • 2402.10986 • Published • 78 -
bigcode/starcoder2-15b
Text Generation • Updated • 29.9k • • 578 -
Zephyr: Direct Distillation of LM Alignment
Paper • 2310.16944 • Published • 123 -
mixedbread-ai/mxbai-rerank-large-v1
Text Classification • Updated • 26.4k • 120
Collection by
Jun 15, 2024
Jun 15, 2024
-
Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models
Paper • 2310.04406 • Published • 8 -
Chain-of-Thought Reasoning Without Prompting
Paper • 2402.10200 • Published • 105 -
ICDPO: Effectively Borrowing Alignment Capability of Others via In-context Direct Preference Optimization
Paper • 2402.09320 • Published • 6 -
Self-Discover: Large Language Models Self-Compose Reasoning Structures
Paper • 2402.03620 • Published • 115