2 21 76

neuralink

AI & ML interests

None yet

Recent Activity

liked a Space 17 days ago

sail/scaling-with-vocab-demo

liked a Space 17 days ago

lvwerra/harms-law

liked a model 24 days ago

tencent/Tencent-Hunyuan-Large

View all activity

Articles

A failed experiment: Infini-Attention, and why we should keep trying?

Aug 14, 2024

• 56

Organizations

neuralink's activity

upvoted a paper about 1 month ago

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published Apr 22, 2024 • 253

upvoted a paper 4 months ago

Small-scale proxies for large-scale Transformer training instabilities

Paper • 2309.14322 • Published Sep 25, 2023 • 19

upvoted an article 4 months ago

Article

How NuminaMath Won the 1st AIMO Progress Prize

Jul 11, 2024

• 109

upvoted a paper 4 months ago

Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets

Paper • 2201.02177 • Published Jan 6, 2022 • 2

upvoted an article 5 months ago

Article

A failed experiment: Infini-Attention, and why we should keep trying?

Aug 14, 2024

• 56

upvoted 2 papers 5 months ago

Grokfast: Accelerated Grokking by Amplifying Slow Gradients

Paper • 2405.20233 • Published May 30, 2024 • 6

Transformer Explainer: Interactive Learning of Text-Generative Models

Paper • 2408.04619 • Published Aug 8, 2024 • 155

upvoted a paper 6 months ago

What matters when building vision-language models?

Paper • 2405.02246 • Published May 3, 2024 • 101

upvoted a paper 7 months ago

DiPaCo: Distributed Path Composition

Paper • 2403.10616 • Published Mar 15, 2024 • 12

upvoted 2 articles 7 months ago

Article

Putting RL back in RLHF

Jun 12, 2024

• 66

Article

Let's talk about LLM evaluation

•

May 23, 2024

• 143

upvoted a paper 9 months ago

Fully-fused Multi-Layer Perceptrons on Intel Data Center GPUs

Paper • 2403.17607 • Published Mar 26, 2024 • 8

upvoted 3 papers 10 months ago

upvoted a paper 11 months ago

FP8-LM: Training FP8 Large Language Models

Paper • 2310.18313 • Published Oct 27, 2023 • 33

upvoted a paper 12 months ago

Zero Bubble Pipeline Parallelism

Paper • 2401.10241 • Published Nov 30, 2023 • 23

upvoted 3 papers about 1 year ago

Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Action

Paper • 2312.17172 • Published Dec 28, 2023 • 27

OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents

Paper • 2306.16527 • Published Jun 21, 2023 • 47

RWKV: Reinventing RNNs for the Transformer Era

Paper • 2305.13048 • Published May 22, 2023 • 15