Training Large Language Models to Reason in a Continuous Latent Space
Paper
•
2412.06769
•
Published
•
75
Korek Rybens
Rybens
AI & ML interests
None yet
Recent Activity
liked
a model
20 days ago
bartowski/Deepthink-Reasoning-7B-GGUF
liked
a model
30 days ago
deepseek-ai/DeepSeek-V3
reacted
to
fuzzy-mittenz's
post
with ❤️
about 1 month ago
So a cool thing happened,
Nomic/GPT4ALL released a "Reasoning/Thinking"(QwQ/o1/o3 type) Model using JavaScript functions to calculate things like the haversine function for distance between two places and so on, it's VERY cool the complex calculative/recursive AI in such a small package..
I was able to adapt their methods to one of my small models "Replicant" 2gb and created a new model with importance matrix Quantization using "THE_KEY" Dataset for better inference in the coding model I pulled from Whiterabbitneo's Qwen2.5 model... I give you Reasoning Rabbit.. enjoy
https://huggingface.co/IntelligentEstate/o3-ReasoningRabbit_Q2.5-Cd-7B-IQ4_XS-GGUF
-IntelligentEstate/o3-ReasoningRabbit_Q2.5-Cd-7B-IQ4_XS-GGUF
https://huggingface.co/IntelligentEstate/Replicant_Warder-o3-Q2.5_3B-iQ5_K_S-GGUF
IntelligentEstate/Replicant_Warder-o3-Q2.5_3B-iQ5_K_S-GGUF
-WhiteRabbitNeo/WhiteRabbitNeo-2.5-Qwen-2.5-Coder-7B
Organizations
