mradermacher
/

AstraLM-16B-MoE-GGUF

Mixture of Experts

NousResearch/Llama-2-7b-chat-hf

mistralai/Mistral-7B-Instruct-v0.2

codellama/CodeLlama-7b-Instruct-hf

Inference Endpoints

Model card Files Files and versions Community

mradermacher commited on Apr 2, 2024

Commit

eb3795c

·

verified ·

1 Parent(s): 4ef635f

uploaded from nethype/back

Files changed (2) hide show

.gitattributes +1 -0
AstraLM-16B-MoE.Q6_K.gguf +3 -0

.gitattributes CHANGED Viewed

@@ -39,3 +39,4 @@ AstraLM-16B-MoE.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
 AstraLM-16B-MoE.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
 AstraLM-16B-MoE.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
 AstraLM-16B-MoE.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text

 AstraLM-16B-MoE.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
 AstraLM-16B-MoE.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
 AstraLM-16B-MoE.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+AstraLM-16B-MoE.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

AstraLM-16B-MoE.Q6_K.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b224bfe624062aea80d29b9abf861b9a73f45ae707bc89464ec4b3613a36a0d0
+size 13198971264