fakezeta
/

openchat-3.6-8b-20240522-ov-int4

Text Generation

Inference Endpoints

Model card Files Files and versions Community

fakezeta commited on Jun 26, 2024

Commit

1495e08

·

verified ·

1 Parent(s): e138a46

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -17,7 +17,7 @@ Model definition for LocalAI:
 name: openchat-3.6
 backend: transformers
 parameters:
-  model: fakezeta/openchat-3.6-8b-20240522-ov-int8
 context_size: 8192
 type: OVModelForCausalLM
 template:

 name: openchat-3.6
 backend: transformers
 parameters:
+  model: fakezeta/openchat-3.6-8b-20240522-ov-int4
 context_size: 8192
 type: OVModelForCausalLM
 template: