Chickaboo
/

Chicka-Mixtral-3x7b

Text Generation

Mixture of Experts

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Chickaboo commited on Apr 23, 2024

Commit

8eca765

·

verified ·

1 Parent(s): f92937d

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -19,8 +19,8 @@ from transformers import AutoModelForCausalLM, AutoTokenizer
 device = "cuda" # the device to load the model onto
-model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-Instruct-v0.2")
-tokenizer = AutoTokenizer.from_pretrained("mistralai/Mistral-7B-Instruct-v0.2")
 messages = [
     {"role": "user", "content": "What is your favourite condiment?"},

 device = "cuda" # the device to load the model onto
+model = AutoModelForCausalLM.from_pretrained("Chickaboo/Chicka-Mistral-4x7b")
+tokenizer = AutoTokenizer.from_pretrained("Chickaboo/Chicka-Mistral-4x7b")
 messages = [
     {"role": "user", "content": "What is your favourite condiment?"},