Hugging Face's logo

dranger003
/
c4ai-command-r-v01-iMat.GGUF

Text Generation
GGUF
Inference Endpoints
imatrix
conversational
Model card Files Community
6
dranger003 commited on
Commit
cd38d2e
·
verified ·
1 Parent(s): 157e2d9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -4,7 +4,7 @@ pipeline_tag: text-generation
4
  library_name: gguf
5
  base_model: CohereForAI/c4ai-command-r-v01
6
  ---
7
- **NOTE**: This is a preview of upcoming [PR#6033](https://github.com/ggerganov/llama.cpp/pull/6033).
8
 
9
  * GGUF importance matrix (imatrix) quants for https://huggingface.co/CohereForAI/c4ai-command-r-v01
10
  * The importance matrix was trained for ~100K tokens (200 batches of 512 tokens) using [wiki.train.raw](https://huggingface.co/datasets/wikitext).
 
4
  library_name: gguf
5
  base_model: CohereForAI/c4ai-command-r-v01
6
  ---
7
+ **NOTE**: Support for this model just got merged - commit [`12247f4`](https://github.com/ggerganov/llama.cpp/commit/12247f4c69a173b9482f68aaa174ec37fc909ccf) - [`PR#6033`](https://github.com/ggerganov/llama.cpp/pull/6033).
8
 
9
  * GGUF importance matrix (imatrix) quants for https://huggingface.co/CohereForAI/c4ai-command-r-v01
10
  * The importance matrix was trained for ~100K tokens (200 batches of 512 tokens) using [wiki.train.raw](https://huggingface.co/datasets/wikitext).