GGUF
English
Inference Endpoints
ybelkada commited on
Commit
3cc5744
·
verified ·
1 Parent(s): 1f4aa24

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -4
README.md CHANGED
@@ -43,15 +43,13 @@ Refer to the documentation of [`llama.cpp`](https://github.com/ggerganov/llama.c
43
  Download the GGUF weights with the command below:
44
 
45
  ```bash
46
- huggingface-cli download tiiuae/falcon-mamba-7b-instruct-GGUF --include FILENAME --local-dir ./
47
  ```
48
 
49
- with `FILENAME` being the filename you want to download locally.
50
-
51
  Once downloaded, you can quickly chat with it:
52
 
53
  ```bash
54
- ./llama-cli -m falcon-mamba-7b/falcon-mamba-7B-Q8_0.gguf -p "Hello how are you?"
55
  ```
56
 
57
  # Training Details
 
43
  Download the GGUF weights with the command below:
44
 
45
  ```bash
46
+ huggingface-cli download tiiuae/falcon-mamba-7b-Q8_0-GGUF --include falcon-mamba-Q8_0.gguf --local-dir ./
47
  ```
48
 
 
 
49
  Once downloaded, you can quickly chat with it:
50
 
51
  ```bash
52
+ ./llama-cli -m falcon-mamba-Q8_0.gguf -p "Hello how are you?"
53
  ```
54
 
55
  # Training Details