gobean commited on
Commit
b1db3f6
·
verified ·
1 Parent(s): 18eff30

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -1
README.md CHANGED
@@ -6,13 +6,32 @@ This is a llamafile for [WizardLM-2-7B](https://huggingface.co/microsoft/WizardL
6
 
7
  Converted and tested on 4/15/2024. Safetensors came from microsoft's hf, quantized with llama.cpp, zipaligned with llamafile.
8
 
9
- The q3-k-l sized quant is under 4gb if you want something to share with your windows-only users.
10
 
11
  Instructions to run q3-k-l on Windows:
12
  Just download, add '.exe' to the filename, and open it. Bypass all friendly Microsoft warnings about using your own computer. It doesn't need network access, completely local.
13
 
14
  Put it on a keychain! Share with friends! Perfect gift for significant other!
15
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
 
17
  -= Llamafile =-
18
 
 
6
 
7
  Converted and tested on 4/15/2024. Safetensors came from microsoft's hf, quantized with llama.cpp, zipaligned with llamafile.
8
 
9
+ The q3-k-l sized quant is under 4gb if you want something to share with your windows-only users. Quality is higher than the average high school student.
10
 
11
  Instructions to run q3-k-l on Windows:
12
  Just download, add '.exe' to the filename, and open it. Bypass all friendly Microsoft warnings about using your own computer. It doesn't need network access, completely local.
13
 
14
  Put it on a keychain! Share with friends! Perfect gift for significant other!
15
 
16
+ usage notes:
17
+ Anything larger than the q3-k-l is going to be over 4gb and won't run as an .exe in Windows.
18
+ You'll need to use WSL, or another operating system.
19
+
20
+ WSL: If you get the error about APE, and the recommended command
21
+
22
+ sudo sh -c 'echo -1 > /proc/sys/fs/binfmt_misc/WSLInterop'
23
+
24
+ doesn't work, the WSLInterop file might be named something else. I had success with
25
+
26
+ sudo sh -c 'echo -1 > /proc/sys/fs/binfmt_misc/WSLInterop-late'
27
+
28
+ If that fails too, just navigate to /proc/sys/fs/binfmt_msc and see what files look like WSLInterop and echo a -1 to whatever they're called by changing that part of the recommended command.
29
+
30
+
31
+ size note:
32
+
33
+ Use q8_0, it's good.
34
+
35
 
36
  -= Llamafile =-
37