gobean commited on
Commit
e20b586
·
verified ·
1 Parent(s): 450b3bf

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -15
README.md CHANGED
@@ -4,10 +4,15 @@ license: apache-2.0
4
 
5
  This is a llamafile for [WizardLM-2-7B](https://huggingface.co/microsoft/WizardLM-2-7B).
6
 
7
- Converted and tested on 4/15/2024.
8
 
9
  The q3-k-l sized quant is under 4gb if you want something to share with your windows-only users.
10
 
 
 
 
 
 
11
 
12
  -= Llamafile =-
13
 
@@ -18,19 +23,6 @@ Options can be passed in to expose the api etc. See their [docs](https://github.
18
 
19
  [Mozilla Blog Announcement for Llamafile](https://hacks.mozilla.org/2023/11/introducing-llamafile/)
20
 
21
-
22
- - Windows note: If it's over 4gb and you want to use it on Windows, you'll have to run it from WSL.
23
-
24
- - WSL note: If you get the error about APE, and the recommended command
25
-
26
- `sudo sh -c 'echo -1 > /proc/sys/fs/binfmt_misc/WSLInterop'`
27
-
28
- doesn't work, the WSLInterop file might be named something else. I had success with
29
-
30
- `sudo sh -c 'echo -1 > /proc/sys/fs/binfmt_misc/WSLInterop-late'`
31
-
32
- If that fails too, just navigate to `/proc/sys/fs/binfmt_msc` and see what files look like `WSLInterop`
33
- and echo a -1 to whatever they're called by changing that part of the recommended command.
34
-
35
 
36
  - FreeBSD note: Yes, it actually works on a fresh install of FreeBSD.
 
4
 
5
  This is a llamafile for [WizardLM-2-7B](https://huggingface.co/microsoft/WizardLM-2-7B).
6
 
7
+ Converted and tested on 4/15/2024. Safetensors came from microsoft's hf, quantized with llama.cpp, zipaligned with llamafile.
8
 
9
  The q3-k-l sized quant is under 4gb if you want something to share with your windows-only users.
10
 
11
+ Instructions to run q3-k-l on Windows:
12
+ Just download, add '.exe' to the filename, and open it. Bypass all friendly Microsoft warnings about using your own computer. It doesn't need network access, completely local.
13
+
14
+ Put it on a keychain! Share with friends! Perfect gift for significant other!
15
+
16
 
17
  -= Llamafile =-
18
 
 
23
 
24
  [Mozilla Blog Announcement for Llamafile](https://hacks.mozilla.org/2023/11/introducing-llamafile/)
25
 
26
+ - Windows: I tried the q3-k-l, it works.
 
 
 
 
 
 
 
 
 
 
 
 
 
27
 
28
  - FreeBSD note: Yes, it actually works on a fresh install of FreeBSD.