finnvoorhees commited on
Commit
97f9361
·
verified ·
1 Parent(s): 9b5561b

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +41 -0
README.md ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ library_name: coreml
5
+ license: apache-2.0
6
+ license_link: https://huggingface.co/Qwen/Qwen2.5-Coder-0.5B-Instruct/blob/main/LICENSE
7
+ pipeline_tag: text-generation
8
+ tags:
9
+ - code
10
+ - codeqwen
11
+ - chat
12
+ - qwen
13
+ - qwen-coder
14
+ - CoreMLPipelines
15
+ ---
16
+
17
+ # coreml-Qwen2.5-Coder-0.5B-Instruct-4bit
18
+
19
+ This model was converted from [Qwen/Qwen2.5-Coder-0.5B-Instruct](https://hf.co/Qwen/Qwen2.5-Coder-0.5B-Instruct) to CoreML using [coremlpipelinestools](https://github.com/finnvoor/CoreMLPipelines/tree/main/coremlpipelinestools).
20
+
21
+ ### Use with CoreMLPipelines
22
+
23
+ ```swift
24
+ import CoreMLPipelines
25
+
26
+ let pipeline = try await TextGenerationPipeline(
27
+ modelName: "finnvoorhees/coreml-Qwen2.5-Coder-0.5B-Instruct-4bit"
28
+ )
29
+ let stream = pipeline(
30
+ messages: [[
31
+ "role": "user",
32
+ "content": "Write a poem about Ireland"
33
+ ]]
34
+ )
35
+ for try await text in stream {
36
+ print(text, terminator: "")
37
+ fflush(stdout)
38
+ }
39
+ print("")
40
+ ```
41
+