File size: 903 Bytes
aba67ba |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 |
---
language:
- en
- de
- fr
- it
- pt
- hi
- es
- th
library_name: coreml
license: llama3.2
pipeline_tag: text-generation
tags:
- facebook
- meta
- llama
- llama-3
- CoreMLPipelines
---
# coreml-Llama-3.2-3B-Instruct-4bit
This model was converted from [meta-llama/Llama-3.2-3B-Instruct](https://hf.co/meta-llama/Llama-3.2-3B-Instruct) to CoreML using [coremlpipelinestools](https://github.com/finnvoor/CoreMLPipelines/tree/main/coremlpipelinestools).
### Use with [CoreMLPipelines](https://github.com/finnvoor/CoreMLPipelines)
```swift
import CoreMLPipelines
let pipeline = try await TextGenerationPipeline(
modelName: "finnvoorhees/coreml-Llama-3.2-3B-Instruct-4bit"
)
let stream = pipeline(
messages: [[
"role": "user",
"content": "Write a poem about Ireland"
]]
)
for try await text in stream {
print(text, terminator: "")
fflush(stdout)
}
print("")
```
|