| language: | |
| - en | |
| library_name: coreml | |
| license: apache-2.0 | |
| license_link: https://huggingface.co/Qwen/Qwen2.5-Coder-0.5B-Instruct/blob/main/LICENSE | |
| pipeline_tag: text-generation | |
| tags: | |
| - code | |
| - codeqwen | |
| - chat | |
| - qwen | |
| - qwen-coder | |
| - CoreMLPipelines | |
| # coreml-Qwen2.5-Coder-0.5B-Instruct-4bit | |
| This model was converted from [Qwen/Qwen2.5-Coder-0.5B-Instruct](https://hf.co/Qwen/Qwen2.5-Coder-0.5B-Instruct) to CoreML using [coremlpipelinestools](https://github.com/finnvoor/CoreMLPipelines/tree/main/coremlpipelinestools). | |
| ### Use with CoreMLPipelines | |
| ```swift | |
| import CoreMLPipelines | |
| let pipeline = try await TextGenerationPipeline( | |
| modelName: "finnvoorhees/coreml-Qwen2.5-Coder-0.5B-Instruct-4bit" | |
| ) | |
| let stream = pipeline( | |
| messages: [[ | |
| "role": "user", | |
| "content": "Write a poem about Ireland" | |
| ]] | |
| ) | |
| for try await text in stream { | |
| print(text, terminator: "") | |
| fflush(stdout) | |
| } | |
| print("") | |
| ``` | |