aipib
/

phillama-prune3

Text Generation

raincandy-u/phillama-3.8b-v1

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

phillama-prune3 / mergekit_config.yml

aipib's picture

Upload folder using huggingface_hub

f0e92cb verified 9 months ago

224 Bytes


	slices:
	- sources:
	- model: raincandy-u/phillama-3.8b-v1
	layer_range: [0, 22]
	- sources:
	- model: raincandy-u/phillama-3.8b-v1
	layer_range: [26, 32]
	merge_method: passthrough
	dtype: bfloat16