PrunaAI
/

TinyLlama-TinyLlama-1.1B-Chat-v0.3-bnb-4bit-smashed

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

TinyLlama-TinyLlama-1.1B-Chat-v0.3-bnb-4bit-smashed / generation_config.json

sharpenb's picture

eff1306c0bb362f29c10f366f82f0247689747f96fa346f1120d4b89e3f092fe

d375fe3 verified 10 months ago

63 Bytes

	{
	"max_new_tokens": 32,
	"transformers_version": "4.37.1"
	}