opt-125m-FP8-Dynamic / recipe.yaml
alpindale's picture
Upload folder using huggingface_hub
9c55095 verified
raw
history blame contribute delete
136 Bytes
DEFAULT_stage:
DEFAULT_modifiers:
QuantizationModifier:
ignore: [lm_head]
targets: [Linear]
scheme: FP8_DYNAMIC