Adding device specific configs & more input image type options + small model spec from args change

Add fields to configs, fix issue with offload from bnb, remove extra random text code

Small fixes & clean up

Add offloading & improved fp8 inference.