timiasuy
/

L3-8B-Lunaris-v1-awq-marlin

4-bit precision

Model card Files Files and versions Community

timiasuy commited on Dec 25, 2024

Commit

4d9071b

·

verified ·

1 Parent(s): 1775c0a

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -23,7 +23,7 @@
     "bits": 4,
     "group_size": 128,
     "modules_to_not_convert": null,
-    "quant_method": "awq_marlin",
     "version": "marlin",
     "zero_point": false
   },

     "bits": 4,
     "group_size": 128,
     "modules_to_not_convert": null,
+    "quant_method": "awq",
     "version": "marlin",
     "zero_point": false
   },