ohayonguy/PMRF_blind_face_image_restoration
Image-to-Image
•
Updated
•
1.79k
•
11
Valeriy Selitskiy
WaveCut
AI & ML interests
Looking to switch from hobby to career
Recent Activity
liked
a model
about 11 hours ago
ohayonguy/PMRF_blind_face_image_restoration
liked
a Space
about 16 hours ago
FaceOnLive/Face-Search-Online
liked
a model
1 day ago
stabilityai/stable-fast-3d
Organizations
WaveCut's activity
liked
a
model
about 11 hours ago
liked
a
Space
about 16 hours ago
liked
2
models
1 day ago
liked
a
Space
1 day ago
liked
a
Space
2 days ago
liked
a
model
2 days ago
liked
2
Spaces
2 days ago
upvoted
a
collection
2 days ago
reacted to
grimjim's
post with 👍
2 days ago
Post
2434
I'm (finally) releasing a Python script that trims excess weights in Gemma2 full-weight models that bloated by ~1B parameters due to an early mergekit bug.
https://github.com/jim-plus/Gemma2-mergekit-remediation
I'd noticed something was off when merges of Gemma2 9B models ended up having ~10B parameters. The current mergekit package is fine, but there are still bloated models on HF that could stand to be fixed.
The script assumes that it will be run from the same directory as the model weights, and will trim the unnecessary lm_head.weight tensor and corresponding index entry.
https://github.com/jim-plus/Gemma2-mergekit-remediation
I'd noticed something was off when merges of Gemma2 9B models ended up having ~10B parameters. The current mergekit package is fine, but there are still bloated models on HF that could stand to be fixed.
The script assumes that it will be run from the same directory as the model weights, and will trim the unnecessary lm_head.weight tensor and corresponding index entry.
- 1 reply
liked
2
models
2 days ago
upvoted
a
collection
2 days ago
liked
a
model
2 days ago
liked
a
model
3 days ago
updated
a
model
3 days ago
liked
a
Space
3 days ago
upvoted
a
collection
3 days ago
liked
a
Space
3 days ago