Hugging Face's logo

distily
/
distily_test_attn_mlp

TensorBoard
Safetensors
Distily
gpt2
bitnet
1.58b
Generated from Trainer
Model card Files Metrics Community
lapp0 commited on
Commit
5f05e49
·
verified ·
1 Parent(s): 2dd829b

Training in progress, step 61875

Browse files
Files changed (4) hide show
  1. logs/attn_layer_mapper=all, attn_loss_fn=cos, attn_projector=mlp/events.out.tfevents.1724626648.e3f806ea38c9 +3 -0
  2. logs/attn_layer_mapper=layer-2, attn_loss_fn=raw_mse, attn_projector=mlp/completed.flag +0 -0
  3. model.safetensors +1 -1
  4. training_args.bin +1 -1
logs/attn_layer_mapper=all, attn_loss_fn=cos, attn_projector=mlp/events.out.tfevents.1724626648.e3f806ea38c9 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6ca29507a3e1fe68bbb16c5143994d2295039142168e161d9502510c7b8c3dc
3
+ size 29625265
logs/attn_layer_mapper=layer-2, attn_loss_fn=raw_mse, attn_projector=mlp/completed.flag ADDED
File without changes
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:93a50537c89dd951a3fa4a95dfc6acee39fa099aecf76913425bc2c41954de82
3
  size 248894656
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ffeb44bd63bbe2ffa8eea9a4658dd0ad97f321e20519a5cf765ecff28477e095
3
  size 248894656
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a1abcfee2d55e1203a688c48528e01f7cbabccbefa089fa3ca0db0afe647af0c
3
  size 5432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be7f9d2ce8d5961ec49052aacd016601cc9cf6a63fb8e6705a0d6f0cf395f6c1
3
  size 5432