Hugging Face's logo

distily
/
distily_attn_distilgpt2_sweep

TensorBoard
Safetensors
Distily
gpt2
Generated from Trainer
Model card Files Metrics Community
lapp0 commited on
Commit
7a5efe9
·
verified ·
1 Parent(s): 4ccaeff

Training in progress, step 99000

Browse files
Files changed (5) hide show
  1. logs/attn_norm=layernorm, attn_projector=orthogonal, attn_weight=5, learning_rate=0.0002, per_device_train_batch_size=4, warmup_ratio=0/completed.flag +0 -0
  2. logs/attn_norm=layernorm, attn_projector=orthogonal, attn_weight=5, learning_rate=0.0002, per_device_train_batch_size=4, warmup_ratio=0/events.out.tfevents.1724981639.e3f806ea38c9 +2 -2
  3. logs/attn_norm=layernorm, attn_projector=orthogonal, attn_weight=5, learning_rate=0.0004, per_device_train_batch_size=4, warmup_ratio=0/events.out.tfevents.1724981850.e3f806ea38c9 +3 -0
  4. model.safetensors +1 -1
  5. training_args.bin +1 -1
logs/attn_norm=layernorm, attn_projector=orthogonal, attn_weight=5, learning_rate=0.0002, per_device_train_batch_size=4, warmup_ratio=0/completed.flag ADDED
File without changes
logs/attn_norm=layernorm, attn_projector=orthogonal, attn_weight=5, learning_rate=0.0002, per_device_train_batch_size=4, warmup_ratio=0/events.out.tfevents.1724981639.e3f806ea38c9 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9505fa007893389af791ac3cfff7b9cee3bbacf40383a79b77f5bb8bd5136d7d
3
- size 253
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ec32724559247159a3c260cbd54d836c2463eb26d0e804b044085b71e89285d
3
+ size 529
logs/attn_norm=layernorm, attn_projector=orthogonal, attn_weight=5, learning_rate=0.0004, per_device_train_batch_size=4, warmup_ratio=0/events.out.tfevents.1724981850.e3f806ea38c9 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f77c7a2321d532e28a734c29b770fadaab1d5896df27fde2ee650cf0659bfc43
3
+ size 47486054
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6a9d71acde22b2796bb3c8bb6fe3d7867473075cc8c9dc6a10286d77028dbbc2
3
  size 163832792
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01d3481bc973ebeb340724f7ff89081abeb5ac3f0733f021f8db68f1059c6e50
3
  size 163832792
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:160141cb7805280390693044f1c194ccde6aaf07de709143ed67f78f2974927f
3
  size 5560
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dab04769221304ecf1e8b1a6b1a68225de1ca61e6edb2229d9a52b1fea5c11cd
3
  size 5560