JiayouZhangGenbio commited on
Commit
80d9278
·
verified ·
1 Parent(s): b1a3138

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -44,7 +44,7 @@ The fine-tuning process used **0.4 trillion tokens**, using AlphaFold database w
44
  - **Hardware**: 64 NVIDIA A100 80GB GPUs
45
  - **Learning Rate**: Max learning rate of 1e-4
46
  - **Scheduler**: Cosine decay with 2.5% warmup
47
- - **Tokens Trained**: 4T tokens
48
  - **Training steps**: 200k steps
49
 
50
  ## Tokenization
 
44
  - **Hardware**: 64 NVIDIA A100 80GB GPUs
45
  - **Learning Rate**: Max learning rate of 1e-4
46
  - **Scheduler**: Cosine decay with 2.5% warmup
47
+ - **Tokens Trained**: 0.4T tokens
48
  - **Training steps**: 200k steps
49
 
50
  ## Tokenization