JiayouZhangGenbio
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -44,7 +44,7 @@ The fine-tuning process used **0.4 trillion tokens**, using AlphaFold database w
|
|
44 |
- **Hardware**: 64 NVIDIA A100 80GB GPUs
|
45 |
- **Learning Rate**: Max learning rate of 1e-4
|
46 |
- **Scheduler**: Cosine decay with 2.5% warmup
|
47 |
-
- **Tokens Trained**: 4T tokens
|
48 |
- **Training steps**: 200k steps
|
49 |
|
50 |
## Tokenization
|
|
|
44 |
- **Hardware**: 64 NVIDIA A100 80GB GPUs
|
45 |
- **Learning Rate**: Max learning rate of 1e-4
|
46 |
- **Scheduler**: Cosine decay with 2.5% warmup
|
47 |
+
- **Tokens Trained**: 0.4T tokens
|
48 |
- **Training steps**: 200k steps
|
49 |
|
50 |
## Tokenization
|