---
language:
- eng
pipeline_tag: text-generation

Trained: Pretrain
Config file: 1.3B
Data: Vietnamese Dataset 30GB(CulturaX) + Project(1.3B)
---
# Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->

Pretrained GPT-NeoX model with 31.3 Vietnamese dataset. Took about 4.5 hours to reach 40,000 iterations. Trained on A100 40GB GPU and 48 core CPU.

## Model Details

### Model Description

<!-- Provide a longer summary of what this model is. -->



- **Developed by:** Eunyoung Lee
- **Model type:** GPT-NeoX
- **Language(s) (NLP):** Vietnamese