Stevross commited on
Commit
b004e09
·
1 Parent(s): 54217ca

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -15,7 +15,8 @@ thumbnail: https://static.wixstatic.com/media/bdee4e_d0af74523fa64a998d4cfb894e8
15
 
16
  Model Card
17
  Summary
18
- This model, Astrid-7B-1, is a GPT-NeoX model for causal language modeling, designed to generate human-like text.
 
19
  It's part of our mission to make AI technology accessible to everyone, focusing on personalization, data privacy, and transparent AI governance.
20
  Trained in English, it's a versatile tool for a variety of applications.
21
  This model is one of the many models available on our platform, and we currently have a 1B and 7B open-source model.
 
15
 
16
  Model Card
17
  Summary
18
+ The model Astrid-7B-1 architecture includes a RWForCausalLM transformer with word embeddings, a module list of 32 DecoderLayers, and a linear lm_head.
19
+ The DecoderLayer includes an input layer normalization, self-attention mechanism, and a multi-layer perceptron (MLP).
20
  It's part of our mission to make AI technology accessible to everyone, focusing on personalization, data privacy, and transparent AI governance.
21
  Trained in English, it's a versatile tool for a variety of applications.
22
  This model is one of the many models available on our platform, and we currently have a 1B and 7B open-source model.