Safetensors
llama
anastasiastasenko commited on
Commit
bb13b04
·
verified ·
1 Parent(s): 852c081

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -0
README.md CHANGED
@@ -104,6 +104,17 @@ Despite these preventive measures, users should be aware that the model has not
104
 
105
  At Pleias, we continue to research and develop improved methods for creating safer and more equitable models and datasets. This includes ongoing work in toxicity reduction, bias mitigation, and the development of more sophisticated ethical filtering techniques.
106
 
 
 
 
 
 
 
 
 
 
 
 
107
 
108
  ## Update
109
  Pleias-pico-350m-Preview is currently released as an early preview.
 
104
 
105
  At Pleias, we continue to research and develop improved methods for creating safer and more equitable models and datasets. This includes ongoing work in toxicity reduction, bias mitigation, and the development of more sophisticated ethical filtering techniques.
106
 
107
+ ## Acknowledgements
108
+
109
+ This work would not have been possible without the substantial support from étalab.
110
+
111
+ The training was conducted as part of the Grand Challenge of GENCI, aligned with the European strategy for establishing AI factories through the EuroHPC Joint Undertaking, aimed at supporting European startups and providing open-source models to the community.
112
+
113
+ We express our gratitude to GENCI's Jean Zay supercomputer, France's AI flagship facility, which was instrumental in our model's training. The project benefited from the new NVIDIA H100 partition specifically dedicated to the French AI community. We appreciate the generous allocation of compute hours over five months and the invaluable technical expertise provided by IDRIS, EVIDEN, and NVIDIA (as well as its Inception program).
114
+
115
+ We are deeply grateful to the Mozilla Foundation Local AI Program for their generous support.
116
+
117
+ Finally, we acknowledge the significant contributions from the open science LLM community, particularly HuggingFace, Eleuther AI and Allen AI whose insights and cooperation have been invaluable to our work.
118
 
119
  ## Update
120
  Pleias-pico-350m-Preview is currently released as an early preview.