|
--- |
|
license: mit |
|
language: |
|
- en |
|
inference: true |
|
base_model: |
|
- FacebookAI/roberta-base |
|
pipeline_tag: fill-mask |
|
tags: |
|
- fill-mask |
|
- smart-contract |
|
- web3 |
|
- software-engineering |
|
- embedding |
|
- codebert |
|
library_name: transformers |
|
--- |
|
|
|
# SmartBERT V1 RoBERTa (2022) |
|
|
|
## Overview |
|
|
|
This **smart contract pre-trained model** is used to transfer smart contract _function-level_ code to embeddings. |
|
|
|
It is trained by **[Sen Fang](https://github.com/TomasAndersonFang)** in 2022 on over **40,000** smart contracts. |
|
|
|
Initialized with **RoBERTa** |
|
|
|
Please update to [SmartBERT V2](https://huggingface.co/web3se/SmartBERT-v2) |
|
|
|
## Thanks |
|
|
|
- [Institute of Intelligent Computing Technology, Suzhou, CAS](http://iict.ac.cn/) |
