File size: 1,053 Bytes
6a21024
 
 
 
 
 
 
 
 
 
 
 
 
 
 
72eedb5
6a21024
 
 
 
 
 
 
 
 
7bf5e2a
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
---
language:
- "ain"
tags:
- "ainu"
- "masked-lm"
license: "cc-by-sa-4.0"
pipeline_tag: "fill-mask"
mask_token: "[MASK]"
---

# deberta-base-ainu

## Model Description

This is a DeBERTa(V2) model pre-trained on Ainu texts written in カタカナ, Roman, and Кириллица. You can fine-tune `deberta-base-ainu` for downstream tasks, such as [POS-tagging](https://huggingface.co/KoichiYasuoka/deberta-base-ainu-upos), [dependency-parsing](https://huggingface.co/KoichiYasuoka/deberta-base-ainu-ud-goeswith), and so on.

## How to Use

```py
from transformers import AutoTokenizer,AutoModelForMaskedLM
tokenizer=AutoTokenizer.from_pretrained("KoichiYasuoka/deberta-base-ainu")
model=AutoModelForMaskedLM.from_pretrained("KoichiYasuoka/deberta-base-ainu")
```

## Reference

安岡孝一: [ローマ字・カタカナ・キリル文字併用アイヌ語RoBERTa・DeBERTaモデルの開発](http://id.nii.ac.jp/1001/00224072/), 情報処理学会研究報告, Vol.2023-CH-131『人文科学とコンピュータ』, No.7 (2023年2月18日), pp.1-7.