SungBeom commited on
Commit
d6a4b3d
ยท
1 Parent(s): 24a9843

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -12,6 +12,10 @@ metrics:
12
  # Conformer-ctc-medium-ko
13
  ํ•ด๋‹น ๋ชจ๋ธ์€ [RIVA Conformer ASR Korean](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/tao/models/speechtotext_ko_kr_conformer)์„ AI hub dataset์— ๋Œ€ํ•ด ํŒŒ์ธํŠœ๋‹์„ ์ง„ํ–‰ํ–ˆ์Šต๋‹ˆ๋‹ค. <br>
14
  Conformer ๊ธฐ๋ฐ˜์˜ ๋ชจ๋ธ์€ whisper์™€ ๊ฐ™์€ attention ๊ธฐ๋ฐ˜ ๋ชจ๋ธ๊ณผ ๋‹ฌ๋ฆฌ streaming์„ ์ง„ํ–‰ํ•˜์—ฌ๋„ ์„ฑ๋Šฅ์ด ํฌ๊ฒŒ ๋–จ์–ด์ง€์ง€ ์•Š๊ณ , ์†๋„๊ฐ€ ๋น ๋ฅด๋‹ค๋Š” ์žฅ์ ์ด ์žˆ์Šต๋‹ˆ๋‹ค.
 
 
 
 
15
 
16
 
17
  ### dataset
 
12
  # Conformer-ctc-medium-ko
13
  ํ•ด๋‹น ๋ชจ๋ธ์€ [RIVA Conformer ASR Korean](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/tao/models/speechtotext_ko_kr_conformer)์„ AI hub dataset์— ๋Œ€ํ•ด ํŒŒ์ธํŠœ๋‹์„ ์ง„ํ–‰ํ–ˆ์Šต๋‹ˆ๋‹ค. <br>
14
  Conformer ๊ธฐ๋ฐ˜์˜ ๋ชจ๋ธ์€ whisper์™€ ๊ฐ™์€ attention ๊ธฐ๋ฐ˜ ๋ชจ๋ธ๊ณผ ๋‹ฌ๋ฆฌ streaming์„ ์ง„ํ–‰ํ•˜์—ฌ๋„ ์„ฑ๋Šฅ์ด ํฌ๊ฒŒ ๋–จ์–ด์ง€์ง€ ์•Š๊ณ , ์†๋„๊ฐ€ ๋น ๋ฅด๋‹ค๋Š” ์žฅ์ ์ด ์žˆ์Šต๋‹ˆ๋‹ค.
15
+ V100 GPU์—์„œ๋Š” RTF๊ฐ€ 0.05, CPU(7 cores)์—์„œ๋Š” 0.35 ์ •๋„ ๋‚˜์˜ค๋Š” ๊ฒƒ์„ ํ™•์ธํ•  ์ˆ˜ ์žˆ์—ˆ์Šต๋‹ˆ๋‹ค.
16
+ ์˜ค๋””์˜ค chunk size 2์ดˆ์˜ streaming ํ…Œ์ŠคํŠธ์—์„œ๋Š” ์ „์ฒด ์˜ค๋””์˜ค๋ฅผ ๋„ฃ๋Š” ๊ฒƒ์— ๋น„ํ•ด์„œ๋Š” 20% ์ •๋„ ์„ฑ๋Šฅ์ €ํ•˜๊ฐ€ ์žˆ์œผ๋‚˜ ์ถฉ๋ถ„ํžˆ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ๋Š” ์„ฑ๋Šฅ์ž…๋‹ˆ๋‹ค.
17
+ ์ถ”๊ฐ€๋กœ open domain์ด ์•„๋‹Œ ๊ณ ๊ฐ ์‘๋Œ€ ์Œ์„ฑ๊ณผ ๊ฐ™์€ domain์—์„œ๋Š” kenlm์„ ์ถ”๊ฐ€ํ•˜์˜€์„ ๋•Œ WER 13.45์—์„œ WER 5.27๋กœ ํฌ๊ฒŒ ์„ฑ๋Šฅ ํ–ฅ์ƒ์ด ์žˆ์—ˆ์Šต๋‹ˆ๋‹ค.
18
+ ํ•˜์ง€๋งŒ ๊ทธ ์™ธ์˜ domain์—์„œ๋Š” kenlm์˜ ์ถ”๊ฐ€๊ฐ€ ํฐ ์„ฑ๋Šฅ ํ–ฅ์ƒ์œผ๋กœ ์ด์–ด์ง€์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค.
19
 
20
 
21
  ### dataset