{
    "componentChunkName": "component---src-templates-post-tsx",
    "path": "/korean-plm/",
    "result": {"data":{"logo":null,"markdownRemark":{"html":"<h1>한국어 사전학습 모델 (Korean Pre-trained Language Model)</h1>\n<p>공개된 한국어 사전학습 모델을 기록합니다. 크게 아래 3개의 모델 계열로 구분했으며, 모델 사이즈는 정확하지 않을 수 있습니다.</p>\n<ul>\n<li>\n<p>Encoder Model (BERT 계열)</p>\n</li>\n<li>\n<p>Decoder Model (GPT 계열)</p>\n</li>\n<li>\n<p>Encoder-Decoder Model (Seq2seq 계열)</p>\n</li>\n</ul>\n<h2>Encoder Model (BERT 계열)</h2>\n<table>\n<thead>\n<tr>\n<th align=\"center\">Model Name</th>\n<th align=\"center\">Size</th>\n<th align=\"center\">Link</th>\n</tr>\n</thead>\n<tbody>\n<tr>\n<td align=\"center\">LASSL BERT</td>\n<td align=\"center\">Small (10M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/lassl/bert-ko-small\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">LASSL RoBERTa</td>\n<td align=\"center\">Small (10M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/lassl/roberta-ko-small\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">TUNiB ELECTRA (Ko)</td>\n<td align=\"center\">Small (10M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/tunib/electra-ko-small\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">TUNiB ELECTRA (Ko-En)</td>\n<td align=\"center\">Small (10M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/tunib/electra-ko-en-small\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KoELECTRA</td>\n<td align=\"center\">Small (10M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/monologg/koelectra-small-v3-discriminator\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KcELECTRA</td>\n<td align=\"center\">Small (10M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/beomi/kcelectra-v2022-dev\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">Soongsil-BERT</td>\n<td align=\"center\">Small (10M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/jason9693/soongsil-bert-small\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">Ko-CHAR-ELECTRA</td>\n<td align=\"center\">Small (10M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/monologg/kocharelectra-small-discriminator\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">Distill-KoBERT</td>\n<td align=\"center\">30M</td>\n<td align=\"center\"><a href=\"https://huggingface.co/monologg/kocharelectra-base-discriminator\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KoBERT</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/skt/kobert-base-v1\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KorBERT</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://aiopen.etri.re.kr/service_dataset.php\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">HanBERT</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://github.com/monologg/HanBert-Transformers\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KcBERT</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/beomi/kcbert-base\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">Soongsil-BERT</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/jason9693/soongsil-bert-base\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KLUE-RoBERTa</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/klue/roberta-base\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KoELECTRA</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/monologg/koelectra-base-v3-discriminator\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KcELECTRA</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/beomi/KcELECTRA-base\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">TUNiB-ELECTRA (Ko)</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/tunib/electra-ko-base\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">TUNiB-ELECTRA (Ko-En)</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/tunib/electra-ko-en-base\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">LMKor Albert</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/kykim/albert-kor-base\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">LMKor Bert</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/kykim/bert-kor-base\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">LMKor Funnel</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/kykim/funnel-kor-base\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">LMKor ELECTRA</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/kykim/electra-kor-base\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KalBERT</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://github.com/MrBananaHuman/KalBert\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">LASSL BERT</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/lassl/bert-ko-base\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KoBigBird</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/monologg/kobigbird-bert-base\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">Ko-CHAR-BERT</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://github.com/MrBananaHuman/KoreanCharacterBert\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">Ko-CHAR-ELECTRA</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/monologg/kocharelectra-base-discriminator\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">BrainSBERT</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/hyunwoongko/brainsbert-base\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KPFBERT</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/jinmang2/kpfbert\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KcBERT</td>\n<td align=\"center\">Large (340M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/beomi/kcbert-large\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KLUE-RoBERTa</td>\n<td align=\"center\">Large (340M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/klue/roberta-large\">link</a></td>\n</tr>\n</tbody>\n</table>\n<h2>Decoder Model (GPT 계열)</h2>\n<table>\n<thead>\n<tr>\n<th align=\"center\">Model Name</th>\n<th align=\"center\">Size</th>\n<th align=\"center\">Link</th>\n</tr>\n</thead>\n<tbody>\n<tr>\n<td align=\"center\">LASSL GPT2</td>\n<td align=\"center\">Small (20M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/lassl/gpt2-ko-small\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">LMKor KoGPT2</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/kykim/gpt3-kor-small_based_on_gpt2\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">SKT KoGPT2</td>\n<td align=\"center\">Base (110M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/skt/kogpt2-base-v2\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">SKT KoGPT Trinity</td>\n<td align=\"center\">1.2B</td>\n<td align=\"center\"><a href=\"https://huggingface.co/skt/ko-gpt-trinity-1.2B-v0.5\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KakaoBrain KoGPT</td>\n<td align=\"center\">6B</td>\n<td align=\"center\"><a href=\"https://huggingface.co/kakaobrain/kogpt\">link</a></td>\n</tr>\n</tbody>\n</table>\n<h2>Encoder-Decoder Model (Seq2seq 계열)</h2>\n<table>\n<thead>\n<tr>\n<th align=\"center\">Model Name</th>\n<th align=\"center\">Size</th>\n<th align=\"center\">Link</th>\n</tr>\n</thead>\n<tbody>\n<tr>\n<td align=\"center\">Cosmoquester BART</td>\n<td align=\"center\">Mini (13M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/cosmoquester/bart-ko-mini\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KE-T5 (Ko-En)</td>\n<td align=\"center\">Small (60M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/KETI-AIR/ke-t5-small\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KE-T5 (Ko)</td>\n<td align=\"center\">Small (60M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/KETI-AIR/ke-t5-small-ko\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">LMKor T5</td>\n<td align=\"center\">Small (60M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/kykim/t5-kor-small\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">Cosmoquester BART</td>\n<td align=\"center\">Small (40M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/cosmoquester/bart-ko-small\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">LMKor BERT Shared</td>\n<td align=\"center\">Base (130M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/kykim/bertshared-kor-base\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">SKT KoBART</td>\n<td align=\"center\">Base (130M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/gogamza/kobart-base-v2\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">Cosmoquester BART</td>\n<td align=\"center\">Base (130M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/gogamza/kobart-base-v2\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KcT5</td>\n<td align=\"center\">Base (220M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/beomi/KcT5-dev\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KE-T5 (Ko-En)</td>\n<td align=\"center\">Base (220M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/KETI-AIR/ke-t5-base\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KE-T5 (Ko)</td>\n<td align=\"center\">Base (220M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/KETI-AIR/ke-t5-basko\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">Asian BART (Ko)</td>\n<td align=\"center\">Base (360M)</td>\n<td align=\"center\"><a href=\"hyunwoongko/asian-bart-ko\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">pko-t5 (Ko)</td>\n<td align=\"center\">Base (250M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/paust/pko-t5-base\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">Wisenut KoT5 (Ko)</td>\n<td align=\"center\">Base (220M)</td>\n<td align=\"center\"><a href=\"https://github.com/wisenut-research/KoT5#usage\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">mBART</td>\n<td align=\"center\">Large (610M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/facebook/mbart-large-50\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KE-T5 (Ko-En)</td>\n<td align=\"center\">Large (770M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/KETI-AIR/ke-t5-large\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">KE-T5 (Ko)</td>\n<td align=\"center\">Large (770M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/KETI-AIR/ke-t5-large-ko\">link</a></td>\n</tr>\n<tr>\n<td align=\"center\">pko-t5 (Ko)</td>\n<td align=\"center\">Large (800M)</td>\n<td align=\"center\"><a href=\"https://huggingface.co/paust/pko-t5-large\">link</a></td>\n</tr>\n</tbody>\n</table>","htmlAst":{"type":"root","children":[{"type":"element","tagName":"h1","properties":{},"children":[{"type":"text","value":"한국어 사전학습 모델 (Korean Pre-trained Language Model)"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"공개된 한국어 사전학습 모델을 기록합니다. 크게 아래 3개의 모델 계열로 구분했으며, 모델 사이즈는 정확하지 않을 수 있습니다."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"ul","properties":{},"children":[{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"Encoder Model (BERT 계열)"}]},{"type":"text","value":"\n"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"Decoder Model (GPT 계열)"}]},{"type":"text","value":"\n"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"Encoder-Decoder Model (Seq2seq 계열)"}]},{"type":"text","value":"\n"}]},{"type":"text","value":"\n"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"h2","properties":{},"children":[{"type":"text","value":"Encoder Model (BERT 계열)"}]},{"type":"text","value":"\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n"},{"type":"element","tagName":"table","properties":{},"children":[{"type":"element","tagName":"thead","properties":{},"children":[{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"th","properties":{"align":"center"},"children":[{"type":"text","value":"Model Name"}]},{"type":"element","tagName":"th","properties":{"align":"center"},"children":[{"type":"text","value":"Size"}]},{"type":"element","tagName":"th","properties":{"align":"center"},"children":[{"type":"text","value":"Link"}]}]}]},{"type":"element","tagName":"tbody","properties":{},"children":[{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"LASSL BERT"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Small (10M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/lassl/bert-ko-small"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"LASSL RoBERTa"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Small (10M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/lassl/roberta-ko-small"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"TUNiB ELECTRA (Ko)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Small (10M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/tunib/electra-ko-small"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"TUNiB ELECTRA (Ko-En)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Small (10M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/tunib/electra-ko-en-small"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KoELECTRA"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Small (10M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/monologg/koelectra-small-v3-discriminator"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KcELECTRA"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Small (10M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/beomi/kcelectra-v2022-dev"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Soongsil-BERT"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Small (10M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/jason9693/soongsil-bert-small"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Ko-CHAR-ELECTRA"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Small (10M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/monologg/kocharelectra-small-discriminator"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Distill-KoBERT"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"30M"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/monologg/kocharelectra-base-discriminator"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KoBERT"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/skt/kobert-base-v1"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KorBERT"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://aiopen.etri.re.kr/service_dataset.php"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"HanBERT"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://github.com/monologg/HanBert-Transformers"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KcBERT"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/beomi/kcbert-base"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Soongsil-BERT"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/jason9693/soongsil-bert-base"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KLUE-RoBERTa"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/klue/roberta-base"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KoELECTRA"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/monologg/koelectra-base-v3-discriminator"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KcELECTRA"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/beomi/KcELECTRA-base"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"TUNiB-ELECTRA (Ko)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/tunib/electra-ko-base"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"TUNiB-ELECTRA (Ko-En)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/tunib/electra-ko-en-base"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"LMKor Albert"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/kykim/albert-kor-base"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"LMKor Bert"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/kykim/bert-kor-base"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"LMKor Funnel"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/kykim/funnel-kor-base"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"LMKor ELECTRA"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/kykim/electra-kor-base"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KalBERT"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://github.com/MrBananaHuman/KalBert"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"LASSL BERT"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/lassl/bert-ko-base"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KoBigBird"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/monologg/kobigbird-bert-base"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Ko-CHAR-BERT"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://github.com/MrBananaHuman/KoreanCharacterBert"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Ko-CHAR-ELECTRA"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/monologg/kocharelectra-base-discriminator"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"BrainSBERT"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/hyunwoongko/brainsbert-base"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KPFBERT"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/jinmang2/kpfbert"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KcBERT"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Large (340M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/beomi/kcbert-large"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KLUE-RoBERTa"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Large (340M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/klue/roberta-large"},"children":[{"type":"text","value":"link"}]}]}]}]}]},{"type":"text","value":"\n"},{"type":"element","tagName":"h2","properties":{},"children":[{"type":"text","value":"Decoder Model (GPT 계열)"}]},{"type":"text","value":"\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n"},{"type":"element","tagName":"table","properties":{},"children":[{"type":"element","tagName":"thead","properties":{},"children":[{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"th","properties":{"align":"center"},"children":[{"type":"text","value":"Model Name"}]},{"type":"element","tagName":"th","properties":{"align":"center"},"children":[{"type":"text","value":"Size"}]},{"type":"element","tagName":"th","properties":{"align":"center"},"children":[{"type":"text","value":"Link"}]}]}]},{"type":"element","tagName":"tbody","properties":{},"children":[{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"LASSL GPT2"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Small (20M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/lassl/gpt2-ko-small"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"LMKor KoGPT2"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/kykim/gpt3-kor-small_based_on_gpt2"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"SKT KoGPT2"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (110M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/skt/kogpt2-base-v2"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"SKT KoGPT Trinity"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"1.2B"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/skt/ko-gpt-trinity-1.2B-v0.5"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KakaoBrain KoGPT"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"6B"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/kakaobrain/kogpt"},"children":[{"type":"text","value":"link"}]}]}]}]}]},{"type":"text","value":"\n"},{"type":"element","tagName":"h2","properties":{},"children":[{"type":"text","value":"Encoder-Decoder Model (Seq2seq 계열)"}]},{"type":"text","value":"\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n"},{"type":"element","tagName":"table","properties":{},"children":[{"type":"element","tagName":"thead","properties":{},"children":[{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"th","properties":{"align":"center"},"children":[{"type":"text","value":"Model Name"}]},{"type":"element","tagName":"th","properties":{"align":"center"},"children":[{"type":"text","value":"Size"}]},{"type":"element","tagName":"th","properties":{"align":"center"},"children":[{"type":"text","value":"Link"}]}]}]},{"type":"element","tagName":"tbody","properties":{},"children":[{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Cosmoquester BART"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Mini (13M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/cosmoquester/bart-ko-mini"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KE-T5 (Ko-En)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Small (60M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/KETI-AIR/ke-t5-small"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KE-T5 (Ko)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Small (60M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/KETI-AIR/ke-t5-small-ko"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"LMKor T5"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Small (60M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/kykim/t5-kor-small"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Cosmoquester BART"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Small (40M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/cosmoquester/bart-ko-small"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"LMKor BERT Shared"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (130M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/kykim/bertshared-kor-base"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"SKT KoBART"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (130M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/gogamza/kobart-base-v2"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Cosmoquester BART"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (130M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/gogamza/kobart-base-v2"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KcT5"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (220M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/beomi/KcT5-dev"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KE-T5 (Ko-En)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (220M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/KETI-AIR/ke-t5-base"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KE-T5 (Ko)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (220M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/KETI-AIR/ke-t5-basko"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Asian BART (Ko)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (360M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"hyunwoongko/asian-bart-ko"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"pko-t5 (Ko)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (250M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/paust/pko-t5-base"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Wisenut KoT5 (Ko)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Base (220M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://github.com/wisenut-research/KoT5#usage"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"mBART"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Large (610M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/facebook/mbart-large-50"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KE-T5 (Ko-En)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Large (770M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/KETI-AIR/ke-t5-large"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"KE-T5 (Ko)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Large (770M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/KETI-AIR/ke-t5-large-ko"},"children":[{"type":"text","value":"link"}]}]}]},{"type":"element","tagName":"tr","properties":{},"children":[{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"pko-t5 (Ko)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"text","value":"Large (800M)"}]},{"type":"element","tagName":"td","properties":{"align":"center"},"children":[{"type":"element","tagName":"a","properties":{"href":"https://huggingface.co/paust/pko-t5-large"},"children":[{"type":"text","value":"link"}]}]}]}]}]}],"data":{"quirksMode":false}},"excerpt":"한국어 사전학습 모델 (Korean Pre-trained Language Model) 공개된 한국어 사전학습 모델을 기록합니다. 크게 아래 3개의 모델 계열로 구분했으며, 모델 사이즈는 정확하지 않을 수 있습니다. Encoder Model (BERT…","fields":{"readingTime":{"text":"4 min read"}},"frontmatter":{"title":"Sooftware NLP - 한국어 사전학습 모델 (Korean Pre-trained Language Model)","userDate":"12 July 2022","date":"2022-07-12T10:00:00.000Z","tags":["nlp"],"excerpt":null,"image":{"childImageSharp":{"gatsbyImageData":{"layout":"fullWidth","backgroundColor":"#383848","images":{"fallback":{"src":"/static/2823decbecd34c6071cef2221f03b4ff/29ba9/bear.jpg","srcSet":"/static/2823decbecd34c6071cef2221f03b4ff/7284f/bear.jpg 750w,\n/static/2823decbecd34c6071cef2221f03b4ff/29ba9/bear.jpg 1080w","sizes":"100vw"},"sources":[{"srcSet":"/static/2823decbecd34c6071cef2221f03b4ff/57584/bear.webp 750w,\n/static/2823decbecd34c6071cef2221f03b4ff/984df/bear.webp 1080w","type":"image/webp","sizes":"100vw"}]},"width":1,"height":0.6666666666666666}}},"author":[{"id":"Soohwan Kim","bio":"Co-founder/A.I. engineer at TUNiB.","avatar":{"children":[{"gatsbyImageData":{"layout":"fullWidth","backgroundColor":"#282838","images":{"fallback":{"src":"/static/a9e6b445142b247ee4cfa66155398bb2/0d6f4/soohwan.png","srcSet":"/static/a9e6b445142b247ee4cfa66155398bb2/248f9/soohwan.png 40w,\n/static/a9e6b445142b247ee4cfa66155398bb2/fd435/soohwan.png 80w,\n/static/a9e6b445142b247ee4cfa66155398bb2/0d6f4/soohwan.png 120w","sizes":"100vw"},"sources":[{"srcSet":"/static/a9e6b445142b247ee4cfa66155398bb2/e7f45/soohwan.webp 40w,\n/static/a9e6b445142b247ee4cfa66155398bb2/589ec/soohwan.webp 80w,\n/static/a9e6b445142b247ee4cfa66155398bb2/71a38/soohwan.webp 120w","type":"image/webp","sizes":"100vw"}]},"width":1,"height":0.6833333333333333}}]}}]}},"relatedPosts":{"totalCount":50,"edges":[{"node":{"id":"6529d72e-80e7-5d61-a672-d66276a3f641","excerpt":"MoE(Mixture of Experts) 기초부터 DeepSeek 혁신까지 작년 이맘때쯤 DeepSeek-V3가 저비용으로 엄청난 성능을 보이면서 화제가 되었습니다. 그 핵심 기술인 MoE(Mixture of Experts…","frontmatter":{"title":"MoE(Mixture of Experts) 기초부터 DeepSeek 혁신까지","date":"2026-01-15T01:11:55.000Z"},"fields":{"readingTime":{"text":"8 min read"},"slug":"/developed-moe/"}}},{"node":{"id":"8b49d3ef-4ce3-568c-9d71-240ff17fc3e0","excerpt":"BERT는 사실 Diffusion 모델이였다?! 최근 굉장히 흥미로운 글을 읽게되어 공유합니다. 원문 : link BERT와 Diffusion이 같은 방식이다?! NLP 연구자들에게 BERT는 너무 익숙한 모델입니다. 201…","frontmatter":{"title":"BERT는 사실 Diffusion 모델이였다?!","date":"2025-10-21T12:00:00.000Z"},"fields":{"readingTime":{"text":"8 min read"},"slug":"/bert_diffusion/"}}},{"node":{"id":"7c7e1676-ea84-58de-970c-ddec9aa10660","excerpt":"RLHF는 수다쟁이를 만든다?! (Does RLHF Breed Verbose Chatterboxes?!) RLHF(Reinforcement Learning from Human Feedback)는 OpenAI의 ChatGPT…","frontmatter":{"title":"RLHF는 수다쟁이를 만든다?! (Does RLHF Breed Verbose Chatterboxes?!)","date":"2024-03-13T01:11:55.000Z"},"fields":{"readingTime":{"text":"7 min read"},"slug":"/rlhf-vervosity/"}}},{"node":{"id":"2b9d3e22-1796-5fab-878d-5941d2e76e9d","excerpt":"LLM Paper Abstract - 2023.12 LLM…","frontmatter":{"title":"LLM Paper Abstract - 2023.12","date":"2024-01-05T10:00:00.000Z"},"fields":{"readingTime":{"text":"5 min read"},"slug":"/llm-abs-202312/"}}},{"node":{"id":"f43fa33b-917b-5c00-8462-937d99592ad7","excerpt":"What it MoE? (Mixture of Experts) 현존 최강 LLM인 GPT-4에서 “MoE (Mixture of Experts)” 방식을 채택하여 사용하고 있다고 알려졌는데요, 최근 AI계의 뜨거운 감자 Mistral AI…","frontmatter":{"title":"What is MoE? (Mixture of Experts)","date":"2023-12-22T01:11:55.000Z"},"fields":{"readingTime":{"text":"9 min read"},"slug":"/moe/"}}}]}},"pageContext":{"slug":"/korean-plm/","prev":{"excerpt":"2022 AI 온라인 경진대회 1위 2022 인공지능 경진대회 - 기계독해 태스크에서 1위를 차지했습니다. 🎉 🎉 작년에는 제가 모든 리딩 및 코딩을 담당했는데, 이번에는…","frontmatter":{"title":"2022 AI 온라인 경진대회 1위","tags":["record"],"date":"2022-06-24T10:00:00.000Z","draft":false,"excerpt":null,"image":{"childImageSharp":{"gatsbyImageData":{"layout":"fullWidth","placeholder":{"fallback":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABQAAAARCAYAAADdRIy+AAAACXBIWXMAAAsTAAALEwEAmpwYAAAC40lEQVQ4y5WU7U8TWRSH5292E18BsYugsDFxvxmTdZUXxVIQCCRrXE1QoS0vFmUX2mmnVApCh05fpjN32nl5NnemQtcPKjd5cs/c8/tw7/mdM4ppmqjaIS27jVxBcE70HVwIZUdrMrtSofjFwhYOphXRsh2CwOeiS7EsQdVoUq+3MGpmSE3uhkmzaSOEi213QmQsHC/ae2K7i+v6KPOLGv2D64yMbnFnbJNbtzeISYY3GBxaZ/RehpGxbYbufCA2vMnNX1MMDqUZGZNxOozv3c/QN5giMVdAqTUCdrbT7O195p+sQUEzULUGubxBqdTg3cpH/nw0TyL+kpW/NzgoW6FmL3tCcb8R6VWdbE7ntGqjgEtZP8UNvG4V3MgMZP18fFdQq1Zo1nXwxI9r2GpZVCoGpaMWr7cafNJshBPVx/cD/OBc7PuEdfI8SfC/+CuK53XwfQfTFhSPTfS6hecJXFeEN7ywyxubJ0xOa7xYLLK8XCQxlyeeiJiOqywslVhYOmBuocTs/D7TM2qYe7Gg8XxG5Xkiz+LyPs/iKsn0MUpqXefRwzdMTGZ4PLnLxNMs41MRU89yPHiYZmjkL0Z/e83939+GZ+NSN/Uv41N7YTw9k+WPxzu8Wz2SpkDNOqITCIIeU6LnBpi1Ez5upcjvfsAyDnse1+mJvbPyKMJqUj7UEaITjpvrBVjCxWn7oSnfLmmCPJdaT5oWQncPUITToWEKLLuNabWp1gVLSYPUbjNqm1Doh0Tz+v35VtptB8tu4TgiQsi2cbCFjeyA7i+iy0+4LF365fIqA7E0A7EUV/uSXOtf41p/kis31rg1LMcxQ39si+sDaS5fXw1zN2PpMH+1b43bdze5dOU98dk8ilHz+JRZJ5sts5s7H71s3mC/VGft/Q4TTxaZn31F8u02B4ctcqpOTq2QL1TRijUKhVNyOZ1qVUQumx3pcNDjLmdPbAuTk+MyVf0Lrmj25Hqb3j/T/wc0c92EyS98KgAAAABJRU5ErkJggg=="},"images":{"fallback":{"src":"/static/961d078004cf7506560cae0b8340246e/0772c/2022-ai-compete.png","srcSet":"/static/961d078004cf7506560cae0b8340246e/4af65/2022-ai-compete.png 750w,\n/static/961d078004cf7506560cae0b8340246e/76758/2022-ai-compete.png 1080w,\n/static/961d078004cf7506560cae0b8340246e/6911c/2022-ai-compete.png 1366w,\n/static/961d078004cf7506560cae0b8340246e/0772c/2022-ai-compete.png 1718w","sizes":"100vw"},"sources":[{"srcSet":"/static/961d078004cf7506560cae0b8340246e/74aff/2022-ai-compete.webp 750w,\n/static/961d078004cf7506560cae0b8340246e/b0f5e/2022-ai-compete.webp 1080w,\n/static/961d078004cf7506560cae0b8340246e/1b8e1/2022-ai-compete.webp 1366w,\n/static/961d078004cf7506560cae0b8340246e/f7543/2022-ai-compete.webp 1718w","type":"image/webp","sizes":"100vw"}]},"width":1,"height":0.8626309662398137}}},"author":[{"id":"Soohwan Kim","bio":"Co-founder/A.I. engineer at TUNiB.","avatar":{"childImageSharp":{"gatsbyImageData":{"layout":"fullWidth","placeholder":{"fallback":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABQAAAAOCAYAAAAvxDzwAAAACXBIWXMAABYlAAAWJQFJUiTwAAADjElEQVQ4y23Oy48TdQDA8TExEaTttvSBfdHddru7bWc6bWd+8+i0u23n0SdlBRQXZGHDgiiLDwgqXjCIJEaC8cLBmHgwUU9EYzRqQuLJi/4NJB6NF+8evgbOHr7XT76SM5ix7s4QnRHnnm9yZzvBTIswN8JcP5bC67ZoWi7CdtFsn5bloZo+dSNAMYbIIqCmD6mJIVXdR3J6I7r9IQ3T59pZlW+uxzndCbPdC/HZXoq3TikowsfqBOjOmFZ7SrM9p2kfRbXn1O0jKNbsSbJ5BMnu9Gl3+qiiz4OPSvz0QRLHFGwOZH6+neLHT5YRbRerM0J0JrTas/8FZXNKzZgg2es+ZtvDdbs8+iHJl+9lWVP7OG2br26k+PvXJCfmFqoYIpwhTXtMwxpTN0coxhjFmCKbE2rGmKoYPQY9qi2fyzsq//4e5sNXi5TlLqbd5t6lPH/9kuDTG2usqgGi7dO0hzSsIXUzQDaGKGKMLEZUxZCKCJB02+PUpMH9vQwP7ybYnSxyfNrjwumA3dEiD94v8cfnK7xzWsbpujQtH9X0qBs+iuEjC5+a7lPVPSqai9SyelyYFbjkh5hqC3TkKOutLON2nkYpgtuMcT6IszdPslo8SLlcpmUH1A0XRQyQhUtNuFQ1l4o2QFI1h3OTVXbcg+grIfSVBRqlEGopgrYSRi0e4KiIse1mScSeopA/iLADmoZL3Rgg631q+oCq1qeq95FOzhQefpzn7eMpBmqcoBVj04pzwkky0eNMRYIdL8F3twusLe2nslrE6g5pGX1U8/FhD1nvUW1tUJK7SH9+n+DR1zF2vQSvH0lz88wiV45V2J1WuHqsxLXNAnuzNJdfWmK5/BylUgFhb6DZAxR9g7rpIos+Wttja2uE9M9vYb69k+DqfJErWzLOuoVqdKlpDo4jODms4zlFckuHObx4iHwuRi6fYqmYY201x/LqMrnFDNl8gRvvukhNdT9394rcOlNFMxrUhYFmW9imTEsp0mhWKC2nWSokyWSiFA7HSKcXiEb34fayyLVniUQk8rmn2drKIqlqiNcuVrh2ymQS1Nh8sc/GoMEbl7u8eb5D1yqTzkRJJsOkkiGymQVShyLE4yHWKnEq1RjpTIhmI8r2y3mkyloI38uha1n6bpVXrkw5+4LD/S/2uHnrIopaJhZ9hmQqwqHkAXJP8BDhyD46ZoWdMxOGcx/PNfECk/8AbxXdRjRliPoAAAAASUVORK5CYII="},"images":{"fallback":{"src":"/static/a9e6b445142b247ee4cfa66155398bb2/7cf1f/soohwan.png","srcSet":"/static/a9e6b445142b247ee4cfa66155398bb2/34f77/soohwan.png 750w,\n/static/a9e6b445142b247ee4cfa66155398bb2/a94f6/soohwan.png 1080w,\n/static/a9e6b445142b247ee4cfa66155398bb2/7cf1f/soohwan.png 1148w","sizes":"100vw"},"sources":[{"srcSet":"/static/a9e6b445142b247ee4cfa66155398bb2/38420/soohwan.webp 750w,\n/static/a9e6b445142b247ee4cfa66155398bb2/7470d/soohwan.webp 1080w,\n/static/a9e6b445142b247ee4cfa66155398bb2/b5ef6/soohwan.webp 1148w","type":"image/webp","sizes":"100vw"}]},"width":1,"height":0.6829268292682927}}}}]},"fields":{"readingTime":{"text":"1 min read"},"layout":"","slug":"/2022_ai_online_competition/"}},"next":{"excerpt":"혐오는 이제 그만! St. Patrick…","frontmatter":{"title":"Sooftware NLP - 혐오는 이제 그만! St. Patrick","tags":["nlp"],"date":"2022-07-16T10:00:00.000Z","draft":null,"excerpt":"St. Patrick, the original safety engine by TUNiB, checks if the user text includes any toxic expressions or personal information and provides detailed reports.","image":{"childImageSharp":{"gatsbyImageData":{"layout":"fullWidth","placeholder":{"fallback":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABQAAAAUCAYAAACNiR0NAAAACXBIWXMAAAsTAAALEwEAmpwYAAAEV0lEQVQ4y3WUC0zVZRjG3wMEMZNQCm+0JQjeb9xERAUxhCUgcpWbCkGKiSaoKbcgWbPI8DIVzBuG5wDC4ajkprWORwXTTqY5Tdtq1YZKNrS0EDj82jnHI8esd/vv+/bfu9+eZ+/7fIJV9fX1mT5j9fb2PvnfoD7F59oLli4MBsMz/ZaSfwOtYQ//NrB23TsUJgpr4p6jfPO2J73W0P8FWjfe6rhHXOQMVHnCR1kKDqwRdmYLi9OS6O7pe0qhBWo85VnLZmDm4jh05QJ6e6IChPUJCrhqx4GVwoYNBaaeR48eYTD0mhxZhDwFtFj9Uve1CXBHZcO1aluqcm3RlNhy4xM7fq0RcmIGc/PH2/yXO7FW19PdbbpXbt1G/uuCpkSozBaqVwq7VgjblwvHSoRlYcLxE1pa29rISI5lfd5qbt/5zazQ2n9XV5fprlQq8fGZjP8ULz7IiWRLbiw78hIpSAtlykRPQkNmsmNXFXPGDyXIVfBzFtITY/otW/xbSqVS4enpxdb8pfzUWAHXmuCSiuvK9ynMisdvWgArcnLwcBSyluUQPWM8YROH8kt7B9JnMCvs7Ozki5ZTGAeYm5lCwjQP9hVmEj/Hl3czIvk4N4Gkuf5UrUtn/qQR5OXmoD3TSv7adcwaIcRFBGOUJb0G8yCWrVqOeAgH9xzkxHENY0e6ER3sR9JrAcwMCiQsJIjkedMJnDoe3wmjaTt3lpqaQ/gMFqaPcqHtgr7f8uGDtUiQIJtckEl23G2/S3FZKaXvlbK7uoqUlEWkpqZQq6ylsKiAquo9/NXTx2RXG0JGu3C69aIJ1tPTYwZqtVo8QscwaNRLhC4Jx9DVTWNjPWmpSdz8/jvaWnV8oz/PJf15FkTPR3/xK+7d/4OhDkJ4SKAZ9nhDxDo6CxfEU7G5ko7f77H3gAoHRyfS09JQ19exr2o3CQkJvODkwtnzl7ly4xbebkJ8+FTzlhgM5qRYJny0pYU34+ZSuXoRvuOGs2mxsCXbFhEhOCqEiYHeOA0Qdr5lQ3GqPUtjR+M2QIiY7f9kqU1Ao29jFRQWodv2Ntw+S9kSdzYmCUvDFGzPFsTfFvG1pXa1MM9X+KxM2JopeA0UMhYEm1P2mCOWuGl1Zwjx8aIiN5lXXAeyKVk4UqTgYZNQkmrDnlUKOlRC/UZhQ6wggQOZMFzBFPdh/Nx+pz96FuClNj0S6ICUOSH+jjw/yYGTRQKnBd2HwuWdAjphb5YgkS8iFUNwH+ZMuLcnGSnx3P/zwdNDud/eycikccjFV7Ff8TKyxhWJduZkqYKFM20oWKSgJl+BRA3CrsUDKXemOCsGHpyjOCsW/eWr/UDLcs+KmYOkCRJqjwTYIImOeI8V0oOF/EhhiLsgyY7IGwOQCGGu3xjU5cuJmu3H9Rs/9AMt8bvy7RUa9tehqWtGXafm6OEm6huaqVU1c0jZTOORZjS1Tag/bUKjVKOqb6B6fw2ao8dMb6MR+A9fVGc7v7OEPgAAAABJRU5ErkJggg=="},"images":{"fallback":{"src":"/static/180de46e7ed5033144148c66da986e75/ccc41/patrick.png","srcSet":"/static/180de46e7ed5033144148c66da986e75/ccc41/patrick.png 512w","sizes":"100vw"},"sources":[{"srcSet":"/static/180de46e7ed5033144148c66da986e75/d689f/patrick.webp 512w","type":"image/webp","sizes":"100vw"}]},"width":1,"height":1}}},"author":[{"id":"Soohwan Kim","bio":"Co-founder/A.I. engineer at TUNiB.","avatar":{"childImageSharp":{"gatsbyImageData":{"layout":"fullWidth","placeholder":{"fallback":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABQAAAAOCAYAAAAvxDzwAAAACXBIWXMAABYlAAAWJQFJUiTwAAADjElEQVQ4y23Oy48TdQDA8TExEaTttvSBfdHddru7bWc6bWd+8+i0u23n0SdlBRQXZGHDgiiLDwgqXjCIJEaC8cLBmHgwUU9EYzRqQuLJi/4NJB6NF+8evgbOHr7XT76SM5ix7s4QnRHnnm9yZzvBTIswN8JcP5bC67ZoWi7CdtFsn5bloZo+dSNAMYbIIqCmD6mJIVXdR3J6I7r9IQ3T59pZlW+uxzndCbPdC/HZXoq3TikowsfqBOjOmFZ7SrM9p2kfRbXn1O0jKNbsSbJ5BMnu9Gl3+qiiz4OPSvz0QRLHFGwOZH6+neLHT5YRbRerM0J0JrTas/8FZXNKzZgg2es+ZtvDdbs8+iHJl+9lWVP7OG2br26k+PvXJCfmFqoYIpwhTXtMwxpTN0coxhjFmCKbE2rGmKoYPQY9qi2fyzsq//4e5sNXi5TlLqbd5t6lPH/9kuDTG2usqgGi7dO0hzSsIXUzQDaGKGKMLEZUxZCKCJB02+PUpMH9vQwP7ybYnSxyfNrjwumA3dEiD94v8cfnK7xzWsbpujQtH9X0qBs+iuEjC5+a7lPVPSqai9SyelyYFbjkh5hqC3TkKOutLON2nkYpgtuMcT6IszdPslo8SLlcpmUH1A0XRQyQhUtNuFQ1l4o2QFI1h3OTVXbcg+grIfSVBRqlEGopgrYSRi0e4KiIse1mScSeopA/iLADmoZL3Rgg631q+oCq1qeq95FOzhQefpzn7eMpBmqcoBVj04pzwkky0eNMRYIdL8F3twusLe2nslrE6g5pGX1U8/FhD1nvUW1tUJK7SH9+n+DR1zF2vQSvH0lz88wiV45V2J1WuHqsxLXNAnuzNJdfWmK5/BylUgFhb6DZAxR9g7rpIos+Wttja2uE9M9vYb69k+DqfJErWzLOuoVqdKlpDo4jODms4zlFckuHObx4iHwuRi6fYqmYY201x/LqMrnFDNl8gRvvukhNdT9394rcOlNFMxrUhYFmW9imTEsp0mhWKC2nWSokyWSiFA7HSKcXiEb34fayyLVniUQk8rmn2drKIqlqiNcuVrh2ymQS1Nh8sc/GoMEbl7u8eb5D1yqTzkRJJsOkkiGymQVShyLE4yHWKnEq1RjpTIhmI8r2y3mkyloI38uha1n6bpVXrkw5+4LD/S/2uHnrIopaJhZ9hmQqwqHkAXJP8BDhyD46ZoWdMxOGcx/PNfECk/8AbxXdRjRliPoAAAAASUVORK5CYII="},"images":{"fallback":{"src":"/static/a9e6b445142b247ee4cfa66155398bb2/7cf1f/soohwan.png","srcSet":"/static/a9e6b445142b247ee4cfa66155398bb2/34f77/soohwan.png 750w,\n/static/a9e6b445142b247ee4cfa66155398bb2/a94f6/soohwan.png 1080w,\n/static/a9e6b445142b247ee4cfa66155398bb2/7cf1f/soohwan.png 1148w","sizes":"100vw"},"sources":[{"srcSet":"/static/a9e6b445142b247ee4cfa66155398bb2/38420/soohwan.webp 750w,\n/static/a9e6b445142b247ee4cfa66155398bb2/7470d/soohwan.webp 1080w,\n/static/a9e6b445142b247ee4cfa66155398bb2/b5ef6/soohwan.webp 1148w","type":"image/webp","sizes":"100vw"}]},"width":1,"height":0.6829268292682927}}}}]},"fields":{"readingTime":{"text":"7 min read"},"layout":"post","slug":"/st-patrick/"}},"primaryTag":"nlp"}},
    "staticQueryHashes": ["3170763342","3229353822"]}