Subscribe to SOOFTWARE

#parallelism

6개의 글

개발toolkitllamaparallelismondevice

llama.cpp (On device llm inference tool)

llama.cpp (On device llm inference tool) 최근에 llama.cpp를 사용해봤는데, 상당히 편리하고 미래에 더 많이 쓰일 툴이라는 생각이 들어서 기록해둔다! llama.cpp란? 대표적인 오픈소스 LLM인 Meta…

AI 개념nlpparallelismlarge-scalelm

Sooftware NLP - GPT (Generative Pre-trained Transformer)

GPT (Generative Pre-trained Transformer) 1 gpt1 먼저 알아보고, gpt2에 대해 알아보겠습니다. GPT1 Improving Language Understanding by Generative Pre-Training…

AI 개념nlpparallelismlarge-scalelm

Sooftware NLP - Large Scale LM (2) Distributed Programming

Large Scale LM (2) Distributed Programming (작성중) 이 자료는 [해당 link…

AI 개념nlpparallelismlarge-scalelm

Sooftware NLP - Large Scale LM (1) Background

Large Scale LM (1) Background 이 자료는 [해당 link…

개발nlpparallelismlarge-scale

Sooftware NLP - DeepSpeed Usage

DeepSpeed Usage…

논문 리뷰nlpparallelismpaper

Sooftware NLP - Megatron LM Paper Review

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism ​ Mohammad Shoeybi et al. 2019. NVIDIA Corp. ​ Summary…