Subscribe to SOOFTWARE

Stay up to date! Get all the latest & greatest posts delivered straight to your inbox

논문 리뷰

읽은 논문을 정리한 리뷰 · 글 25개

논문 리뷰aiagent

Next Intelligence Explosion

Agentic AI and the next intelligence explosion | https://arxiv.org/abs/2603.20639 다들 하나의 AI…

·3 min read
Next Intelligence Explosion cover image
논문 리뷰aiagent

Agentic Context Engineering (ACE) Paper Review

Agentic Context Engineering: Evolving Contexts for Self-Improving Language Models Paper Review 흥미로운 최신 AI Agent…

·13 min read
Agentic Context Engineering (ACE) Paper Review cover image
논문 리뷰nlprlhf

RLHF는 수다쟁이를 만든다?! (Does RLHF Breed Verbose Chatterboxes?!)

RLHF는 수다쟁이를 만든다?! (Does RLHF Breed Verbose Chatterboxes?!) RLHF(Reinforcement Learning from Human Feedback)는 OpenAI의 ChatGPT…

·7 min read
RLHF는 수다쟁이를 만든다?! (Does RLHF Breed Verbose Chatterboxes?!) cover image
논문 리뷰nlppaper

LLaMA2

LLaMA2 Meta(전 Facebook)가 이번 7월 18일에 LLaMA2를 공개했습니다. 🎉 LLaMA2 관련 내용이 담긴 논문 과 함께 7B, 13B, 70B 모델을 공개했습니다. 이전 LLaMA와 다르게 LLaMA…

·5 min read
LLaMA2 cover image
논문 리뷰nlppaper

Sooftware NLP - Generation with Retrieval

Generation with Retrieval 이번에 딥마인드에서 RETRO(Retrieval-Enhanced Transformer) 라는 모델을 내놓았습니다. 문서 retrieval + GPT 기반 모델인데, 7B 모델임에도 불구하고 2…

·6 min read
Sooftware NLP - Generation with Retrieval cover image
논문 리뷰nlppaper

Sooftware NLP - Fine-grained Post-training for Improving Retrieval-based Dialogue Systems Paper Review

Fine-grained Post-training for Improving Retrieval-based Dialogue Systems Paper Review Paper: https://aclanthology.org/2021.naacl-main.12…

·2 min read
Sooftware NLP - Fine-grained Post-training for Improving Retrieval-based Dialogue Systems Paper Review cover image
논문 리뷰speechnlppaper

Sooftware NLP - Textless NLP

Textless NLP: Generating expressive speech from raw audio paper / code / pre-train model / blog Name: Generative Spoken Language Model (GSLM…

·4 min read
Sooftware NLP - Textless NLP cover image
논문 리뷰nlppaper

Sooftware NLP - Efficient Attention Paper Review

Efficient Attention: Attention with Linear Complexities Shen Zhuoran et al. Abstract Dot-product attention은 들어오는 인풋 길이에 따라 memory…

·1 min read
Sooftware NLP - Efficient Attention Paper Review cover image
논문 리뷰nlppaper

Sooftware NLP - Luna: Linear Unified Nested Attention

Luna: Linear Unified Nested Attention USC + CMU + Facebook AI 2021.06 code Abstract 트랜스포머의 Multi Headed Self Attention…

·4 min read
Sooftware NLP - Luna: Linear Unified Nested Attention cover image
논문 리뷰nlppaper

Sooftware NLP - P-Tuning Paper Review

GPT Understands, Too Xiao Liu et al. Tsinghua University etc. arXiv pre-print Abstract GPT를 파인튜닝하는 방법은 Narural Language Understanding (NLU…

·4 min read
Sooftware NLP - P-Tuning Paper Review cover image