| 일 | 월 | 화 | 수 | 목 | 금 | 토 |
|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | |||
| 5 | 6 | 7 | 8 | 9 | 10 | 11 |
| 12 | 13 | 14 | 15 | 16 | 17 | 18 |
| 19 | 20 | 21 | 22 | 23 | 24 | 25 |
| 26 | 27 | 28 | 29 | 30 |
- 바닥부터 배우는 강화 학습
- BERT 사용방법
- Multi Task Learning Objectives for Natural Language Processing
- A Neural Attention Model for Abstractive Sentence Summarization
- TOD 논문리뷰
- The Natural Language Decathlon:Multitask Learning as Question Answering
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer 리뷰
- MMTOD
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
- 길찾기
- attention 설명
- ImageNet Classification with Deep ConvolutionalNeural Networks 리뷰
- Zero-shot Generalization in Dialog State Tracking through GenerativeQuestion Answering
- Multi Task Learning Objectives for Natural Language Processing 리뷰
- T5 논문 리뷰
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 리뷰
- 정책기반 agent
- BART 논문리뷰
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 논문리뷰
- NLP 논문 리뷰
- 다양한 모듈에서 log쓰기
- CNN 논문리뷰
- RuntimeError: DataLoader worker (pid(s) ) exited unexpectedly
- Attention Is All You Need 리뷰
- UBAR: Towards Fully End-to-End Task-Oriented Dialog System with GPT-2
- Evaluate Multiwoz
- Attention Is All You Need
- hugging face tokenizer에서 special case 추가하기
- BERT란
- 뉴텝스 400
- Today
- Total
목록2021/09 (2)
one by one ◼◻◼◻
[NLP 논문리뷰]STraTA: Self-Training with Task Augmentation for Better Few-shot Learning
제목 : HowMuchKnowledge Can You Pack Into the Parameters of a Language Model? 저자 : Tu Vu, Minh-Thang Luong, Quoc V. Le, Grady Simon, Mohit Iyyer, Noam Shazeer 발행년도 : 2021 paper : https://arxiv.org/abs/2109.06270 code : https://github.com/google-research/google-research/tree/master/TA-ST Review Abstract 최근의 발전이 NLP task에서 많은 발전을 이뤘지만, Large scale의 pretrained 언어 모델이 few shot 세팅에서는 그리 좋은 성능을 보이지 못하고 ..
[NLP논문리뷰]How Much Knowledge Can You Pack Into the Parameters of a Language Model?
제목 : HowMuchKnowledge Can You Pack Into the Parameters of a Language Model? 저자 : Adam Roberts, Colin Raffel, Noam Shazeer 발행년도 : 2020 paper : https://arxiv.org/abs/2002.08910 code : https://github.com/google-research/google-research/tree/master/t5_closed_book_qa Review QA모델에 대한 논문 중 google에서 출간한 논문. 기존의 QA task는 passage를 보여주고 이에 대한 답을 찾아가는 방식이었다. 그러나 이 논문은 passage를 보여주지 않고 질문 부터 한다. 즉 다양한 task에 ..