당근 마켓에서 Machine Learning Engineer로 다양한 Machine Learning Application 연구/개발을 하고 있습니다. 자연어 처리, 컴퓨터 비전 등 전반적인 머신러닝/딥러닝에 관심이 많습니다. 블로그에는 주로 공부한 내용(논문 리뷰 등)을 기록합니다.
DGIST Bachelor, Basic of Science (2015 - Present)
- 산업기능요원 복무 중입니다.(휴학)
Daangn Market, Machine Learning Engineer (Jul 2020 - Present)
Scatterlab, Machine Learning Software Engineer (Mar 2019 - Jun 2020)
- Research on Pre-training Language Models for Dialogue System. [Blog post]
- Research on Knowledge Distillation methods for model compression and BERT serving.
- Develop Multitask Fine-tuning (MT-DNN) system for NLU inference Integration.
- Develop multi-turn reaction and response selection model using BERT. [Blog post, Demo]
Naver Clova AI, AI Research Intern (Dec 2018 - Feb 2019)
Natural Language Processing, Computer Vision, Machine Learning, Deep Learning
- Little Big Data presenter [Slide] (Aug 2010)
- World Friends IT Volunteer, Hanoi, Vietnam (Jul 2016 – Aug 2016)
- MaaS Hackathon(2019), 3rd prize – worked as machine learning engineer
- SKT Blockchain Hackathon(2018), 1st prize – worked as backend developer
- Crypto On the beach Hackathon(2018), 1st prize – worked as backend developer
총 포스트 수: 24개
2020년 : 18개의 포스트
2019년 : 6개의 포스트
BERT Series Review: BERT(NAACL 2019), MT-DNN(arXiv 2019), RoBERTa(arXiv 2019), ALBERT(ICLR 2020), StructBERT(ICLR 2020), Transformer-XL(ACL 2019), XLNet(NeurIPS 2019), UniLM(NeurIPS 2019) SchuBERT(ACL2020)
Dialogue Modeling(System) Review: Transformer for Learning Dialogue(ACL 2020), Masked Hierarchical Transformer(AAAI 2020), Graph-Structured Network(IJCAI 2019), ReCoSa(ACL 2019), DialogueRNN(AAAI 2019), SoundingBoard(Alexa Prize 2017 1st prize)
Deep Learning Paper Review: Graph Convolutional Network (ICLR 2017)