당근 마켓에서 Machine Learning Engineer로 다양한 Machine Learning Application 연구/개발을 하고 있습니다. 자연어 처리, 컴퓨터 비전 등 전반적인 머신러닝/딥러닝에 관심이 많습니다. 블로그에는 주로 공부한 내용(논문 리뷰 등)을 기록합니다.


Education

DGIST Bachelor, Basic of Science (2015 - Present)

  • 산업기능요원 복무 중입니다.(휴학)

Work Experience

Daangn Market, Machine Learning Engineer (Jul 2020 - Present)

Scatterlab, Machine Learning Software Engineer (Mar 2019 - Jun 2020)

  • Research on Pre-training Language Models for Dialogue System. [Blog post]
  • Research on Knowledge Distillation methods for model compression and BERT serving.
  • Develop Multitask Fine-tuning (MT-DNN) system for NLU inference Integration.
  • Develop multi-turn reaction and response selection model using BERT. [Blog post, Demo]

Naver Clova AI, AI Research Intern (Dec 2018 - Feb 2019)

Research Interest

Natural Language Processing, Computer Vision, Machine Learning, Deep Learning

Extracurricular Activities

  • Little Big Data presenter [Slide] (Aug 2010)
  • World Friends IT Volunteer, Hanoi, Vietnam (Jul 2016 – Aug 2016)

Awards

  • MaaS Hackathon(2019), 3rd prize – worked as machine learning engineer
  • SKT Blockchain Hackathon(2018), 1st prize – worked as backend developer
  • Crypto On the beach Hackathon(2018), 1st prize – worked as backend developer

BLOG POST

총 포스트 수: 25개

  • 2020년 : 19개의 포스트

  • 2019년 : 6개의 포스트

BERT Series Review: BERT(NAACL 2019), MT-DNN(arXiv 2019), RoBERTa(arXiv 2019), ALBERT(ICLR 2020), StructBERT(ICLR 2020), Transformer-XL(ACL 2019), XLNet(NeurIPS 2019), UniLM(NeurIPS 2019) SchuBERT(ACL2020)

Dialogue Modeling(System) Review: Transformer for Learning Dialogue(ACL 2020), Masked Hierarchical Transformer(AAAI 2020), Graph-Structured Network(IJCAI 2019), ReCoSa(ACL 2019), DialogueRNN(AAAI 2019), SoundingBoard(Alexa Prize 2017 1st prize)

Deep Learning Paper Review: Graph Convolutional Network (ICLR 2017)