Publications

Conference Publications

• Flora: Low-Rank Adapters Are Secretly Gradient Compressors
  Yongchang Hao, Yanshuai Cao, Lili Mou
  ICML 2024
• LLMR: Knowledge Distillation with a Large Language Model-Induced Reward
  Dongheng Li, Yongchang Hao, Lili Mou
  Coling 2024
• An Equal-Size Hard EM Algorithm for Diverse Dialogue Generation
  Yuqiao Wen, Yongchang Hao, Yanshuai Cao, Lili Mou
  ICLR 2023
• Teacher Forcing Recovers Reward Functions for Text Generation
  Yongchang Hao, Yuxin Liu, Lili Mou
  NeurIPS 2022
• Understanding and Improving Sequence-to-Sequence Pretraining for Neural Machine Translation
  Wenxuan Wang, Wenxiang Jiao, Yongchang Hao, Xing Wang, Shuming Shi, Zhaopeng Tu, Michael Lyu
  ACL 2022
• Multi-Task Learning with Shared Encoder for Non-Autoregressive Machine Translation
  Yongchang Hao*, Shilin He*, Wenxiang Jiao, Zhaopeng Tu, Michael Lyu, Xing Wang
  NAACL 2021

Preprints

• NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks
  Yongchang Hao, Yanshuai Cao, Lili Mou
  ar$\chi$iv 2024
• Ginger: An Efficient Curvature Approximation with Linear Complexity for General Neural Networks
  Yongchang Hao, Yanshuai Cao, Lili Mou
  ar$\chi$iv 2024

Theses

• Discovering Reward Functions for Language Models
  Yongchang Hao
  M.Sc. Thesis, University of Alberta, 2023