About me

I am a CS PhD student at UIUC, advised by Prof. Tong Zhang and Prof. Huan Zhang. Previously, I earned my bachelor’s and master’s degrees from the Department of Automation at Tsinghua University and CSE, HKUST. My research interests lie in deep reinforcement learning (RL) and the application of RL algorithms to Large Language Models (LLMs). I am furtunate to have been working closely with Prof. Chongjie Zhang (Washington University in St. Louis), Dr. Lei Han (Tencent AI Lab), and Prof. Meng Fang (University of Liverpool).

Currently, I am actively researching ways to improve the robustness and generalization abilities of deep reinforcement learning, while also trying to enhance the trustworthiness of LLMs. Feel free to contact me by email if you are interested in discussing or collaborating with me.

News

• 🌟 (2024.10) A dynamic visual math benchmark is out! Check the project page and the DynaMath paper.
• 🎉 (2024.9) GRM is accepted by NeurIPS 2024! Check out our GRM series here.
• 🎉 (2024.5) Rewards-in-Context (RiC) is accepted by ICML 2024! Thanks to my co-authors!
• 🎉 (2024.5) GOPlan is accepted by Transactions on Machine Learning Research (TMLR)!
• 🎉 (2024.1) Robust IQL is accepted by ICLR 2024 as a spotlight paper!

Selected Publications

RL for LLMs

• Regularizing Hidden States Enables Learning Generalizable Reward Model for LLMs. Neural Information Processing Systems (NeurIPS), 2024.

  Rui Yang, Ruomeng Ding, Yong Lin, Huan Zhang, Tong Zhang.

• Rewards-in-Context: Multi-objective Alignment of Foundation Models with Dynamic Preference Adjustment. International Conference on Machine Learning (ICML) 2024.

  Rui Yang $^*$, Xiaoman Pan $^*$, Feng Luo $^*$, Shuang Qiu $^*$, Han Zhong, Dong Yu, Jianshu Chen.

Robust Offline RL

• Towards Robust Offline Reinforcement Learning under Diverse Data Corruption. International Conference on Learning Representations (ICLR) 2024. $\color{red}{\text{(Spotlight)}}$

  Rui Yang $^*$, Han Zhong $^*$, Jiawei Xu $^*$, Amy Zhang, Chongjie Zhang, Lei Han, Tong Zhang.

• Corruption-Robust Offline Reinforcement Learning with General Function Approximation. Neural Information Processing Systems (NeurIPS) 2023.

  Chenlu Ye $^*$, Rui Yang $^*$, Quanquan Gu, Tong Zhang.

• RORL: Robust Offline Reinforcement Learning via Conservative Smoothing. Neural Information Processing Systems (NeurIPS) 2022. $\color{red}{\text{(Spotlight)}}$

  Rui Yang $^*$, Chenjia Bai $^*$, Xiaoteng Ma, Zhaoran Wang, Chongjie Zhang, Lei Han.

Goal-conditioend RL

• What Is Essential for Unseen Goal Generalization of Offline Goal-conditioned RL?. International Conference on Machine Learning (ICML) 2023.

  Rui Yang, Yong Lin, Xiaoteng Ma, Hao Hu, Chongjie Zhang, Tong Zhang.

• Rethinking Goal-conditioned Supervised Learning and Its Connection to Offline RL. International Conference on Learning Representations (ICLR), 2022.

  Rui Yang, Yiming Lu, Wenzhe Li, Hao Sun, Meng Fang, Yali Du, Xiu Li, Lei Han, Chongjie Zhang.

• GOPlan: Goal-conditioned Offline Reinforcement Learning by Planning with Learned Models. Transactions on Machine Learning Research (TMLR) 2024.

  Mianchu Wang $^*$, Rui Yang $^*$, Xi Chen, Hao Sun, Meng Fang, Giovanni Montana.

Experiences

• Internship at Tencent AI Lab

• Internship at Meituan Financial Service Group

Services

Conference Reviewer: ICML (22,24), ICLR (24, 25), NeurIPS (22,23 $\color{red}{\text{Top Reviewer}}$, 24), ICRA (23), AAMAS(24).

Journal Reviewer: IEEE Robotics and Automation Letters (RA-L), IEEE Transactions on Artificial Intelligence (TAI), Machine Learning, Journal of Artificial Intelligence Research.

Teaching Assistant: COMP 4211 Machine Learning, HKUST; COMP 1021 Introduction to Computer Science, HKUST

Others

In my leisure time, I enjoy sports like running, table tennis, and swimming. During my time at Tsinghua University, I was an amateur long-distance runner. In 2019, I completed a half marathon (21.0975 km) in 1 h 30 m and a full marathon (42.195 km) in 3 h 36 m.