About me

I’m a first year Ph.D. student at CSE, the Hong Kong University of Science and Technology, supervised by Prof. Tong Zhang. I received my master’s and bachelor’s degrees from the Department of Automation at Tsinghua University. I am furtunate to have been working closely with Prof. Chongjie Zhang (IIIS, Tsinghua University), Dr. Lei Han (Tencent), and Prof. Meng Fang (University of Liverpool). My research interests lie in deep reinforcement learning (RL), especially goal-conditioned RL, offline RL and model-based RL, and the application of RL algorithms to game AI and robotics.

Currently, I am actively researching ways to improve the robustness and generalization abilities of deep reinforcement learning. Feel free to contact me by email if you are interested in discussing or collaborating with me.


Conference Papers

Journal Papers


  • 2022.09 - now, Ph.D. student, Department of Computer Science and Engineering, the Hong Kong University of Science and Technology.
  • 2019.09 - 2022.07, Master, Department of Automation, Tsinghua University.
  • 2015.09 - 2019.07, Bachelor, Department of Automation, Tsinghua University.


  • Tencent AI Lab (Jun. 2020 – Sep. 2020)

    Researched on multi-step HER and offline meta RL.

  • Meituan Financial Service Group (Jul. 2019 – Sep. 2019)

    Controlled the advertising speed of Meituan app via a pacing PI control algorithm.


Conference Reviewer: ICML (2022), NeurIPS (2022,2023)


During my leisure time, I like sports such as running, table tennis and swimming. I used to be an amateur long-distance runner. I finished a half marathon (21.0975 km) in 1h30min and a marathon (42.195 km) in 3h36min.