Tuchel and Me!

• I am currently visiting Prof. Xiaolong Wang’s Lab, UC San Diego, CA, USA, doing robotics learning research.

• I am a fifth-year Ph.D. student in Apex Lab. at Shanghai Jiao Tong University, supervised by Prof. Weinan Zhang and Prof. Yong Yu. I used to be the group leader of ApexRL, the RL research group of Apex Lab. I am also a member of Wu Wen Jun Honorary Doctoral Plan (吴文俊荣誉博士班), advised by Prof. Cewu Lu. I won ByteDance Scholars Program (字节跳动奖学金) (10 candidates worldwide each year) in 2022. [My Curriculum Vitae] (updated in Feb. 2024)

• My current research interests lie in the general area of reinforcement learning (RL). Particularly, I was devoted in (data-driven) RL methods, like imitation learning, offline RL that can solve real-world decision-making challenges.

• Recently, I have been taking my knowledge in IL/RL to work on robotics learning, aiming at taking intelligent robots closer to real life, e.g., expanding the skills of robots, and helping robots make smart decisions.

• When I read interesting papers I will write down notes in Chinese at Zhihu, where I have 4.6k+ followers.

Recent News

• Jan. 21, 2024. Two papers accepted by ICLR 2024.
• Jan. 21, 2023. One paper accepted by ICLR 2023.
• Sept. 15, 2022. Two papers accepted by NeurIPS 2022.
• May. 23, 2022. Won the TOP1 of Ubiquant Retro Snake Challenge. [News]
• May. 15, 2022. One paper accepted by ICML 2022.
• Apr. 21, 2022. Two papers accepted by IJCAI 2022.

Selected Publications (Full List)

Visual Whole-Body Control for Legged Loco-Manipulation
Minghuan Liu*, Zixuan Chen*, Xuxin Cheng, Yandong Ji, Ruihan Yang, Xiaolong Wang.
Arxiv. [paper] [project]

Vision-Language Foundation Models as Effective Robot Imitators
Xinghang Li*, Minghuan Liu*, Hanbo Zhang, Cunjun Yu, Jie Xu, Hongtao Wu, Chilam Cheang, Ya Jing, Weinan Zhang, Huaping Liu, Hang Li, Tao Kong.
The 12th International Conference on Learning Representations. ICLR 2024. (Spotlight). [paper] [code] [project]

Visual Imitation with Patch Rewards
Minghuan Liu, Tairan He, Weinan Zhang, Shuicheng YAN, Zhongwen Xu.
The 11th International Conference on Learning Representations. ICLR 2023. [paper] [code] [project]

PerfectDou: Dominating DouDizhu with Perfect Information Distillation
Yang Guan*, Minghuan Liu*, Weijun Hong, Weinan Zhang, Fei Fang, Guangjun Zeng, Yue Lin.
The 36th Conference on Neural Information Processing Systems, 2022. NeurIPS 2022. [paper] [code]

Plan Your Target and Learn Your Skills: Transferable State-Only Imitation Learning via Decoupled Policy Optimization.
Minghuan Liu, Zhengbang Zhu, Yuzheng Zhuang, Weinan Zhang, Jianye Hao, Yong Yu, Jun Wang.
Thirty-ninth International Conference on Machine Learning. ICML 2022. [paper] [code] [project]

Curriculum Offline Imitation Learning
Minghuan Liu*, Hanye Zhao*, Zhengyu Yang, Jian Shen, Weinan Zhang, Li Zhao, Tie-Yan Liu.
The 35th Conference on Neural Information Processing Systems, 2021. NeurIPS 2021. [paper] [code]

Energy-Based Imitation Learning
Minghuan Liu, Tairan He, Minkai Xu, Weinan Zhang.
The 20th International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2021. AAMAS 2021. (Oral). [paper][code]

Competitions

• TOP1, Ubiquant Retro Snake Challenge. [News] May. 23, 2022.
• TOP5, Liver Cancer Imaging AI Diagnosis. [Link][News] Apr. 4, 2019.
• TOP10, SCADA Data Missing Repair Competition. [Link][News] Mar. 23, 2019.
• TOP3, Weather Forecast Competition of AI Challenger 2018. [Link][News] Nov. 19, 2018.

Honors and Awards

• ByteDance Scholars Program (字节跳动奖学金), Oct. 2022.
• NeurIPS 2022 Top Reviewer, Oct. 2022.
• National Doctoral Scholarship, Oct. 2022.

Services

• Conference Reviewer: NeurIPS’21’22’23, ICML’21’22’23, ICLR’23’24, CVPR’24

Misc

• I love playing / watching football (soccer), Forward, A fan of Shandong Luneng Taishan, A beginner of football analystics with AI.
  • Click [demo-1] and [demo-2] to see some interesting gadgets I’ve made for football analysis during the Sports Analytics Challenge sponsored by PSG.
  • Have kept a document called Football-Analytics-101 on football analytics motivated by NBAStuffer-Analytics-101, in order to provide ordered, collected and detailed, information about football (soccer) analytics for research works and interesting stuff.
• I also play tennis (NTRP 3.0-3.5) in my spare time.