Weiyang Liu
The Chinese University of Hong Kong
Max Planck Institute for Intelligent Systems
I am an assistant professor in Computer Science and Engineering at The Chinese University of Hong Kong, heading the Scalable Principles for Learning and Reasoning Lab (SphereLab). I am also affiliated as a researcher with Max Planck Institute for Intelligent Systems. Previously, I finished my postdoc at Max Planck Institute for Intelligent Systems, working with Bernhard Schölkopf. I received a Ph.D. in Machine Learning from University of Cambridge, and a Ph.D. in Computer Science from Georgia Institute of Technology. I have also spent wonderful time at Google, Nvidia, and MERL.
I work primarily on principled modeling of inductive bias in learning algorithms. My research seeks to understand how inductive bias affects generalization, and to develop "light-yet-sweet" learning algorithms: (i) light: conceptually simple in methodology and easy to implement in practice, (ii) sweet: having clear intuitions and non-trivial theoretical guarantees.
Over the years, I always find myself fascinated by geometric invariance, symmetry, structures and how they can benefit generalization as guiding principles. Recently, I start rethinking inductive bias for foundation models, and develop a deep interest in large language models and generative modeling across visual, textual, and physical domains. More specifically, my current research focuses on (i) developing principled algorithms for training and adapting foundation models, and (ii) understanding how LLMs perform reasoning and eliciting it in verifiable scenarios (formal/math/symbolic reasoning).
I always believe in two principles in my research: (i) insight must precede application, and (ii) everything should be made as simple as possible, but not simpler. I try to follow certain research values.
I take great pleasure to work with a group of highly motivated students. Interested in joining? Make sure to read this first.
Ph.D. students
- Zeju Qiu (with Bernhard Schölkopf)
- Jiacheng Chen (with Yu Cheng)
- He Guo
- Siyuan Ma (with Yandong Wen)
Visiting students
Model Merging with Functional Dual Anchors
Kexuan Shi, Yandong Wen, Weiyang Liu
Preprint 2025
arXiv | code | project | bib
Agentic Design of Compositional Machines
Wenqian Zhang, Weiyang Liu, Zhen Liu
Preprint 2025
arXiv | code | project | bib
SimKO: Simple Pass@K Policy Optimization
Ruotian Peng, Yi Ren, Zhouliang Yu, Weiyang Liu, Yandong Wen
Preprint 2025
arXiv | code | project | bib
Reparameterized LLM Training via Orthogonal Equivalence Transformation
Zeju Qiu, Simon Buchholz, Tim Z. Xiao, Maximilian Dax, Bernhard Schölkopf, Weiyang Liu*
NeurIPS 2025
arXiv | code | project | bib
Show selected / all by date / all by topic