Liyuan (Lucas) Liu is a Principal Researcher at Microsoft Research and the lead author behind GRIN-MoE (GRadient-INformed Mixture of Experts), a 2024 paper introducing a novel gradient-informed routing approach that achieves strong MMLU performance with fewer active parameters. His research focuses on demystifying the mathematics behind LLM pretraining heuristics.
Liyuan Liu (Lucas) appeared as a guest on ThursdAI, the weekly AI news podcast hosted by Alex Volkov. Browse the full guest directory or subscribe on Substack to never miss an episode.
ThursdAI — The weekly AI podcast. Every Thursday, live.
Subscribe Free →