Jade Yu

AI Research Scientist

Jade (Lei) Yu

Meta Superintelligence Labs · FAIR

Large language models & AI agents

Portrait of Jade (Lei) Yu

About Me

I am a research scientist at Meta Superintelligence Labs, in the Fundamental AI Research pillar (FAIR). I work on Large Language Models (LLMs) and AI Agents.

I currently work on agentic post-training of Meta’s Muse model family, including the Muse Wonder, Muse Spark, and Muse Glimmer series. I also lead and conduct research projects covering topics including long-horizon reinforcement learning and recursive self-improvement.

I received my PhD in Computer Science from the University of Toronto, where I studied machine generation of creative language use under the supervision of Yang Xu. During my PhD, I was fortunate to intern at Meta FAIR and Google Research.

Background

Experience

Education

Publications

Google Scholar

2025

Calibrating Verbal Uncertainty as a Linear Feature to Reduce Hallucinations

Ziwei Ji, Lei Yu, Yeskendir Koishekenov, Yejin Bang, Anthony Hartshorn, Alan Schelten, Cheng Zhang, Pascale Fung, Nicola Cancedda
arXiv preprint arXiv:2503.14477 · 2025

Infinite Mixture Chaining: An Efficiency-Based Framework for the Dynamic Construction of Word Meaning

Lei Yu, Yang Xu
Open Mind · 2025

2024

Beyond Sparse Rewards: Enhancing Reinforcement Learning with Language Model Critique in Text Generation

Meng Cao, Lei Shu, Lei Yu, Yun Zhu, Nevan Wichers, Yinxiao Liu, Lei Meng
arXiv preprint arXiv:2401.07382 · 2024

Drlc: Reinforcement learning with dense rewards from llm critic

Meng Cao, Lei Shu, Lei Yu, Yun Zhu, Nevan Wichers, Yinxiao Liu, Lei Meng
arXiv e-prints · 2024

Emergence of a high-dimensional abstraction phase in language transformers

Emily Cheng, Diego Doimo, Corentin Kervadec, Iuri Macocco, Jade Yu, Alessandro Laio, Marco Baroni
arXiv preprint arXiv:2405.15471 · 2024

Enhancing reinforcement learning with dense rewards from language model critic

Meng Cao, Lei Shu, Lei Yu, Yun Zhu, Nevan Wichers, Yinxiao Liu, Lei Meng
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · 2024

Functional faithfulness in the wild: Circuit discovery with differentiable computation graph pruning

Lei Yu, Jingcheng Niu, Zining Zhu, Gerald Penn
arXiv preprint arXiv:2407.03779 · 2024

Geometric Signatures of Compositionality Across a Language Model’s Lifetime

Jin Hwa Lee, Thomas Jiralerspong, Lei Yu, Yoshua Bengio, Emily Cheng
arXiv preprint arXiv:2410.01444 · 2024

Intrinsic evaluation of unlearning using parametric knowledge traces

Yihuai Hong, Lei Yu, Haiqin Yang, Shauli Ravfogel, Mor Geva
arXiv preprint arXiv:2406.11614 · 2024

Mechanisms of non-factual hallucinations in language models

Lei Yu, Meng Cao, Jackie Chi Kit Cheung, Yue Dong
arXiv e-prints · 2024

Mechanistic understanding and mitigation of language model non-factual hallucinations

Lei Yu, Meng Cao, Jackie Chi Kit Cheung, Yue Dong
arXiv preprint arXiv:2403.18167 · 2024

Robust LLM safeguarding via refusal feature adversarial training

Lei Yu, Virginie Do, Karen Hambardzumyan, Nicola Cancedda
arXiv preprint arXiv:2409.20089 · 2024

2023

A computational analysis of crosslinguistic regularity in semantic change

Olivia Fugikawa, Oliver Hayman, Raymond Liu, Lei Yu, Thomas Brochhagen, Yang Xu
Frontiers in Communication · 2023

Rolecraft-glm: Advancing personalized role-playing in large language models

Meiling Tao, Xuechen Liang, Tianyu Shi, Lei Yu, Yiting Xie
arXiv preprint arXiv:2401.09432 · 2023

Systematic word meta-sense extension

Lei Yu
arXiv preprint arXiv:2311.13029 · 2023

Word sense extension

Lei Yu, Yang Xu
arXiv preprint arXiv:2306.05609 · 2023

2022

Infinite mixture chaining: Efficient temporal construction of word meaning

Lei Yu, Yang Xu
Proceedings of the Annual Meeting of the Cognitive Science Society · 2022

Noun2Verb: Probabilistic frame semantics for word class conversion

Lei Yu, Yang Xu
Computational Linguistics · 2022

2021

Predicting emergent linguistic compositions through time: Syntactic frame extension via multimodal chaining

Lei Yu, Yang Xu
arXiv preprint arXiv:2109.04652 · 2021

2020

How nouns surface as verbs: Inference and generation in word class conversion

Lei Yu, Lana El Sanyoura, Yang Xu
Proceedings of the Annual Meeting of the Cognitive Science Society · 2020

Inferring symmetry in natural language

Chelsea Tanchip, Lei Yu, Aotao Xu, Yang Xu
arXiv preprint arXiv:2010.08090 · 2020

Undated

Geometric Signatures of Compositionality in Language Models

Thomas Jiralerspong, Jin Hwa Lee, Lei Yu, Emily Cheng
NeurIPS 2024 Workshop on Compositional Learning: Perspectives, Methods, and Paths Forward

The Reasoning-Memorization Interplay in Language Models Is Mediated by a Single Direction

Yihuai Hong, Dian Zhou, Meng Cao, Lei Yu, Zhijing Jin