Jade (Lei) Yu
  • Bio
  • Papers
  • News
  • Experience
  • Recent & Upcoming Talks
    • Example Talk
  • Publications
    • Calibrating Verbal Uncertainty as a Linear Feature to Reduce Hallucinations
    • Infinite Mixture Chaining: An Efficiency-Based Framework for the Dynamic Construction of Word Meaning
    • The Reasoning-Memorization Interplay in Language Models Is Mediated by a Single Direction
    • Beyond Sparse Rewards: Enhancing Reinforcement Learning with Language Model Critique in Text Generation
    • Drlc: Reinforcement learning with dense rewards from llm critic
    • Emergence of a high-dimensional abstraction phase in language transformers
    • Enhancing reinforcement learning with dense rewards from language model critic
    • Functional faithfulness in the wild: Circuit discovery with differentiable computation graph pruning
    • Geometric Signatures of Compositionality Across a Language Model's Lifetime
    • Geometric Signatures of Compositionality in Language Models
    • Intrinsic evaluation of unlearning using parametric knowledge traces
    • Mechanisms of non-factual hallucinations in language models
    • Mechanistic understanding and mitigation of language model non-factual hallucinations
    • Robust LLM safeguarding via refusal feature adversarial training
    • A computational analysis of crosslinguistic regularity in semantic change
    • Rolecraft-glm: Advancing personalized role-playing in large language models
    • Systematic word meta-sense extension
    • Word sense extension
    • Infinite mixture chaining: Efficient temporal construction of word meaning
    • Noun2Verb: Probabilistic frame semantics for word class conversion
    • Predicting emergent linguistic compositions through time: Syntactic frame extension via multimodal chaining
    • How nouns surface as verbs: Inference and generation in word class conversion
    • Inferring symmetry in natural language
    • An example preprint / working paper
    • An example journal article
    • An example conference paper
  • Projects
  • Blog
    • ๐ŸŽ‰ Easily create your own simple yet highly customizable blog
    • ๐Ÿง  Sharpen your thinking with a second brain
    • ๐Ÿ“ˆ Communicate your results effectively with the best data visualizations
    • ๐Ÿ‘ฉ๐Ÿผโ€๐Ÿซ Teach academic courses
    • โœ… Manage your projects
  • Projects
    • Pandas
    • PyTorch
    • scikit-learn
  • Teaching
    • Learn JavaScript
    • Learn Python
  • Work Experience

Geometric Signatures of Compositionality Across a Language Model's Lifetime

Jan 1, 2024ยท
Jin Hwa Lee
,
Thomas Jiralerspong
,
Lei Yu
,
Yoshua Bengio
,
Emily Cheng
ยท 0 min read
Cite
Type
Journal article
Publication
arXiv preprint arXiv:2410.01444
Last updated on Jan 1, 2024

← Functional faithfulness in the wild: Circuit discovery with differentiable computation graph pruning Jan 1, 2024
Geometric Signatures of Compositionality in Language Models Jan 1, 2024 →

ยฉ 2025 Me. This work is licensed under CC BY NC ND 4.0

Published with Hugo Blox Builder โ€” the free, open source website builder that empowers creators.