Why Muon Outperforms Adam: A Curvature Perspective
Paper • 2606.04662 • Published • 10
AI & ML interests
Reinforcement Learning, Language Models, Diffusion Models
Recent Activity
View all activity
Papers
View all Papers
FengzhuoÂ
submitted a
paper to Daily Papers about 1 month ago
JLiangHeÂ
authored a
paper about 1 month ago
JLiangHeÂ
submitted a
paper to Daily Papers about 1 month ago
zhuoranyangÂ
updated a
Space 4 months ago
JLiangHeÂ
submitted a
paper to Daily Papers 5 months ago
JLiangHeÂ
authored 6
papers 5 months ago
Sample-efficient Learning of Infinite-horizon Average-reward MDPs with General Function Approximation
Paper • 2404.12648 • Published
In-Context Linear Regression Demystified: Training Dynamics and Mechanistic Interpretability of Multi-Head Softmax Attention
Paper • 2503.12734 • Published
Llama-3.1-FoundationAI-SecurityLLM-8B-Instruct Technical Report
Paper • 2508.01059 • Published • 35
Llama-3.1-FoundationAI-SecurityLLM-Reasoning-8B Technical Report
Paper • 2601.21051 • Published • 14
On the Mechanism and Dynamics of Modular Addition: Fourier Features, Lottery Ticket, and Grokking
Paper • 2602.16849 • Published • 7
From Words to Actions: Unveiling the Theoretical Underpinnings of LLM-Driven Autonomous Systems
Paper • 2405.19883 • Published
zhuoranyangÂ
published a
Space 5 months ago
zhuoranyangÂ
submitted a
paper to Daily Papers 6 months ago
FengzhuoÂ
submitted a
paper to Daily Papers 6 months ago
zhuoranyangÂ
authored 6
papers 9 months ago
A Theoretical Analysis of Deep Q-Learning
Paper • 1901.00137 • Published
Diffusion Model is an Effective Planner and Data Synthesizer for Multi-Task Reinforcement Learning
Paper • 2305.18459 • Published
Symmetric Mean-field Langevin Dynamics for Distributional Minimax Problems
Paper • 2312.01127 • Published
In-Context Linear Regression Demystified: Training Dynamics and Mechanistic Interpretability of Multi-Head Softmax Attention
Paper • 2503.12734 • Published
Taming Polysemanticity in LLMs: Provable Feature Recovery via Sparse Autoencoders
Paper • 2506.14002 • Published • 5
On Computation and Generalization of Generative Adversarial Imitation Learning
Paper • 2001.02792 • Published • 1