---
title:

Aurora Optimizer Prevents Neuron Death in Large Models

date: 2026-05-10
tags: [#news, #ai ]
draft: false
---

Tilde Research introduced Aurora, a new leverage-aware optimizer that solves the issue of dying neurons in MLP layers caused by standard row-normalization. By combining row-norm uniformity with orthogonality, the optimizer achieves significantly higher data efficiency and outperforms current state-of-the-art results in nanoGPT optimization benchmarks.