Deep double descent
- ID
- 873
- Status
- new
- Published
- 05 Dec 2019, 4:00 PM
- Fetched
- 27 Jun 2026, 7:47 PM
- Provider
- OpenAI News
- Category
- ai-labs
- Original URL
- https://openai.com/index/deep-double-descent
- Source URL
- https://openai.com/news/rss.xml
Excerpt
We show that the double descent phenomenon occurs in CNNs, ResNets, and transformers: performance first improves, then gets worse, and then improves again with increasing model size, data size, or training time. This effect is often avoided through careful regularization. While this behavior appears to be fairly universal, we don’t yet fully understand why it happens, and view further study of this phenomenon as an important research direction.
Summary
No summary yet. It will appear after the daemon summarizes this item.