DayNews.aiWhy neural net loss landscapes are so flat
Researchers explain why neural network loss landscapes have so many near-flat directions, tracing them to hidden symmetries in how networks are built.
DayNews.aiDayNews.aiDayNews.aiResearchers explain why neural network loss landscapes have so many near-flat directions, tracing them to hidden symmetries in how networks are built.