Network
Per-layer activations
Initialization
Goal
Add a goal
Training
Optimizer & speed
Continual learning
Loss–
History
Neural networks bend space.
Layer by layer…
…until every class has its own place.
Watch a neural network bend space — live, in your browser.
by Eren Can Almaz
Watch a small neural network bend space, layer by layer, and see how training reshapes it. Layers wider than 2D or 3D are shown through PCA, their most important directions.
The network maps points of the plane or of space to the same kind of space.
Each card shows what happens in that problem.
Pick a data set; you can adjust it inside.
Each layer is a weight matrix W and a bias b, followed by an activation. The colours are the actual starting weights (gold +, violet −).