Plate 2 · Loss landscape

Find theflat minimum.

A loss surface engraved as contour lines, one level for every tenth of a decade. Orange sparks descend it by gradient: some settle in a valley, some fall into the sharp minimum at its centre.