Sun.Jul 21, 2024

article thumbnail

Visualizing piecewise linear neural networks

Jane Street

Neural networks are often thought of as opaque, black-box function approximators, but theoretical tools let us describe and visualize their behavior. In particular, lets study piecewise-linearity, a property many neural networks share. This property has been studied before , but well try to visualize it in more detail than has been previously done.