Digit Recognition - Backpropagation Process

Input
-
Ready
-
Output Prediction
Parameters Update
Layer $\mathbf{w}$ (Weight) $\mathbf{b}$ (Bias) $C$ (Loss)
L1---
L2---
L3---
Output---
Loss $C_i^{(n+1)}$
-
Avg Activation
-
Avg Gradient $\overline{v}_i$
-
Prediction
-