GENERALOBSERVATIONS
Enhanced generalization performance is achieved, when the exponential weights of the Neural Networks are kept small.
Hence box-constrained optimization methods should be applied.
Bigger Networks (greater number of nodes) can achieve higher accuracy.
- Existing Specialized Hardware
- Sophisticated Optimization Software