Tricks for deep neural networks

-- This post will be updated when I come across a new trick.  Data augmentation: add noise to data, for images: simulate different view points, camera models, such as using affine transformation, lens distortion, color correction, adjust contrast, gamma, saturation, etc.  Data normalization: center data, normalize to [-1, 1], PCA, ...

Read More