AlexNet--ImageNet Classification with Deep Convolutional Neural Networks

LRN(Local Response Normalization)

• applied this normalization after applying the ReLU nonlinearity in certain layers

Overlapping Pooling

• We generally observe during training that models with overlapping pooling find it slightly more difficult to overfit

Overall Architecture

Data Augmentation

• image translations
• horizontal reflections
• perform PCA on the set of RGB pixel values