Deep Learning · MT2 · section

Images and sequences

Course vocabulary in plain words

TermMeaningWhat to keep separate
TensorArray of numbers with one or more axesIts shape and its values
ChannelOne feature map within an image-like tensorChannels versus spatial size
Kernel / filterLearned weights sliding over a mapKernel size versus filter count
StrideStep between adjacent window positionsStride versus kernel width
PaddingExtra border cells around an inputPer-side P versus total 2P
Feature mapResponses from a filter across positionsActivations versus parameters
PoolingWindow-based reduction of feature mapsMaximum versus average
FlattenRearrange H × W × C entries as a vectorRearrangement has no parameters
LogitRaw score before an output activationScore versus probability
Hidden stateRecurrent features carried through timePrevious state versus current input
Shared weightsOne learned rule reused at many positions/timesReuse versus extra parameters