A 1x1 convolution or a network in network is an architectural technique used in some convolutional neural networks.
The technique was first described in the paper Network In Network.
A 1x1 convolution is a convolutional layer where the filter is of dimension .
The filter takes in a tensor of dimension , over the values in the third dimension and outputting a matrix. Subsequently, an activation function (like ReLU) is applied to the output matrix.
If we have filters, then the output of the layer is a tensor of dimension . This is useful if the number of channels in the previous layer of the network has grown too large and needs to be altered to channels.
The convolution technique was featured in paper introducing the Inception network architecture, titled Going Deeper With Convolutions.