Multi-Layer Perceptron (MLP) - based Classification

Since the publication of the paper: "Attention is all you need" in 2017, Google Brain aims to replace Transformers with the Multi-layer Perceptron (MLP) in Computer Vision tasks. In a recent paper, Google has introduced MLP-Mixer: “While convolutions and attention are both sufficient for good performance, neither of them are necessary”.