senet

While transformers have dominated the machine learning landscape with their revolutionary attention mechanisms, the computer vision community has been quietly developing sophisticated attention techniques that predate and complement transformer architectures. Two standout approaches that have significantly impacted convolutional neural networks are the Convolutional Block Attention Module (CBAM) and Squeeze-and-Excitation Networks (SENet). These mechanisms have proven … Read more