We dive deep into the concept of Self Attention in Transformers! Self attention is a key mechanism that allows models like BERT and GPT to capture long-range dependencies within text, making them ...

3D illustration of high voltage transformer on white background. Even now, at the beginning of 2026, too many people have a sort of distorted view of how attention mechanisms work in analyzing text.

In the last decade, convolutional neural networks (CNNs) have been the go-to architecture in computer vision, owing to their powerful capability in learning representations from images/videos.