01·Intuition Behind Attention

Introduction

This lesson builds intuition: attention lets each sequence position choose which other positions to read information from. Before formulas appear, we establish the meaning of weights, context and masking.