03·Language Modeling Head and Logits

Introduction

You will learn the language modeling head that maps token representations to vocabulary logits, and the relationship between logits, softmax, and cross-entropy.