01·Mini-GPT Architecture

Introduction

You will assemble the high-level mini-GPT architecture: token and position embeddings, a decoder-only block stack, final normalization, and the language modeling head.