← all topics

Large Language Models

Pretraining

The expensive part: corpus, curriculum, scaling laws, and the compute bill.

Levels advanced / architect
Depth 8
Time 10h
Kind practice
This node is a stub. It exists on the map because the topic is real and its place in the graph is settled, but the writing has not happened yet. The sources on the right are the honest starting point until it does.