Context Windows

Large Language Modelsconcept

First met at Engineer4h

In simple words

The model’s entire working memory, and the constraint that shapes most system design.

The fuller explanation is not written yet

This term has its meaning, its place on the map and its sources, and they are accurate. The longer write-up is still to come, and this page will say so until it does rather than padding the gap.

The sources below are the honest starting point.

Learn these first

Real prerequisites, taken from the map rather than guessed.

Large Language ModelsTransformers trained on enough text to become general-purpose reasoning surfaces.
TokenisationHow text becomes numbers, and why the model cannot count the letters in a word.

Sources

Where this came from, so you can go past us.

paperLost in the Middle: How Language Models Use Long Contexts

Where does this sit on your route?

The free assessment places you on the same map and names which terms stand between you and the role you want.

Take the free assessment

See it in context

The Atlas shows this term with everything that leads into it and everything that follows, as one picture.

Open the map