Optimisers

Deep Learningtechnique

First met at Engineer5h

In simple words

Adam, AdamW, schedules and warmup. What you actually tune when training stalls.

The fuller explanation is not written yet

This term has its meaning, its place on the map and its sources, and they are accurate. The longer write-up is still to come, and this page will say so until it does rather than padding the gap.

The sources below are the honest starting point.

Learn these first

Real prerequisites, taken from the map rather than guessed.

Sources

Where this came from, so you can go past us.

Where does this sit on your route?

The free assessment places you on the same map and names which terms stand between you and the role you want.

Take the free assessment

See it in context

The Atlas shows this term with everything that leads into it and everything that follows, as one picture.

Open the map