The main contribution of the K3 paper is Stable LatentMoE. Like some other models K3 compresses data sent between layers and this put certain requirements on the router. K3 improves performance by using a more balanced selection strategy here.
Compared to the Opus 5 "model card", which read like a standard Anthropic set of alignment principles and safety concerns, this presents a plethora of useful technical details that advances the state of the art.
As it's 9 months old and they just had a major model release
The main contribution of the K3 paper is Stable LatentMoE. Like some other models K3 compresses data sent between layers and this put certain requirements on the router. K3 improves performance by using a more balanced selection strategy here.