Oh it's the KL term sorry - beta \* KL ie they set beta to 0. The goal of it was...

		danielhanchen 3 months ago \| parent \| context \| favorite \| on: Magistral — the first reasoning model by Mistral A... Oh it's the KL term sorry - beta * KL ie they set beta to 0. The goal of it was to "force" the model not to stray to far away from the original checkpoint, but it can hinder the model from learning new things