Self-training can quietly corrupt AI safety
Repeatedly training a model on its own outputs can slowly make it willing to produce harmful responses, even without any harmful data.
Repeatedly training a model on its own outputs can slowly make it willing to produce harmful responses, even without any harmful data.