When two AIs grade each other, they can agree their way into wrong answers
Two copies of one model that write and grade each other’s questions can look healthy while agreeing on more wrong answers.
Two copies of one model that write and grade each other’s questions can look healthy while agreeing on more wrong answers.
Post-training a model for one skill nudges its answers on unrelated questions, and that changes how I think about protecting models from copying.