CASI Leaderboard Shifts: Developer Role Attack, and Three Concerning Incidents
Introduction We evaluated 15 new models this month and noted some surprising changes in behavior and CASI scores. During the same period, three production incidents demonstrated specific failure modes in…