Coding AIs Tend to Suffer From the Dunning-Kruger Effect
New research shows that coding AIs such as ChatGPT suffer from the Dunning-Kruger Effect, often acting most confident when they are least competent. When tackling unfamiliar or obscure programming languages, they claim high certainty even as their answers fall apart. The study links model overconfidence to both poor performance and lack of training data, raising new concerns about how much these systems really know about what they don’t know.
Anyone who has spent even a moderate amount of time i...
Read more at unite.ai