Total Survey Design

How the Dunning-Kruger Effect Skews Self-Reported Skill Ratings

Dr. Azdren Coma Season 3 Episode 10

Use Left/Right to seek, Home/End to jump to start or end. Hold shift to jump forward or backward.

0:00 | 7:49

In this episode, Dr. Azdren Coma explores how the Dunning-Kruger effect distorts self-reported skill ratings in hiring and surveys. A seemingly straightforward question like “On a scale of 0 to 10, how skilled are you in Microsoft Excel?” can produce misleading data because undefined scale points allow respondents to interpret them differently. Beginners often overestimate their abilities due to limited awareness of complexity, while more skilled individuals rate themselves more conservatively as they recognize what they don’t know—potentially reversing the ranking of candidates.

This episode breaks down the psychological mechanism behind the bias, illustrates it with real-world examples, and offers practical fixes for better data quality, including fully labeling scales, using clearer anchors, and shifting to task-specific questions. Ideal for HR professionals, hiring managers, and anyone relying on self-assessments in talent acquisition or people operations.

Support the show

Contact us at: totalsurveydesign@gmail.com

Find us online at: instagram.com/totalsurveydesign/

https://taplink.cc/totalsurveydesign


Podcasts we love

Check out these other fine podcasts recommended by us, not an algorithm.

POP: Public Opinion Podcast Artwork

POP: Public Opinion Podcast

American Association for Public Opinion Research
NN/G UX Podcast Artwork

NN/G UX Podcast

Nielsen Norman Group
Scope Conditions Podcast Artwork

Scope Conditions Podcast

Alan Jacobs and Yang-Yang Zhou
FiveThirtyEight Politics Artwork

FiveThirtyEight Politics

ABC News, 538, FiveThirtyEight, Galen Druke