ROC (Receiver Operator Characteristic) graphs and AUC (the area under the curve), are useful for consolidating the information from a ton of confusion matrices into a single, easy to interpret graph. This video walks you through how to create and interpret ROC graphs step-by-step. We then show how the AUC can be used to compare classification methods and, lastly, we talk about what to do when your data isn’t as warm and fuzzy as it should be.
NOTE: This is the 2019.07.11 revision of a video published earlier.
NOTE: This video assumes you already know about
Confusion Matrices…
…Sensitivity and Specificity…
…and the example I work through is based on Logistic Regression, so it would help to understand the basics of that as well:
For a complete index of all the StatQuest videos, check out:
If you’d like to support StatQuest, please consider…
Patreon: https://www.patreon.com/statquest
…or…
YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join
…a cool StatQuest t-shirt or sweatshirt (USA/Europe): https://teespring.com/stores/statquest
(everywhere):
https://www.redbubble.com/people/starmer/works/40421224-statquest-double-bam?asc=u&p=t-shirt
…buying one or two of my songs (or go large and get a whole album!)
https://joshuastarmer.bandcamp.com/
…or just donating to StatQuest!
https://www.paypal.me/statquest
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:
https://twitter.com/joshuastarmer