Choose a photo
Pick a JPEG or PNG of a skin lesion, or start from one of the example images, and run the model on it.
K-nearest Index of Typicality in Hidden layers
Machine metacognition · Research demo
Checking whether a model has seen images like yours
KITH is a research demo built around a computer program that sorts close-up photos of skin lesions into benign (harmless) or malignant (cancerous). It learned from 5,772 labelled photos.
Give it a photo and you get two results: the program’s answer with its output probability (the probability the network gives its top answer), and a familiarity score showing how closely your photo resembles the photos it learned from.
Your photo stays on your computer. Nothing is uploaded.
Explore eight worked examples →Read how it works →
A research demo. Not medical advice: if a lesion on your skin worries you, see a doctor.
Measuring Neural Network certainty by distance to known examples
Prediction
Which label does the model choose, and how sure is it?
Familiarity
How similar is this image to the training photos?
Illustration only, not real results.
Combating over-confidence in neural networks.
Read two results
See which label the model chooses, and how similar your image is to the training images it most resembles.
Check familiarity at different stages of the network
Try an image to compare the familiarity score at the early stages of the model with the score at the late stage.
The research question
For ordinary photos, the familiarity score has not added to the program’s own sense of how sure it is. The open question is whether it helps in the cases that matter most: when the program is very sure but wrong, or when a photo is unlike anything it learned from.