Test a simple classifier
Use fictional school sorting cards to trace a threshold rule, reserve unseen examples and count errors. This local model exercise does not train or deploy an AI service.
Lessons in this course
- Separate inputs from labelsDistinguish measured features, known training labels and future predictions in a classification task. About this lesson
- Trace a threshold ruleApply an inclusive threshold and distinguish a chosen toy rule from proof that a model works generally. About this lesson
- Keep a fair test unseenSeparate choosing a rule from evaluating it and recognise answer leakage and repeated test tuning. About this lesson
- Count errors and compare tradeoffsCalculate test accuracy and distinguish overall accuracy from the consequences and distribution of errors. About this lesson
Every lesson is learn-by-doing: make a guess, try it, see the rule, then practise. Progress saves on this phone.