ā Must-know
š The data are assumed to be independently and identically sampled from a fixed but unknown distribution p(x,y).
Inputs belong to an input space , while outputs belong to an output space Y, typically a subset of the real numbers.
Regression uses an output space , binary classification uses , and multiclass classification uses .
Further detail
š Formula - The joint distribution factorizes as .
ā Must-know
š Formula - In regression, the data model is , where f* is a fixed unknown regression function and ε is random noise.
Further detail
The regression noise may follow a Gaussian distribution , with .
Noiseless classification has for every x in X.
š Formula - In binary classification, for every x.
ā Must-know
š Formula - The expected risk of a predictor is .
Further detail
ā Must-know
Further detail
Good learning requires both fitting the data well and remaining stable when the data change slightly.
Regularization algorithms use one or more parameters to control the trade-off between data fitting and stability.
Overfitting fits but is unstable; oversmoothing is stable but disregards the data.
Take a 18-question practice quiz on Statistical Learning Basic Concepts, with every answer explained.
1. A software system improves its performance by learning patterns from examples rather than receiving explicit instructions for each task. Which field studies this approach?
2. A researcher has input-output examples and wants a model that predicts an output for a previously unseen input. What is the goal of this supervised-learning task?
Memorize the key concepts of Statistical Learning Basic Concepts with 35 flashcards.
What does machine learning study?
Systems trained from data rather than explicitly programmed.
What relation does supervised learning seek to predict outputs for new inputs?
An underlying input-output relation.
In what space do inputs belong, and how is it bounded?
.
Upload your class notes and Revizly writes a study guide, a quiz and flashcards in about a minute.
Study guide maker