Practical Advice for Applying Machine Learning

Practical Advice for Applying Machine Learning

Learn how to make decisions, evaluate models, handle bias and variance, and manage real-world ML workflows with cross-validation, error analysis, and transfer learning.

Jongmin Lee
14 min read

3.Advice for applying machine learning

Advice for applying machine learning

Deciding what to try next

Screenshot 2024-04-01 at 6.07.39 PM.png

Screenshot 2024-04-01 at 6.09.48 PM.png

Evaluating a model

Screenshot 2024-04-01 at 6.16.37 PM.png

Screenshot 2024-04-01 at 6.17.07 PM.png

Screenshot 2024-04-01 at 6.17.57 PM.png

Screenshot 2024-04-01 at 6.19.10 PM.png

Screenshot 2024-04-01 at 6.19.23 PM.png

Model selection and training/cross validation/test sets

Screenshot 2024-04-01 at 6.20.24 PM.png

Screenshot 2024-04-01 at 6.20.46 PM.png

Screenshot 2024-04-01 at 6.21.14 PM.png

Screenshot 2024-04-01 at 6.21.29 PM.png

Screenshot 2024-04-01 at 6.21.52 PM.png

Screenshot 2024-04-01 at 6.22.23 PM.png

Bias and variance

Bias/variance

Screenshot 2024-04-01 at 6.29.01 PM.png

Screenshot 2024-04-01 at 6.29.55 PM.png

Regularization and bias/variance

Screenshot 2024-04-01 at 6.31.26 PM.png

Screenshot 2024-04-01 at 6.31.58 PM.png

Screenshot 2024-04-01 at 6.32.19 PM.png

Establishing a baseline level of performance

Screenshot 2024-04-01 at 6.37.23 PM.png

Screenshot 2024-04-01 at 6.38.15 PM.png

Learning curves

Screenshot 2024-04-01 at 6.45.29 PM.png

High bias

Screenshot 2024-04-01 at 7.03.03 PM.png

High variance

Screenshot 2024-04-01 at 7.03.23 PM.png

Deciding what to try next revisited

Screenshot 2024-04-01 at 9.16.19 PM.png

Bias/variance and neural networks

Screenshot 2024-04-01 at 9.17.23 PM.png

Screenshot 2024-04-01 at 9.17.41 PM.png

Screenshot 2024-04-01 at 9.17.52 PM.png

Screenshot 2024-04-01 at 9.18.02 PM.png

Machine learning development process

Iterative loop of ML development

Screenshot 2024-04-02 at 7.50.31 PM.png

Screenshot 2024-04-02 at 7.52.46 PM.png

Screenshot 2024-04-02 at 7.53.44 PM.png

Error analysi

Screenshot 2024-04-02 at 7.55.46 PM.png

Screenshot 2024-04-02 at 7.56.06 PM.png

Adding data

Screenshot 2024-04-02 at 7.57.03 PM.png

Screenshot 2024-04-02 at 7.57.54 PM.png

Screenshot 2024-04-02 at 7.58.22 PM.png

Screenshot 2024-04-02 at 7.58.44 PM.png

Transfer learning

Screenshot 2024-04-02 at 7.59.33 PM.png

Screenshot 2024-04-02 at 7.59.45 PM.png

Screenshot 2024-04-02 at 7.59.54 PM.png

Full cycle of a machine learning project

Screenshot 2024-04-02 at 8.00.45 PM.png

Screenshot 2024-04-02 at 8.00.57 PM.png

Fairness, bias, and ethics

Screenshot 2024-04-02 at 8.02.44 PM.png

Screenshot 2024-04-02 at 8.03.01 PM.png

Screenshot 2024-04-02 at 8.03.12 PM.png

Skewed datasets

Screenshot 2024-04-02 at 8.09.46 PM.png

Screenshot 2024-04-02 at 8.10.08 PM.png

Trading off precision and recall

Screenshot 2024-04-02 at 8.12.37 PM.png

Screenshot 2024-04-02 at 8.12.55 PM.png