Overview
This following list is the topics of study included in the Intro to Machine Learning with Pytorch nanodegree certification.
Supervised Learning
- Linear Regression 2/15
- Perceptron Algorithm 2/17
- Decision Tree 2/19
- Naive Bayes 2/23
- Support Vector Machines 3/2
- Ensemble Methods 3/8
- Model Evaluation Methods 3/9
- Training and Tuning 3/19
- Project: Supervised Learning on the Census Income Dataset 4/24
Deep Learning
- Intro to Neural Networks 4/25
- Implementing Gradient Descent 5/8
- Training Neural Networks 5/15
- Deep Learning with PyTorch
- Essentials 5/16
- Tensors in PyTorch 5/17
- Neural Networks Architecture 5/20
- Training Neural Networks 5/21
- Classifying Fashion Example from MNIST 5/22
- Inference and Validation 5/26
- Saving and Loading Models 5/27
- Loading Image Data 5/28
- Transfer Learning 5/29
- Project: Image Classifier 7/25
Unsupervised Learning
- Clustering 7/26
- Hierarchical and Density Based Clustering 8/1
- Gaussian Mixture Models and Cluster Validation 8/9
- Dimensionality Reduction and PCA 8/10
- Random Projection and ICA 8/15
- Project: Identify Customer Segments 8/29
Overview
Two Histories of Machine Learning
Current uses of machine learning come from the combination of two perspectives: statisticians' and computer scientists'.
Statisticians' Approach
The statisticians' perspective has evolved from understanding data. This perspective involves using probability-based models of our world. For example, there are models that predict the answers given on a test, the number of accidents on a given stretch of road, and the frequency of words in a body of text. These models have been used to describe many aspects of our daily lives, but these models are an oversimplification of the real-world that do not always hold true.
Computer Scientists' Approach
In the 1950’s, computer scientists began to realize that hard-coding all computers' decision-making was becoming untenable. Instead, a new paradigm was developed wherein computers looked at data and recognized patterns. This idea of recognizing patterns is what is now known as machine learning. Rather than hard-coding rules, these new techniques involved rules that were based on distributions. Over time, machine learning advanced, and these distributions evolved into extremely flexible and complex models.
These more recent, complex models outperform both the previous hard-coded computational paradigm as well as the more simplistic statical models. These intricate models have, however, also become opaque and difficult to understand and interpret, even for the experts who design them.
Types of Machine Learning
Supervised Learning
In supervised learning, algorithms learn from studying labeled data. After studying the labeled data, the algorithms determine which label should be assigned to new data. Supervised learning can be further subdivided into classification and regression, which are differentiated by whether the output is discrete or continuous. Supervised learning is the type of machine learning that has gained the most traction in business use cases.
Unsupervised Learning
Unsupervised learning creates labels for data when there are no labels to train on. There are many applications for these techniques, including reducing a dataset down to only the most useful features, grouping similar items, and building music recommendation systems.
Reinforcement Learning
The final type of machine learning is reinforcement learning. It is used to train algorithms that learn based on taking certain actions, and receiving feedback from taking those actions. The applications of reinforcement learning include self-driving cars and gaming agents like the ones recently developed to play Go and Starcraft 2.
Deep Learning
Deep learning has outperformed all other machine learning systems in its ability to predict. It can be used for all three types of learning outlined above: unsupervised, supervised, and reinforcement. The recent rapid growth of this technique makes sense, because over time we have cared less about how we make predictions and more about the accuracy of the predictions we make. In deep learning, we rarely have a complete understanding of how or why certain predictions are made.
Deep learning, unfortunately, cannot be the answer to every problem because of three barriers:
- Deep learning requires a lot of data.
- Deep learning requires a lot of computing power. In order to reach superhuman performance at Go, Google Deep Mind’s Alpha Go required 1202 CPUs and 176 GPUs.
- How or why a decision was made is not likely to be fully understandable.
Scikit-Learn
Scikit-learn is the most popular open-source library for supervised and unsupervised learning. With this library, the most advanced techniques are available to all data scientists at no cost. Scikit-learn will continue to be widely used for the foreseeable future.