Practical Aspects of Deep Learning-Setting up your Machine Learning Application
Train / Dev / Test sets
()
Bias / Variance
()
Basic Recipe for Machine Learning
()
Practical Aspects of Deep Learning-Connect with your Mentors and Fellow Learners on Discourse!
Connect with your Mentors and Fellow Learners on Discourse!
Practical Aspects of Deep Learning-Regularizing your Neural Network
Clarification about Upcoming Regularization Video
Regularization
()
Why Regularization Reduces Overfitting?
()
Dropout Regularization
()
Clarification about Upcoming Understanding Dropout Video
Understanding Dropout
()
Other Regularization Methods
()
Practical Aspects of Deep Learning-Setting Up your Optimization Problem
Normalizing Inputs
()
Vanishing / Exploding Gradients
()
Weight Initialization for Deep Networks
()
Numerical Approximation of Gradients
()
Gradient Checking
()
Gradient Checking Implementation Notes
()
Practical Aspects of Deep Learning-Lecture Notes (Optional)
Lectures in PDF
Practical Aspects of Deep Learning-Programming Assignments
How to Download your Notebook
How to Refresh your Workspace
Practical Aspects of Deep Learning-Heroes of Deep Learning (Optional)
Yoshua Bengio Interview
()
Optimization Algorithms-Optimization Algorithms
Mini-batch Gradient Descent
()
Understanding Mini-batch Gradient Descent
()
Exponentially Weighted Averages
()
Understanding Exponentially Weighted Averages
()
Bias Correction in Exponentially Weighted Averages
()
Gradient Descent with Momentum
()
RMSprop
()
Clarification about Upcoming Adam Optimization Video
Adam Optimization Algorithm
()
Clarification about Learning Rate Decay Video
Learning Rate Decay
()
The Problem of Local Optima
()
Optimization Algorithms-Lecture Notes (Optional)
Lectures in PDF
Optimization Algorithms-Heroes of Deep Learning (Optional)
Yuanqing Lin Interview
()
Hyperparameter Tuning, Batch Normalization and Programming Frameworks-Hyperparameter Tuning
Tuning Process
()
Using an Appropriate Scale to pick Hyperparameters
()
Hyperparameters Tuning in Practice: Pandas vs. Caviar
()
Hyperparameter Tuning, Batch Normalization and Programming Frameworks-Batch Normalization
Clarification about Upcoming Normalizing Activations in a Network Video
Normalizing Activations in a Network
()
Fitting Batch Norm into a Neural Network
()
Why does Batch Norm work?
()
Batch Norm at Test Time
()
Hyperparameter Tuning, Batch Normalization and Programming Frameworks-Multi-class Classification
Clarifications about Upcoming Softmax Video
Softmax Regression
()
Training a Softmax Classifier
()
Hyperparameter Tuning, Batch Normalization and Programming Frameworks-Introduction to Programming Frameworks
Deep Learning Frameworks
()
TensorFlow
()
(Optional) Learn about Gradient Tape and More
Hyperparameter Tuning, Batch Normalization and Programming Frameworks-Lecture Notes (Optional)
Lectures in PDF
Hyperparameter Tuning, Batch Normalization and Programming Frameworks-References & Acknowledgments
References
Acknowledgments