Loading...

Deep Learning Fundamentals - Premium Edition

Deep Learning Course - Level: Beginner

Learning Rates in Artificial Neural Networks Explained

video

lock
Lesson thumbnail for Learning Rates in Artificial Neural Networks Explained

text

lock

Learning Rates in Artificial Neural Networks Explained

In this lesson, we'll be discussing a configurable parameter called the learning rate, and we'll see how it's used when we train a neural network.

When we previously learned about the neural network training process, we briefly introduced the idea of a learning rate. There, we mentioned that the learning rate is a fractional value for which we multiply the gradients by before updating the weights with the resulting product.

quiz

lock

resources

lock
In this lesson, we'll be discussing a hyperparameter called the learning rate and see how it's used when we train a neural network. πŸ•’πŸ¦Ž VIDEO SECTIONS πŸ¦ŽπŸ•’ 00:00 Welcome to DEEPLIZARD - Go to deeplizard.com for learning resources 00:13 How Learning Rate is Used in Neural Network Training 01:47 How Learning Rate Influences Training 04:00 Choosing the Learning Rate Value 06:15 Learning Rate Schedules 06:45 Adaptive Learning Rates 08:00 Collective Intelligence and the DEEPLIZARD HIVEMIND πŸ’₯🦎 DEEPLIZARD COMMUNITY RESOURCES 🦎πŸ’₯ πŸ‘‹ Hey, we're Chris and Mandy, the creators of deeplizard! πŸ‘€ CHECK OUT OUR VLOG: πŸ”— https://youtube.com/deeplizardvlog πŸ‘‰ Check out the website for more learning material: πŸ”— https://deeplizard.com πŸ’» ENROLL TO GET DOWNLOAD ACCESS TO CODE FILES πŸ”— https://deeplizard.com/resources 🧠 Support collective intelligence, join the deeplizard hivemind: πŸ”— https://deeplizard.com/hivemind 🧠 Use code DEEPLIZARD at checkout to receive 15% off your first Neurohacker order πŸ‘‰ Use your receipt from Neurohacker to get a discount on deeplizard courses πŸ”— https://neurohacker.com/shop?rfsn=6488344.d171c6 ❀️🦎 Special thanks to the following polymaths of the deeplizard hivemind: Tammy Mano Prime Ling Li πŸš€ Boost collective intelligence by sharing this video on social media! πŸ‘€ Follow deeplizard: Our vlog: https://youtube.com/deeplizardvlog Facebook: https://facebook.com/deeplizard Instagram: https://instagram.com/deeplizard Twitter: https://twitter.com/deeplizard Patreon: https://patreon.com/deeplizard YouTube: https://youtube.com/deeplizard πŸŽ“ Deep Learning with deeplizard: Deep Learning Dictionary - https://deeplizard.com/course/ddcpailzrd Deep Learning Fundamentals - https://deeplizard.com/course/dlcpailzrd Learn TensorFlow - https://deeplizard.com/course/tfcpailzrd Learn PyTorch - https://deeplizard.com/course/ptcpailzrd Natural Language Processing - https://deeplizard.com/course/txtcpailzrd Reinforcement Learning - https://deeplizard.com/course/rlcpailzrd Generative Adversarial Networks - https://deeplizard.com/course/gacpailzrd πŸŽ“ Other Courses: DL Fundamentals Classic - https://deeplizard.com/learn/video/gZmobeGL0Yg Deep Learning Deployment - https://deeplizard.com/learn/video/SI1hVGvbbZ4 Data Science - https://deeplizard.com/learn/video/d11chG7Z-xk Trading - https://deeplizard.com/learn/video/ZpfCK_uHL9Y πŸ›’ Check out products deeplizard recommends on Amazon: πŸ”— https://amazon.com/shop/deeplizard 🎡 deeplizard uses music by Kevin MacLeod πŸ”— https://youtube.com/channel/UCSZXFhRIx6b0dFX3xS8L1yQ ❀️ Please use the knowledge gained from deeplizard content for good, not evil.

updates

lock
deeplizard logo DEEPLIZARD Message notifications

Update history for this page

Did you know you that deeplizard content is regularly updated and maintained?

  • Updated
  • Maintained

Spot something that needs to be updated? Don't hesitate to let us know. We'll fix it!


All relevant updates for the content on this page are listed below.