Loading...

Deep Learning Dictionary - Lightweight Crash Course

Deep Learning Course 1 of 7 - Level: Beginner

Neural Network Learning Rate Schedules - Deep Learning Dictionary

video

lock
Lesson thumbnail for Neural Network Learning Rate Schedules - Deep Learning Dictionary

text

lock

Learning Rate Schedules - Deep Learning Dictionary

In neural network training, the learning rate is a fractional value, typically set between 0.01 and 0.0001, for which the gradients are multiplied by before updating the weights with this resulting product. This value is a hyperparameter that we set prior to training.

When we first introduced the concept of a learning rate, we assumed that we set the learning rate and leave it at this static rate for the duration of training.

quiz

lock

resources

lock
What is a learning rate schedule, and how does it affect the artificial neural network training process? πŸ‘‰ To gain early access to the full Deep Learning Dictionary course, register at: πŸ”— https://deeplizard.com/course/ddcpailzrd πŸ‘‰ For more in depth lessons, check out the Deep Learning Fundamentals course: πŸ”— https://deeplizard.com/course/dlcpailzrd πŸ•’πŸ¦Ž VIDEO SECTIONS πŸ¦ŽπŸ•’ 00:00 Welcome to DEEPLIZARD - Go to deeplizard.com for learning resources 00:10 Neural Network Learning Rate Schedules 01:07 Collective Intelligence and the DEEPLIZARD HIVEMIND πŸ’₯🦎 DEEPLIZARD COMMUNITY RESOURCES 🦎πŸ’₯ πŸ‘‹ Hey, we're Chris and Mandy, the creators of deeplizard! πŸ‘€ CHECK OUT OUR VLOG: πŸ”— https://youtube.com/deeplizardvlog πŸ‘‰ Check out the website for more learning material: πŸ”— https://deeplizard.com πŸ’» ENROLL TO GET DOWNLOAD ACCESS TO CODE FILES πŸ”— https://deeplizard.com/resources 🧠 Support collective intelligence, join the deeplizard hivemind: πŸ”— https://deeplizard.com/hivemind 🧠 Use code DEEPLIZARD at checkout to receive 15% off your first Neurohacker order πŸ‘‰ Use your receipt from Neurohacker to get a discount on deeplizard courses πŸ”— https://neurohacker.com/shop?rfsn=6488344.d171c6 ❀️🦎 Special thanks to the following polymaths of the deeplizard hivemind: Tammy Mano Prime Ling Li πŸš€ Boost collective intelligence by sharing this video on social media! πŸ‘€ Follow deeplizard: Our vlog: https://youtube.com/deeplizardvlog Facebook: https://facebook.com/deeplizard Instagram: https://instagram.com/deeplizard Twitter: https://twitter.com/deeplizard Patreon: https://patreon.com/deeplizard YouTube: https://youtube.com/deeplizard πŸŽ“ Deep Learning with deeplizard: Deep Learning Dictionary - https://deeplizard.com/course/ddcpailzrd Deep Learning Fundamentals - https://deeplizard.com/course/dlcpailzrd Learn TensorFlow - https://deeplizard.com/course/tfcpailzrd Learn PyTorch - https://deeplizard.com/course/ptcpailzrd Natural Language Processing - https://deeplizard.com/course/txtcpailzrd Reinforcement Learning - https://deeplizard.com/course/rlcpailzrd Generative Adversarial Networks - https://deeplizard.com/course/gacpailzrd πŸŽ“ Other Courses: DL Fundamentals Classic - https://deeplizard.com/learn/video/gZmobeGL0Yg Deep Learning Deployment - https://deeplizard.com/learn/video/SI1hVGvbbZ4 Data Science - https://deeplizard.com/learn/video/d11chG7Z-xk Trading - https://deeplizard.com/learn/video/ZpfCK_uHL9Y πŸ›’ Check out products deeplizard recommends on Amazon: πŸ”— https://amazon.com/shop/deeplizard 🎡 deeplizard uses music by Kevin MacLeod πŸ”— https://youtube.com/channel/UCSZXFhRIx6b0dFX3xS8L1yQ ❀️ Please use the knowledge gained from deeplizard content for good, not evil.

updates

lock
deeplizard logo DEEPLIZARD Message notifications

Update history for this page

Did you know you that deeplizard content is regularly updated and maintained?

  • Updated
  • Maintained

Spot something that needs to be updated? Don't hesitate to let us know. We'll fix it!


All relevant updates for the content on this page are listed below.