Loading...

Deep Learning Dictionary - Lightweight Crash Course

Deep Learning Course 1 of 7 - Level: Beginner

Vanishing & Exploding Gradients in Network Training - Deep Learning Dictionary

video

lock
Lesson thumbnail for Vanishing & Exploding Gradients in Network Training - Deep Learning Dictionary

text

lock

Vanishing and Exploding Gradients - Deep Learning Dictionary

The vanishing gradient problem is a problem that occurs during neural network training regarding unstable gradients and is a result of the backpropagation algorithm used to calculate the gradients.

During training, the gradient descent optimizer calculates the gradient of the loss with respect to each of the weights and biases in the network. This calculation is performed via backpropagation.

quiz

lock

resources

lock
What are vanishing and exploding gradients, and how can they occur during artificial neural network training? πŸ‘‰ To gain early access to the full Deep Learning Dictionary course, register at: πŸ”— https://deeplizard.com/course/ddcpailzrd πŸ‘‰ For more in depth lessons, check out the Deep Learning Fundamentals course: πŸ”— https://deeplizard.com/course/dlcpailzrd πŸ•’πŸ¦Ž VIDEO SECTIONS πŸ¦ŽπŸ•’ 00:00 Welcome to DEEPLIZARD - Go to deeplizard.com for learning resources 00:10 Vanishing & Exploding Gradients in Network Training 04:51 Collective Intelligence and the DEEPLIZARD HIVEMIND πŸ’₯🦎 DEEPLIZARD COMMUNITY RESOURCES 🦎πŸ’₯ πŸ‘‹ Hey, we're Chris and Mandy, the creators of deeplizard! πŸ‘€ CHECK OUT OUR VLOG: πŸ”— https://youtube.com/deeplizardvlog πŸ‘‰ Check out the website for more learning material: πŸ”— https://deeplizard.com πŸ’» ENROLL TO GET DOWNLOAD ACCESS TO CODE FILES πŸ”— https://deeplizard.com/resources 🧠 Support collective intelligence, join the deeplizard hivemind: πŸ”— https://deeplizard.com/hivemind 🧠 Use code DEEPLIZARD at checkout to receive 15% off your first Neurohacker order πŸ‘‰ Use your receipt from Neurohacker to get a discount on deeplizard courses πŸ”— https://neurohacker.com/shop?rfsn=6488344.d171c6 ❀️🦎 Special thanks to the following polymaths of the deeplizard hivemind: Tammy Mano Prime Ling Li πŸš€ Boost collective intelligence by sharing this video on social media! πŸ‘€ Follow deeplizard: Our vlog: https://youtube.com/deeplizardvlog Facebook: https://facebook.com/deeplizard Instagram: https://instagram.com/deeplizard Twitter: https://twitter.com/deeplizard Patreon: https://patreon.com/deeplizard YouTube: https://youtube.com/deeplizard πŸŽ“ Deep Learning with deeplizard: Deep Learning Dictionary - https://deeplizard.com/course/ddcpailzrd Deep Learning Fundamentals - https://deeplizard.com/course/dlcpailzrd Learn TensorFlow - https://deeplizard.com/course/tfcpailzrd Learn PyTorch - https://deeplizard.com/course/ptcpailzrd Natural Language Processing - https://deeplizard.com/course/txtcpailzrd Reinforcement Learning - https://deeplizard.com/course/rlcpailzrd Generative Adversarial Networks - https://deeplizard.com/course/gacpailzrd πŸŽ“ Other Courses: DL Fundamentals Classic - https://deeplizard.com/learn/video/gZmobeGL0Yg Deep Learning Deployment - https://deeplizard.com/learn/video/SI1hVGvbbZ4 Data Science - https://deeplizard.com/learn/video/d11chG7Z-xk Trading - https://deeplizard.com/learn/video/ZpfCK_uHL9Y πŸ›’ Check out products deeplizard recommends on Amazon: πŸ”— https://amazon.com/shop/deeplizard 🎡 deeplizard uses music by Kevin MacLeod πŸ”— https://youtube.com/channel/UCSZXFhRIx6b0dFX3xS8L1yQ ❀️ Please use the knowledge gained from deeplizard content for good, not evil.

updates

lock
deeplizard logo DEEPLIZARD Message notifications

Update history for this page

Did you know you that deeplizard content is regularly updated and maintained?

  • Updated
  • Maintained

Spot something that needs to be updated? Don't hesitate to let us know. We'll fix it!


All relevant updates for the content on this page are listed below.