Nash School

Nash School

Share

nashschool.com

07/06/2024

What is the vanishing gradient problem in neural networks? It means the loss is not impacted by changing weights closer to input layer. If the weights do not change, the neural network stops learning and becomes bad at modelling the data.

In the figure, it is clear how the loss changes a lot when w1 is changed, and how loss remains nearly constant with w3. This is an illustration of vanishing gradients (as we move from output layer to the input layer).

πŸ§‘β€πŸŽ“πŸ“‘πŸ’»

✨ Nash school London ✨

🌟Become a certified data scientist πŸ’»πŸ’Ό

12-week courses πŸ“š

Personalised curriculum πŸ“‘πŸ“™

Mentorship sessionsπŸ‘©πŸ½β€πŸ’»

International certification πŸ§‘β€πŸŽ“

Coaches with masters and Ph.D.s ✨

Join us today! @ https://nashschool.com

Want your school to be the top-listed School/college in London?

Click here to claim your Sponsored Listing.

Location

Address


London