What are the neurons, why are there layers, and what is the math fundamental it?
Support fund long run assignments: https://www.patreon.com/3blue1brown
Published/interactive type of this collection: https://www.3blue1brown.com/topics/neural-networks
Additional funding for this project delivered by Amplify Partners
Typo correction: At 14 minutes 45 seconds, the past index on the bias vector is n, when it really is supposed to in fact be a k. Many thanks for the sharp eyes that caught that!
For those people who want to discover more, I highly endorse the guide by Michael Nielsen introducing neural networks and deep finding out: https://goo.gl/Zmczdy
There are two neat factors about this reserve. 1st, it can be accessible for absolutely free, so look at joining me in earning a donation Nielsen’s way if you get a little something out of it. And next, it’s centered all around walking via some code and details which you can obtain yourself, and which addresses the identical instance that I introduce in this online video. Yay for energetic mastering!
https://github.com/mnielsen/neural-networks-and-deep-learning
I also extremely advocate Chris Olah’s blog: http://colah.github.io/
For a lot more films, Welch Labs also has some terrific collection on machine learning:
For individuals of you on the lookout to go *even* deeper, test out the textual content “Deep Understanding” by Goodfellow, Bengio, and Courville.
Also, the publication Distill is just totally attractive: https://distill.pub/
Lion image by Kevin Pluck
—————–
Timeline:
:00 – Introduction example
1:07 – Collection preview
2:42 – What are neurons?
3:35 – Introducing levels
5:31 – Why levels?
8:38 – Edge detection example
11:34 – Counting weights and biases
12:30 – How discovering relates
13:26 – Notation and linear algebra
15:17 – Recap
16:27 – Some last phrases
17:03 – ReLU vs Sigmoid
——————
Animations largely produced applying manim, a scrappy open supply python library. https://github.com/3b1b/manim
If you want to check it out, I sense compelled to warn you that it is not the most well-documented instrument, and has many other quirks you may well assume in a library an individual wrote with only their individual use in brain.
Music by Vincent Rubinetti.
Down load the tunes on Bandcamp:
https://vincerubinetti.bandcamp.com/album/the-songs-of-3blue1brown
Stream the tunes on Spotify:
https://open up.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u
If you want to lead translated subtitles or to support critique those that have already been built by many others and will need acceptance, you can click on the equipment icon in the video and go to subtitles/cc, then “increase subtitles/cc”. I seriously recognize individuals who do this, as it aids make the classes accessible to far more individuals.
——————
3blue1brown is a channel about animating math, in all senses of the word animate. And you know the drill with YouTube, if you want to keep posted on new films, subscribe, and click the bell to obtain notifications (if you might be into that).
If you are new to this channel and want to see extra, a fantastic position to commence is this playlist: http://3b1b.co/proposed
Numerous social media stuffs:
Web page: https://www.3blue1brown.com
Twitter: https://twitter.com/3Blue1Brown
Patreon: https://patreon.com/3blue1brown
Facebook: https://www.facebook.com/3blue1brown
Reddit: https://www.reddit.com/r/3Blue1Brown
