Exploring how neural networks learn by programming one from scratch in C#, and then attempting to teach it to recognize various doodles and images.
If you’d like to see if the neural network can recognize your doodles or digits, you can download the demo here (windows/linux):
Source code:
The project is currently only available to supports on Patreon over here: (but will accessible to everyone Aug 26)
The data is from:
Digits
Fashion
Doodles
Cifar10
Chapters
0:00 Introduction
2:39 The decision boundary
3:49 Weights
5:42 Biases
6:45 Hidden layers
7:45 Programming the network
9:57 Activation functions
12:42 Cost
15:07 Gradient descent example
18:22 The cost landscape
19:55 Programming gradient descent
21:10 It’s…