A deep learning library mockup implemented from scratch in python, with numpy being the only library used. The code implements the forward pass and backward error propagation methods for:
2 Types of Layers:
- Dense Layer
- Dropout Layer
3 Activation Functions:
- Linear
- ReLU
- Softmax
4 Loss Functions:
- Categorical Crossentropy
- Binary Crossentropy
- Mean Squared
- Mean Absolute
4 Optimizers:
- Stochastic Gradient Descent
- Adaptive Gradient Descent
- Root Mean Squared Propagation
- Adam