Intro Deep Learning

Part I - The Optimizer

• QUIZ questions

• Presentation - When to Apply DeepLearning?

• Play around with In the TensorFlow Playground

  • Which Data-Set can the Linear Activation Learn ?
  • Can we mimic vanishing Gradient Problem ?

• Break

• Exercises

---

Video's / Links discussed in Part I

• OpenWorm
• An AI Pioneer Explains the Evolution of Neural Networks - Nice Interview!
• But what is a neural network? | Chapter 1, Deep learning - Check all 4 Parts
• How Computationally Complex Is a Single Neuron?
• Neural Networks Pt. 1: Inside the Black Box

Part II - The Feature Planes (CNN)

• Nuts and Bolts of Applying Deep Learning (Andrew Ng)
• CNN Explainer | Online CNN visualisation in your Browser
• Common CNN Architectures
• CNN Weakness - Capsule Networks Are Shaking up AI
• How to Trick CNN Networks

Part III - History

• Common architectures in convolutional neural networks.
• A Brief History Of Neural Network Architectures
• https://medium.com/@shahariarrabby/lenet-5-alexnet-vgg-16-from-deeplearning-ai-2a4fa5f26344
• History of Convolutional Blocks in simple Code

Part IV - Hugging Face

https://huggingface.co/

• Spaces (Apps)

  • https://huggingface.co/spaces/akhaliq/AnimeGANv2
  • Play Around with https://huggingface.co/spaces - pick 1 or 2 you like

• Transformers

  • Find GPT-2 and let GPT-2 complete an sentence for you
  • Play around and pick 1 or 2 models you like

• Transformers

  • https://huggingface.co/docs/transformers/index
  • Install & Try run a model local on your PC / local on the cloud

• AutoNLP

  • Find the documentation, what is it?

• Plans

  • https://huggingface.co/pricing
  • Create a free account
  • Play around