Dive into Deep Learning (D2L.ai)

Book website | STAT 157 Course at UC Berkeley, Spring 2019 | Latest version: v0.15.1

The best way to understand deep learning is learning by doing.

This open-source book represents our attempt to make deep learning approachable, teaching you the concepts, the context, and the code. The entire book is drafted in Jupyter notebooks, seamlessly integrating exposition figures, math, and interactive examples with self-contained code.

Our goal is to offer a resource that could

1. be freely available for everyone;
2. offer sufficient technical depth to provide a starting point on the path to actually becoming an applied machine learning scientist;
3. include runnable code, showing readers how to solve problems in practice;
4. allow for rapid updates, both by us and also by the community at large;
5. be complemented by a forum for interactive discussion of technical details and to answer questions.

Universities Using D2L

Cool Papers Using D2L

1. Universal Average-Case Optimality of Polyak Momentum. D. Scieur, F. Pedregosan. International Conference on Machine Learning, 2020

2. 2D Digital Image Correlation and Region-Based Convolutional Neural Network in Monitoring and Evaluation of Surface Cracks in Concrete Structural Elements. M. Słoński, M. Tekieli. Materials, 2020

3. GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing. J. Guo, H. He, T. He, L. Lausen, M. Li, H. Lin, X. Shi, C. Wang, J. Xie, S. Zha, A. Zhang, H. Zhang, Z. Zhang, Z. Zhang, S. Zheng, and Y. Zhu. Journal of Machine Learning Research, 2020

4. Detecting Human Driver Inattentive and Aggressive Driving Behavior Using Deep Learning: Recent Advances, Requirements and Open Challenges. M. Alkinani, W. Khan, Q. Arshad. IEEE Access, 2020

5. Diagnosing Parkinson by Using Deep Autoencoder Neural Network. U. Kose, O. Deperlioglu, J. Alzubi, B. Patrut. Deep Learning for Medical Decision Support Systems, 2020

more

1. Descending through a Crowded Valley--Benchmarking Deep Learning Optimizers. R. Schmidt, F. Schneider, P. Hennig.

2. Deep Learning Architectures for Medical Diagnosis. U. Kose, O. Deperlioglu, J. Alzubi, B. Patrut. Deep Learning for Medical Decision Support Systems, 2020

3. ControlVAE: Tuning, Analytical Properties, and Performance Analysis. H. Shao, Z. Xiao, S. Yao, D. Sun, A. Zhang, S. Liu, T. Abdelzaher.

4. Potential, challenges and future directions for deep learning in prognostics and health management applications. O. Fink, Q. Wang, M. Svensén, P. Dersin, W-J. Lee, M. Ducoffe. Engineering Applications of Artificial Intelligence, 2020

5. Learning User Representations with Hypercuboids for Recommender Systems. S. Zhang, H. Liu, A. Zhang, Y. Hu, C. Zhang, Y. Li, T. Zhu, S. He, W. Ou. ACM International Conference on Web Search and Data Mining, 2021

If you find this book useful, please star (★) this repository or cite this book using the following bibtex entry:

@book{zhang2020dive,
    title={Dive into Deep Learning},
    author={Aston Zhang and Zachary C. Lipton and Mu Li and Alexander J. Smola},
    note={\url{https://d2l.ai}},
    year={2020}
}

Endorsements

"In less than a decade, the AI revolution has swept from research labs to broad industries to every corner of our daily life. Dive into Deep Learning is an excellent text on deep learning and deserves attention from anyone who wants to learn why deep learning has ignited the AI revolution: the most powerful technology force of our time."

— Jensen Huang, Founder and CEO, NVIDIA

"This is a timely, fascinating book, providing with not only a comprehensive overview of deep learning principles but also detailed algorithms with hands-on programming code, and moreover, a state-of-the-art introduction to deep learning in computer vision and natural language processing. Dive into this book if you want to dive into deep learning!"

— Jiawei Han, Michael Aiken Chair Professor, University of Illinois at Urbana-Champaign

"This is a highly welcome addition to the machine learning literature, with a focus on hands-on experience implemented via the integration of Jupyter notebooks. Students of deep learning should find this invaluable to become proficient in this field."

— Bernhard Schölkopf, Director, Max Planck Institute for Intelligent Systems

Contributing (learn how)

This open source book has benefited from pedagogical suggestions, typo corrections, and other improvements from community contributors. Your help is valuable for making the book better for everyone.

Dear D2L contributors, please email your GitHub ID and name to d2lbook.en AT gmail DOT com so your name will appear on the acknowledgments. Thanks.

License Summary

This open source book is made available under the Creative Commons Attribution-ShareAlike 4.0 International License. See LICENSE file.

The sample and reference code within this open source book is made available under a modified MIT license. See the LICENSE-SAMPLECODE file.

Chinese version | Discuss and report issues | Code of conduct | Other Information