of Deep Learning

**Synopsis: ** This book provides a complete and concise overview of the mathematical engineering of deep learning. In addition to overviewing deep learning foundations, the treatment includes convolutional neural networks, recurrent neural networks, transformers, generative adversarial networks, diffusion models, reinforcement learning, graphical neural networks, and multiple tricks of the trade.
The focus is on the basic mathematical description of deep learning models, algorithms and methods. The presentation is mostly agnostic to computer code, neuroscientific relationships, historical perspectives, and theoretical research. The benefit of such an approach is that a mathematically equipped reader can quickly grasp the essence of modern deep learning algorithms, models, and techniques without having to look at computer code, neuroscience, or the historical progression.

Deep learning is easily described through the language of mathematics at a level accessible to many professionals. Readers from the fields of engineering, signal processing, statistics, physics, pure mathematics, econometrics, operations research, quantitative management, applied machine learning, or applied deep learning will quickly gain insights into the key mathematical engineering components of the field.

**Draft book chapters:**

**Preface and Table of Contents**- Chapter 1:
**Introduction** - Chapter 2:
**Principles of Machine Learning** - Chapter 3:
**Simple Neural Networks** - Chapter 4:
**Optimization Algorithms** - Chapter 5:
**Feed-Forward Deep Networks** - Chapter 6:
**Convolutional Neural Networks** - Chapter 7:
**Sequence Models**(New: July 7, 2023) - Chapter 8:
**Specialized Architectures and Paradigms**(Expect draft on November 30, 2023) -
**Epilogue**(Expect draft on November 30, 2023) - Appendix A:
**Some Multivariable Calculus** - Appendix B:
**Cross Entropy and Other Expectations with Logarithms** **Back matter**

**Narrated videos:**

**Related courses and workshops:**

**See also:**

- Source code used to create figures and tables of the book. This includes code in Julia, Python, R, and TikZ.