Abstract: Over the past years deep learning has seen a major increase in popularity. This is because recent developments in deep neural networks – both related to hardware and software – allow us to solve classification problems we were never able to solve before. At the core of deep neural networks lies a challenging optimization problem. In this presentation you will be introduced to the basic concepts in deep neural networks, the underlying optimization problem and current approaches to solve the optimization.