Deep Learning

Deep learning is concerned with learning increasingly abstract, hierarchical representations of data so that the representations still contain relevant information from the original input. Deep learning models constitute the state-of-the-art for virtually all tasks involving high-dimensional, complex data, like images, speech, and video data, as it was shown that they tend to scale very well with more data.

Training a German LLM from Scratch

This article is not finished and will be updated. The research group I work with has access to a small GPU cluster, which occasionally sits idle. To avoid wasting valuable compute resources …

Convolutional Filter Visualization

Deep Neural Networks are black-boxes: they map some input to some output, and we can make them do this surprisingly well. However, we usually have no idea how this mapping works. …