Training a German LLM from Scratch
This article is not finished and will be updated. The research group I work with has access to a small GPU cluster, which occasionally sits idle. To avoid wasting valuable compute resources …
Deep learning is concerned with learning increasingly abstract, hierarchical representations of data so that the representations still contain relevant information from the original input. Deep learning models constitute the state-of-the-art for virtually all tasks involving high-dimensional, complex data, like images, speech, and video data, as it was shown that they tend to scale very well with more data.
This article is not finished and will be updated. The research group I work with has access to a small GPU cluster, which occasionally sits idle. To avoid wasting valuable compute resources …
ISPRS Journal of Photogrammetry and Remote Sensing, 2024
ESS Transformers Workshop 2022
Deep Neural Networks are black-boxes: they map some input to some output, and we can make them do this surprisingly well. However, we usually have no idea how this mapping works. …