Article

Efficient Parallelization Layouts for Large-Scale Distributed Model Training

Efficiently training large language models requires parallelizing across hundreds of hardware accelerators and invoking various compute …

Johannes Hagemann, Samuel Weinbach, Konstantin Dobler, Maximilian Schall, Gerard De Melo

NextLevelBERT: Masked Language Modeling with Higher-Level Representations for Long Documents

While (large) language models have significantly improved over the last years, they still struggle to sensibly process long sequences …

Tamara Czinczoll, Christoph Hönes, Maximilian Schall, Gerard De Melo

GorillaVision- Open-Set Re-Identification of Wild Gorillas

This paper presents GorillaVision, an open-set re-identification system for gorillas in the wild. Open-set re-identification is crucial …

Lukas Laskowski, Rohan Sawahn, Maximilian Schall, Dante Wasmuht, Magdalena Bermejo, Gerard De Melo