Natural language processing (NLP) research group at the Department of Informatics, University of Oslo. Creators of the GPT-BERT architecture and Norwegian language models (NorBERT).
The Language Technology Group (LTG) is a research group within the Department of Informatics (IFI) at the Faculty of Mathematics and Natural Sciences, University of Oslo, Norway. The group works on natural language processing (NLP) — a subfield of artificial intelligence — including large language models with a particular focus on Norwegian. LTG develops models such as NorBERT and coordinates the Nordic Language Processing Laboratory (NLPL). Its researchers Lucas Georges Gabriel Charpentier and David Samuel authored "GPT or BERT: why not both?" (arXiv:2410.24159), which introduced the hybrid GPT-BERT architecture — the winning approach of the BabyLM Challenge 2024. The group is led by Lilja Øvrelid.
Classification
