CAS Natural Language Processing - AI for Language

If there are free places, modules can be attended individually.

Module 1: NLP Fundamentals

Block module. In this module, linguistics and machine learning concepts are introduced and an overview of the NLP field and common applications is given.

Module 2: Preprocessing and basic analysis

Block module. In this module, participants learn to perform basic preprocessing and analysis of natural language.

Module 3: Neural networks

In this module, participants learn how neural networks work, are trained, tuned, assessed and applied for NLP tasks

Module 3 takes place at the mediterranean coast. Full pension hotel accommodation is included in the CAS fee. 

Module 4: Transformers

Participants study transformers and learn why they have changed the NLP field.

Module 5: Philosophical and ethical aspects of NLP

In this module, participants study and discuss ethical and philosophical aspects related to machines being capable of natural language processing.

Module 6: Frontier and applications

This module consolidates the knowledge obtained from previous modules to focus on prominent NLP topics and applications.

Module 6 takes place in the wonderful historic hotel Regina in the ski resort Mürren (Bernese oberland), only about two train hours from Bern. Full pension hotel accommodations are included in the CAS fee. 

All modules

The duration of all modules corresponds to approximately 20 classroom hours each and module work (expected eff ort is 30 hours), with each complete module qualifying for 2 ECTS points. The expected workload for the CAS Project is 120 hours. Computational resources are offered.

The CAS Natural Language Processing is a university study program leading to a “Certificate of Advanced Studies in Natural Language Processing” awarded by the University of Bern.

The field Natural Language Processing belongs to both computational linguistics as its engineering domain and artificial intelligence as an increasingly important subdomain. The applications based on deep neural networks have reached a
performance level which cannot be ignored by any field that is processing natural languages.

The program is organised into six modules, running over 18 course days from August to January and targets practitioners who aim for an overview of the NLP domain with focus on recent developments (deep learning models) and hands-on learning. The difficulty is at a university master level and assumes own basic machine learning experience, programming skills and a higher education degree.

Objectives

Course competence is developed throughout six modules and a CAS project work. On completion the graduates will (be able to):

• have an overview of the NLP domain and common applications
• be able to perform relevant preprocessing tasks needed for advanced NLP
• be able to understand neural networks and practice them on own NLP applications
• be able to understand transformers and practice transfer learning with transformers for own applications
• know discussions related to philosophical and ethical aspects around NLP and artificial intelligence
• be familiar with active research in the NLP domain.

Information Events

Learn everything you need to know about the CAS in Natural Language Processing. One introduction is mandatory, remote participation is possible. 

Introductionary courses

Prepare yourself for the CAS Modules. We offer the following introductionary courses to refresh your knowledge.

Modules

All Information about Modules 1-6. 

Course materials are accessed via the Ilias learning platform.

Events and other important dates

Information Events

Learn everything you need to know about the CAS in Natural Language Processing. One introduction is mandatory, remote participation is possible. 

Introductionary courses

Prepare yourself for the CAS Modules. We offer the following introductionary courses to refresh your knowledge.

Modules

All Information about Modules 1-6. 

Course materials are accessed via the Ilias Learning Platform upon receiving the course password. 

Events and other important dates

The Certificate of Advanced Studies (CAS) in Natural Language Processing (NLP) is offered by the Mathematical Institute.

Program management

• Prof. Dr. Jan Draisma 
• Prof. Dr. Tobias Hodel
• Prof. Dr. Paolo Favaro
• PD Dr. Sigve Haug (director of studies)
• Prof. Dr. Christiane Tretter (chair)
• Prof. Dr. Thomas Wihler

Lecturers            

• Prof. Dr. Dr. Claus Beisbart 
• PD Dr. Sigve Haug 
• Prof. Dr. T. Hodel
• Dr. Kinga Sipos 
• Dr. Mykhailo Vladymyrov 
• M.Sc. Joel Niklaus,
• M. A. Phillip Ströbel
• et al. 

Target groups

Aimed at students and professionals from the public/private sector that hold a degree from a university or a university of applied sciences (e.g. BSc, MSc, PhD).

SUITABLE AND INTENDED FOR PRACTITIONERS AND RESEARCHERS ► Gain an overview of the Natural Language Processing domain with a focus on recent developments (deep learning models) and hands-on learning.

Standard data sets are provided, but participants are encouraged to bring or acquire their own. lf you have any questions regarding whether this program could work for you, please do not hesitate to contact us.

Registered participants will receive acceptance confirmation by email and will be invited to one of the next information events. Attendance to one information event is mandatory. Participants can cancel their registrations before the deadline without any costs. After the deadline the regulations apply. Individual modules and electives can be attended before the registration. Please contact PD Dr. Sigve Haug for further information.

Registration opens in November and a maximum of 20 registrations can be accepted each year. Registrations are processed in the order of arrival. The CAS can only be offered if there are sufficient registrations by the deadline.

Deadline: 2025-06-30

Per year there are 20 places. Registrations are accepted in the order they arrive. A waiting list is maintained. 

Program fees

Regular CAS program: CHF 9'600.-

Students currently enrolled in an University or University of Applied Sciences: CHF 5'600.-

Employees of University of Bern: CHF 5'600.-

Payment in installments is possible.

lnclusive of all modules, performance assessments, certificates, materials & teaching platforms, coffee breaks, full pension hotels (Module 3 and Module 6) and diploma apero.

Participants must supply their own laptops.

lf there are free places, modules can be attended individually. Prices are CHF 300.- per half day. Individual modules are accredited with certificates which are accumulated for the full CAS NLP.

Register here

"The CAS NLP at the University of Bern provides a deep insight into the secrets of Large Language Models. After the course, I was not only able to better understand how these models work, but also to train such models myself and programme them for my needs. The course is run by highly competent staff from the University of Bern and the small course groups allow for individual support. I can definitely recommend the course."

"It has been a true pleasure to learn from excellent experts in the field of Natural Language Processing. On top of their expertise, they created a very friendly and cooperative atmosphere, which stimulated exchange and creativity.Special acknowledgments go to Mykhailo and Sukanya for their code examples. The NLP_M3_NN_Tutorial by Mykhailo was particularly helpful when implementing the Siamese networks, presented at the end of module 3, during work for the assessment of module 4, as well as for the implementation of some aspects of the sentence transformers code presented in the current report. Besides her excellent lectures on Transformers, Sukanya was very kind and took her time after one of her lectures to helpme understand what I had to do in order to install the TensorFlow package. Without her help, none of the implementations presented in this report would have been possible."

"Special acknowledgments go to Sigve for the excellent course organization. He has understood to join work and leisure, best represented by the weeks in Italy and at Mürren. These weeks represent wonderful experiences, which made the group grow close. In particular, I will never forget the boat trip along the Liguria coast and the sledge ride and the party at the “Bliemli Chäller” at Mürren. These are moments, which make life worth living."