Department of Engineering and Communication

Workshop on Large Language Models and Generative AI

Workshop LLM_Erzeugtes KI-Bild

Wednesday 6 September 2023

On Wednesday, August 23, Dr. Alexander Hagg, Postdoctoral Fellow in the Department, conducted an interdisciplinary workshop on "Large Language Models & Generative Artificial Intelligence." He was joined by guest speakers Dr. Adam Gaier of Autodesk Research and Dr. Karl Kirschner of the Department of Computer Science.

A day dedicated to AI

Alexander Hagg im Workshop über Large Language Models und Generative KI
At the beginning of the workshop, Alexander Hagg listed key data about AI models. Photo: H-BRS

The workshop covered a wide range of topics, from an introduction to the history of artificial intelligence to practical application examples.

Dr. Gaier provided insights into the use of generative AI systems in computer-aided design (CAD) and architecture. Dr. Kirschner, in turn, focused on machine learning, but from the perspective of a natural scientist who is relatively new to this area of research.

Dr. Alexander Hagg, organizer of the workshop, shed light on the role of Large Language Models (LLMs) specifically in the field of teaching, emphasizing that they are much more than mere text generators. They can simulate abstracting thinking such as generalization, analogical reasoning, and creativity. "LLMs, however, are still machines operated by humans. Without input, there is no output. We are responsible for what LLMs do in our society," Hagg said. It's also important to understand the limitations of the models, he said. For example, an LLM can't really do math, which surprised many participants.

Alexander Hagg im Workshop über Large Language Models und Generative KI
Alexander Hagg explains how autoencoders work. Photo: H-BRS

Practice meets theory

A particular highlight of the workshop was the practical exercise phase under the motto "Self is man: Experiments with Large Language Models". Here, participants had the opportunity to get hands-on and learn how to effectively use Large Language Models.

Following the practical phase, a discussion round took place in which it was discussed in which areas LLMs can be usefully employed and what challenges and limitations are associated with them.

 

Workshop LLM_Erzeugtes KI-Bild
A small robot reads a book. The image was generated for the presentation using AI. Photo: Alexander Hagg, created with AI

What's next?

The workshop ended with a contribution on the future application of AI systems. Questions such as "Where can I use AI systems?" and "How do I even determine that?" were also discussed.

The event generated a lot of interest and positive feedback. It provided a valuable opportunity for members to explore both the theory and practice of AI and to see the relevance of these technologies to various disciplines.

Contact

Alexander Hagg (DE)

Alexander Hagg

PhD student, Artificial intelligence (surrogate modelling), Artificial Intelligence (Optimisation)

Research fields

Location

Sankt Augustin

Address

Grantham-Allee 20

53757 Sankt Augustin