Medical and AI Security

The increasing use of artificial intelligence in safety-critical application areas creates new challenges for IT security. In particular, in medical technology and medical decision-making processes, attacks on AI systems can have significant implications for diagnosis, treatment, and patient safety.

The Medical and AI Security research focus takes a holistic view of the security of AI applications throughout the entire AI lifecycle:  from data collection and modelling to training and deployment in real-world systems. The aim is to systematically analyse threats and attacks on AI-based applications, evaluate the robustness of neural networks, and identify security risks associated with the integration of AI into existing processes at an early stage. This includes attacks that deliberately manipulate classification decisions, for example in tumour detection, as well as attacks targeting data, models, and the underlying infrastructure.