Medical Augmented Reality
Medical Augmented Reality (IN2293)
| Lecturer (assistant) | |
|---|---|
| Number | 0000000873 |
| Type | lecture with integrated exercises |
| Duration | 4 SWS |
| Term | Winter semester 2025/26 |
| Language of instruction | English |
| Position within curricula | See TUMonline |
| Dates | See TUMonline |
Admission information
Description
Lecture:
+ Basics of intra-operative imaging and navigation.
+ Camera calibration using multi-view approaches.
+ Projective geometry basics including transformations and reconstruction.
+ Introduction to XR/AR display technologies
+ 3D user interfaces and interaction methods
+ Basics of user-centered design with a focus on XR/AR
+ Different sensor technologies including: RG, infrared cameras, optical trackers, and depth-cameras.
+ Advanced perceptual visualization methods for in-situ augmentation
+ Review of multimodal registration, visualization and user interfaces.
+ Real-examples using head mounted display (HMDs), Camera augmented mobile C-arm (CamC) and, intraoperative gamma probes coupled with AR capabilities, AR magic mirror for anatomy education.
+ Includes visits to the Navigated Augmented Reality Visualization Systems Laboratory, Chirurgische Klinik und Poliklinik Innenstadt; and IFL: Interdisziplinäres Forschungslabor, Klinikum rechts der Isar.
Exercises (every two weeks):
+ Using Unity3D, C#, Python or C++
+ Implementation of lecture course topics with students in small groups.
+ Basics of intra-operative imaging and navigation.
+ Camera calibration using multi-view approaches.
+ Projective geometry basics including transformations and reconstruction.
+ Introduction to XR/AR display technologies
+ 3D user interfaces and interaction methods
+ Basics of user-centered design with a focus on XR/AR
+ Different sensor technologies including: RG, infrared cameras, optical trackers, and depth-cameras.
+ Advanced perceptual visualization methods for in-situ augmentation
+ Review of multimodal registration, visualization and user interfaces.
+ Real-examples using head mounted display (HMDs), Camera augmented mobile C-arm (CamC) and, intraoperative gamma probes coupled with AR capabilities, AR magic mirror for anatomy education.
+ Includes visits to the Navigated Augmented Reality Visualization Systems Laboratory, Chirurgische Klinik und Poliklinik Innenstadt; and IFL: Interdisziplinäres Forschungslabor, Klinikum rechts der Isar.
Exercises (every two weeks):
+ Using Unity3D, C#, Python or C++
+ Implementation of lecture course topics with students in small groups.
Prerequisites
Students should have robust programming skills and should be interested in Augmented- and Virtual Reality technologies in the medical context. Previous knowledge in Unity3D or UnrealEngine is usually of benefit, but not required.
MA0901 Linear Algebra for Informatics
IN0038 Real-time Computer Graphics
MA0901 Linear Algebra for Informatics
IN0038 Real-time Computer Graphics
Teaching and learning methods
Lectures and Exercises