Automatic Control

Faculty of Engineering, LTH

Denna sida på svenska This page in English

Kirurgens Perspektiv

Today's surgical reports consists of a written textual presentation which only the surgeon and the corresponding core-team can understand. One goal is to improve tomorrow's surgical reports by replacing it with a film with 3D-images in high resolution. In this way, the report will be more complete and understandable for a larger audience. in addition, tehy can serve as a learning plattform useful for e.g. students in medicine, and practicing surgeons preparing for a similar operation. Robotics is needed when collecting the film material and 3D-images, in order to track the precise perspective of the surgeon. Our vision is to provide the hospitals with modern surgical reports, which also facilitates for improved learning in surgical operations and healthcare. 




  • UDI-step1: 2016-09 - 2017-04 
  • UDI-step2: 2017-11 - 2019-11


  • Vinnova Utmaningsdriven Innovation (UDI)

Researchers and Partners: 

  • Skånes universitetssjukhus Lund: Kiet Tran
  • Lund University: Charlotta Johnsson, Anders Robertsson, Martin Karlsson
  • Linköping University: Jonas Unger, Per Larsson
  • Business Region Skåne: Christer Mårtensson 
  • Cognibotics: Maj Stenmarck, Klas Nilsson
  • Screen9: Robert
  • IBM: 
  • Gubbemed: 



The live surgical field, as the surgeon visually perceives it, contains invaluable image information needed for surgical training, clinical consultations and support the development of surgical robots. How ever, access to the surgeon's view of the reality is highly restricted because there are currently no technical solutions to collect, reproduce, and share this 3-D image information. At the present, only the surgeon can see the organs and pathologies that need surgical attention.

The goal of this project is to develop technical solutions to collect image data during open heart surgery, and to reproduce 3-D heart models that can be used for education, clinical consultations, and in the future advance the development of autonomous robotic systems. The overall goal is to achieve increased safety and quality in surgical care.

Components that will be developed:
1. A camera system for collection of 3-D video images.
2. A platform for interactive visualisation of the surgical field.
3. A database that within 3 years will collect data from 5000-10000 surgical cases, for use in machine learning algorithms, augmented reality, and, ultimately robotic surgery.