Instytut Podstawowych Problemów Techniki
Polskiej Akademii Nauk

Partnerzy

T. Rogula


Prace konferencyjne
1.  Proniewska K., Kolecki R., Grochowska A., Popiela T., Rogula T., Malinowski K., Dołęga-Dołęgowski D., Kenig J., Richter P., Dąbrowa J., Mortada M.J., van Dam P., Pręgowska A., The Application of the Preoperative Image-Guided 3D Visualization Supported by Machine Learning to the Prediction of Organs Reconstruction During Pancreaticoduodenectomy via a Head-Mounted Displays, International Conference on eXtended Reality, XR SALENTO 2023, 2023-09-06/09-09, Lecce (IT), DOI: 10.1007/978-3-031-43401-3_21, No.14218, pp.321-344, 2023

Streszczenie:
Early pancreatic cancer diagnosis and therapy drastically increase the chances of survival. Tumor visualization using CT scan images is an important part of these processes. In this paper, we apply Mixed Reality (MR) and Artificial Intelligence, in particular, Machine Learning (ML) to prepare image-guided 3D models of pancreatic cancer in a population of oncology patients. Object detection was based on the convolution neural network, i.e. the You Only Look Once (YOLO) version 7 algorithm, while the semantic segmentation has been done with the 3D-UNET algorithm. Next, the 3D holographic visualization of this model as an interactive, MR object was performed using the Microsoft HoloLens2. The results indicated that the proposed MR and ML-based approach can precisely segment the pancreas along with suspected lesions, thus providing a reliable tool for diagnostics and surgical planning, especially when considering organ reconstruction during pancreaticoduodenectomy.

Słowa kluczowe:
Extended Reality, Mixed Reality, Augmented Reality, Head-Mounted Displays, Artificial Intelligence, Image-guided surgery

Afiliacje autorów:
Proniewska K. - Jagiellonian University (PL)
Kolecki R. - inna afiliacja
Grochowska A. - inna afiliacja
Popiela T. - inna afiliacja
Rogula T. - inna afiliacja
Malinowski K. - Politechnika Warszawska (PL)
Dołęga-Dołęgowski D. - Jagiellonian University (PL)
Kenig J. - inna afiliacja
Richter P. - Jagiellonian University (PL)
Dąbrowa J. - inna afiliacja
Mortada M.J. - inna afiliacja
van Dam P. - PEACS BV, Nieuwerbrug (NL)
Pręgowska A. - IPPT PAN

Kategoria A Plus

IPPT PAN

logo ippt            ul. Pawińskiego 5B, 02-106 Warszawa
  +48 22 826 12 81 (centrala)
  +48 22 826 98 15
 

Znajdź nas

mapka
© Instytut Podstawowych Problemów Techniki Polskiej Akademii Nauk 2024