IPCAI 2021

The conference format of IPCAI 2021 will consist of pre-recorded presentation videos available to the participants, so the videos can be watched in advance before the conference. During the event, at the beginning of each session all presenters will give short pitches, followed by a collective Q&A of all the papers in the session. During the breaks there will be short discussion opportunities with individual presenters, as in a poster session.

Archived links of the conference:

Link to all videos

Link to editorial of conference proceedings

Link to IJCARS - IPCAI 2021 Special Issue: 12th Conference on Information Processing for Computer-assisted Interventions - Part 1

Link to IJCARS - IPCAI 2021 Special Issue: 12th Conference on Information Processing for Computer-assisted Interventions - Part 2

June 22nd (CEST)

June 23rd (CEST)

June 22nd

15:00 Welcome

15:15 Session S1: Machine Learning in Surgical Data Science
Session Chair: Anirban Mukhopadhyay, PhD (DE)

Simulation-to-Real domain adaptation with teacher-student learning for endoscopic instrument segmentation
Manish Sahu^1*, Anirban Mukhopadhyay², Stefan Zachow^1
1Zuse Institute Berlin (DE); ²Technical University of Darmstadt (DE).   [#04]
Video | Paper

Multi-Task Temporal Convolutional Networks for Joint Recognition of Surgical Phases and Steps in Gastric Bypass Procedures
Sanat Ramesh^1,2*, Diego Dall'Alba¹, Cristians Gonzalez³, Tong Yu², Pietro Mascagni^2,5, Didier Mutter^3,4, Jacques Marescaux⁴, Paolo Fiorini¹, Nicolas Padoy^2
1University of Verona (IT); ²University of Strasbourg (FR); ³University Hospital of Strasbourg (FR); ⁴IRCAD (Strasbourg, FR); ⁵Fondazione Policlinico Universitario Agostino Gemelli IRCCS (Rome, IT).   [#26]
Video | Paper

Domain Adaptation and Self-Supervised Learning for Surgical Margin Detection
Alice ML Santilli^1*, Amoon Jamzad¹, Alireza Sedghi¹, Martin Kaufmann¹, Kathryn Logan¹, Julie Wallis¹, Kevin Yi Mi Ren¹, Natasja Janssen¹, Shaila Merchant¹, Jay Engel¹, Doug McKay¹, Sonal Varma¹, Ami Wang¹, Gabor Fichtinger¹, John Rudan¹, Parvin Mousavi^1
1Queen's University (Kingston, CA).   [#33]
Video | Paper

15:45 Session S2: Imaging
Session Chair: Stefanie Speidel, PhD (DE)

Metabolomics Patterns of Breast Cancer Tumors Using Mass Spectrometry Imaging
Rachel Theriault^1*, Martin Kaufmann¹, Kevin Yi Mi Ren¹, Sonal Varma¹, Randy E Ellis^1
1Queen's University (Kingston, CA).   [#08]
Video | Paper

Tattoo tomography: Freehand 3D photoacoustic image reconstruction with an optical pattern
Niklas Holzwarth^1*, Melanie Schellenberg¹, Janek Groehl¹, Kris Dreher¹, Jan-Hinrich Nölke¹, Alexander Seitel¹, Minu Dietlinde Tizabi¹, Beat Peter Müller², Lena Maier-Hein^1,2
1German Cancer Research Center (Heidelberg, DE); ²University Hospital Heidelberg (DE).   [#32]
Video | Paper

Speed-of-Sound Imaging using Diverging Waves
Richard Rau^1*, Dieter Schweizer¹, Valery Vishnevskiy¹, Orcun Goksel^1
1ETH Zurich (CH).   [#37]
Video | Preprint Paper

16:15 Session S3: Interventional Planning
Session Chair: Nicola Rieke, PhD (US)

Automatic Cortical Target Point Localisation in MRI for Transcranial Magnetic Stimulation via a Multi-Resolution Convolutional Neural Network
John SH Baxter^1*, Ehouarn Maguet¹, Quoc Anh Bui¹, Stéphane Croci², Antoine Delmas², Jean-Pascal Lefaucheur³, Luc Bredoux², Pierre Jannin^1
1Université de Rennes 1 (FR); ²SYNEIKA (Rennes, FR); ³Paris Est Créteil University (FR).   [#13]
Video | Paper

Automatic Identification of Sweet Spots from MERs for Electrodes Implantation in STN-DBS
Linxia Xiao^1*, Caizi Li⁵, Yanjiang Wang¹, Weixin Si⁵, Doudou Zhang^3,4, Hai Lin^3,4, Xiaodong Cai^3,4, Pheng-Ann Heng^2,5
1China University of Petroleum (CN); ²The Chinese Univsersity of Hong Kong (HK); ³Shenzhen Second People’s Hospital, the First Affiliated Hospital of Shenzhen University (CN); ⁴Shenzhen University School of Medicine (CN); ⁵Chinese Academy of Sciences (CN).   [#15]
Video | Paper

Patient-specific Prediction of SEEG Electrode Bending for Stereotactic Neurosurgical Planning
Alejandro Granados^1*, Yuxuan Han¹, Oeslle Lucena¹, Vejay Vakharia², Roman Rodionov², Sjoerd B. Vos², Anna Miserocchi², Andrew W. McEvoy², John Duncan², Rachel Sparks¹, Sebastien Ourselin^1
1King's College London (UK); ²National Hospital of Neurology and Neurosurgery, London (UK).   [#30]
Video | Paper

16:45 Breaks and Posters (S1-3)

17:30 Session S4: Machine Learning in Ultrasound
Session Chair: Alexander Seitel, PhD (DE)

Time-Aware Deep Neural Networks for Needle Tip Localization in 2D Ultrasound
Cosmas Mwikirize^1*, Ilker Hacihaliloglu^2,3, John L Nosher², Andrew Katumba¹, Sylvia Imanirakiza¹, Alvin Kimbowa^1
1Makerere University (Kampala, UG); ²Rutgers Robert Wood Johnson Medical School (New Brunswick, US); ³Rutgers University (Piscataway, US).   [#14]
Video | Paper

Vessel Segmentation for Automatic Registration of Untracked Laparoscopic Ultrasound to CT of the Liver
Nina Montaña Brown^1*, João Ramalhinho¹, Moustafa Allam¹, Brian Davidson¹, Yipeng Hu¹, Matthew J Clarkson^1
1University College London (UK).   [#23]
Video | Paper

Learning Ultrasound Rendering from Cross-Sectional Model Slices for Simulated Training
Lin Zhang^1*, Tiziano Portenier¹, Orcun Goksel^1,2
1ETH Zurich (CH); ²Uppsala University (SE).   [#24]
Video | Paper

Leveraging Voxel-wise Segmentation Uncertainty to Improve Reliability in Assessment of Paediatric Dysplasia of the Hip
Arunkumar Kannan^1*, Antony J Hodgson¹, Kishore Mulpuri², Rafeef Abugharbieh^1
1University of British Columbia(Vancouver, CA); ²British Columbia Children's Hospital (Vancouver, CA).   [#51]
Video | Paper

18:10 Session S5: Prostate Interventions
Session Chair: Purang Abolmaesumi, PhD (CA)

Towards Targeted Ultrasound-guided Prostate Biopsy by Incorporating Model and Label Uncertainty in Cancer Detection
Golara Javadi^1*, Sharareh Bayat¹, Samareh Samadi¹, Alireza Sedghi², Samira Sojoudi¹, Antonio Hurtado-coll³, Silvia Chang³, Peter Black³, Parvin Mousavi², Purang Abolmaesumi^1
1University of British Columbia (Vancouver, CA); ²Queen's University (Kingston, CA); ³Vancouver General Hospital (Vancouver, CA).   [#17]
Video | Paper

Preclinical Evaluation of a Marker-less, Real-time, Augmented Reality Guidance System for Robot Assisted Radical Prostatectomy
Megha Kalia^1*, Apeksha Avinash¹, Nassir Navab², Septimiu Salcudean^1
1University of British Columbia (Vancouver, CA); ²TU Munich (DE).   [#40]
Video | Paper

Centre-specific autonomous treatment plans for prostate brachytherapy using cGANs
Tajwar A Aleef^1*, Ingrid Spadinger², Michael Peacock², Septimiu Salcudean¹, Sara Mahdavi^2
1University of British Columbia (Vancouver, CA); ²BC Cancer Agency (CA).   [#43]
Video | Paper

An Office-Based MR System for Prostate Biopsy
Selin Chiragzada^1*, Eva Hellman¹, Duncan Michael¹, Ram Narayanan¹, Aleksandar Nacev¹, Dinesh Kumar^1
1Promaxo Inc. (Oakland, CA).   [#48]
Video | Paper

18:50 Breaks and Posters (S4-5)

19:30 Panel Discussion (Details)
Moderation: Parvin Mousavi, PhD (CA); Alice Santilli, MSc Student (CA)
Panelists: Shekoofeh Azizi (AI Researcher at Google), Purang Abolmaesumi (Professor of Medical Imaging, Image Guided Therapy and Applied Machine Learning at UBC), David Pichora (President & CEO Kingston Health Sciences Centre), Lena Maier-Hein (Professor of Computer-assisted Medical Interventions at DKFZ), Fausto Milletari (Staff engineer at Johnson & Johnson)

20:30 Meet & Greet

21:15 Open-ended Social Event

June 23rd

15:00 Long Abstract Session
Session Chair: Matthew Clarkson, PhD (UK), Keno März, PhD (DE)

Pose optimization of X-ray protective shields for staff radiation exposure minimization
Alexandre Krebs^1*, Cindy Rolland¹, Juan JMV Verde², Nicolas Padoy^1,2
1University of Strasbourg, CNRS, IHU Strasbourg (FR); ²IHU Strasbourg (FR).   [#53]
Video | (Paper not available yet)

Superpixel Tracking: Configurable Polynomial-Time Semantic Segmentation for Endoscope Video
W.-Y. Hong¹, Chi-Sheng Shih^1*
1National Taiwan University (Taipei, TW).   [#54]
Video | (Paper not available yet)

CholecSeg8k: A Semantic Segmentation Dataset for Laparoscopic Cholecystectomy Based on Cholec80
W.-Y. Hong¹, C.-L. Kao¹, Y.-H. Kuo¹, J.-R. Wang¹, W.-L. Chang¹, Chi-Sheng Shih^1*
1National Taiwan University (Taipei, TW).   [#55]
Video | Preprint Paper

Colonoscopic 3D Reconstruction by Tubular Non-Rigid Structure-from-Motion
Agniva Sengupta^1*, Adrien Bartoli^2
1Université Clermont Auvergne (FR).   [#56]
Video | Paper

Learning 3D Medical Image Patch Descriptors with Triplet Loss
Nicolas Loiseau--Witon^1,2*, Razmig Kechichian¹, Sebastien Valette¹, Adrien Bartoli^2
1CREATIS (FR); ²Université Clermont Auvergne (FR).   [#57]
Video | Preprint Paper

SlicerAutoscoperM: Multi-modal Tracking of Skeletal Structures and Implants
Bardiya Akhbari^1*, Amy Morton¹, Lauren Welte², Jillian Beveridge³, Jean-Christophe Fillion-Robin⁴, Michael Rainbow², Beatriz Paniagua⁴, Joseph Crisco^1
1Brown University (Providence, US); ²Queen's University (Kingston, CA); ³Cleveland Clinic (US); ⁴Kitware (US).   [#59]
Video | (Paper not available yet)

Automation of Internal Limiting Membrane Peeling Task with Deep Reinforcement Learning
Mikinori Kanehara^1*, Saul Alexis Heredia Perez¹, Seiji Omata², Fumihito Arai¹, Koichiro Sugimoto³, Fumiyuki Araki³, Kiyohito Totsuka³, Tomoyasu Shiraya³, Takashi Ueta³, Muneyuki Takao³, Kanako Harada¹, Mamoru Mitsuishi^1
1The University of Tokyo (JP); ²Kumamoto University (JP); ³The University of Tokyo Hospital (JP).   [#62]
Video | (Paper not available yet)

Image Recognition Applied to a Robotic Platform for Mouse Dissection
Taketo Inoue^1*, Mamoru Mituishi¹, Kanako Harada^1
1The University of Tokyo (JP).   [#63]
Video | (Paper not available yet)

15:45 Breaks and Posters (Long Abstracts)

16:15 Session S6: Machine Learning in Computer Assisted Interventions
Session Chair: Ka-Wai Kwok, PhD (HK)

Deep Learning to Segment Pelvic Bones: Large-scale CT Datasets and Baseline Models
Pengbo Liu^1*, Hu Han¹, Yuanqi Du³, Heqin Zhu¹, Yinhao Li¹, Feng Gu^1,4, Honghu Xiao², Jun Li¹, Chunpeng Zhao², Li Xiao¹, Xinbao Wu², S. Kevin Zhou^1,5
1Chinese Academy of Sciences (Beijing, CN); ²Beijing Jishuitan Hospital (CN); ³George Mason University (Virginia, US); ⁴Beijing Electronics Science&Technology Institute (CN); ⁵University Of Science And Technology Of China (Suzhou, CN).   [#07]
Video | Paper

Against Spatial-Temporal Discrepancy: Contrastive Learning based Network for Surgical Workflow Recognition
Fucang Jia^1,2, Tong Xia^1,2*
1Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences (Shenzen, CN); ²University of Chinese Academy of Science (Beijing, CN).   [#28]
Video | Paper

Real-to-Virtual Domain Transfer-based Depth Estimation for Real-time 3D Annotation in Transnasal Surgery: A Study of Annotation Accuracy and Stability
Hon Sing Tong^1*, Yui Lun Ng¹, Zhiyu Liu¹, Justin D.L. Ho¹, Po-Ling Chan², Catherine Chan², Jason Y. K. Chan², Ka-Wai Kwok^1
1The University of Hong Kong (HK); ²The Chinese University of Hong Kong (HK).   [#41]
Video | Paper

Computer-assisted contralateral side comparison using flat panel technology
Sarina Thomas^1*, Lisa Kausch^1,2, Holger Kunze³, Maxim Privalov⁴, Andre Klein^1,2, Jan Siad El Barbari⁴, Celia Martin Vicario³, Jochen Franke⁴, Klaus H. Maier-Hein^1,2
1German Cancer Research Center (Heidelberg, DE); ²Universität Heidelberg (Heidelberg, DE); ³Siemens Healthineers (DE); ⁴Department for Trauma and Orthopaedic Surgery, BG Trauma Center Ludwigshafen (DE).   [#42]
Video | Paper

16:55 Session S7: Surgical Robotics
Session Chair: Omid Mohareri, PhD (US)

Cross-modal self-supervised representation learning for gesture and skill recognition in robotic surgery
Jie Ying Wu^1*, Aniruddha Tamhane¹, Peter Kazanzides¹, Mathias Unberath^1
1Johns Hopkins University (Baltimore, US).   [#21]
Video | Paper

Autonomous Pick-And-Place Using the dVRK
Claudia D'Ettorre^1*, Agostino Stilli¹, George Dwyeer¹, Maxine Tran¹, Danail Stoyanov^1
1University College London (UK).   [#35]
Video | Paper

An Intuitive Surgical Handle Design for Robotic Neurosurgery
Emmanouil Dimitrakakis^1*, Lukas Lindenroth¹, George Dwyer¹, Holly Aylmore², Neil Dorward³, Hani Marcus^1,2,3, Danail Stoyanov^1
1University College London (UK); ²UCL Queen Square Institute of Neurology (London, UK); ³National Hospital for Neurology and Neurosurgery (London, UK).   [#44]
Video | Paper

Mask then Classify: Multi-Instance Segmentation for Surgical Instruments
Thomas Kurmann^1*, Pablo Márquez Neila¹, Maximilian Allan², Sebastian Wolf³, Raphael Sznitman^1
1University of Bern (CH); ²Intuitive Surgical (US); ³University Hospital of Bern (CH).   [#49]
Video | Paper

17:35 Breaks and Posters (S6-7)

18:15 Session S8: Training and Simulation
Session Chair: Ingerid Reinersten, PhD (NO)

Comparison of Augmented Reality-based and Conventional Training for ECMO Cannulation
Julian Wolf^1*, Viviane Wolfer¹, Maximilian Halbe², Francesco Maisano³, Quentin Lohmeyer¹, Mirko Mebolt^1
1ETH Zurich (CH); ²University Hospital Zurich (CH); ³University of Zurich (CH).   [#12]
Video | Paper

Automatic extraction of the mitral valve chordae geometry for biomechanical simulation
Daryna Panicheva^1*, Pierre-Frederic Villard^1,2, Peter Hammer³, Douglas Perrin^2,3, Marie-Odile Berger^1
1University of Lorraine, CNRS, Inria, LORIA (FR); ²Harvard School of Engineering and Applied Sciences (US); ³Harvard Medical School (US).   [#18]
Video | Paper

Automatic Triangulated Mesh Generation of Pulmonary Airways from 3DCTs for Computational Fluid Dynamics
Michael Lauria^1*, Kamal Singhrao¹, Brad Stiehl¹, Daniel Low¹, Jonathan Goldin¹, Igor Barjaktarevic¹, Anand P Santhanam^1
1University of California (US).   [#19]
Video | Paper

18:45 Session 9: Tracking and Localization
Session Chair: Phillippe Cattin, PhD (CH)

Predictive online 3D target tracking with population-based generative networks for image-guided radiotherapy
Liset Vazquez Romaguera^1*, Tal Mezheritsky¹, Rihab Mansour³, William Tanguay², Samuel Kadoury^1
1École Polytechnique de Montreal (CA); ²Faculty of Medicine, University of Montreal (CA); ³University of Montreal (CA).   [#02]
Video | Paper

CycleGAN for Interpretable Online EMT Compensation
Henry J Krumb^1*, Dhritimaan Das², Romol Chadda¹, Anirban Mukhopadhyay^1
1TU Darmstadt (DE); ²Indian Institute of Technology (IIT-BHU), Varanasi (IN).   [#09]
Video | Paper

Towards Markerless Surgical Tool and Hand Pose Estimation
Jonas Hein^1,2*, Matthias Seibold^1,3, Federica Bogo⁴, Mazda Farshad⁵, Marc Pollefeys^2,4, Philipp Fürnstahl¹, Nassir Navab^3
1University of Zurich; ²ETH Zurich (CH); ³TU Munich (DE); ⁴Microsoft (CH); ⁵Balgrist University Hospital Zurich (CH).  [#11]
Video | Paper

Fast and Robust Localization of Surgical Array using Kalman Filter
Md Ashikuzzaman^1*, Noushin Jafarpisheh¹, Sunil Rottoo², Pierre Brisson², Hassan Rivaz^1
1Concordia University (Montreal, CA); ²THINK Surgical Inc. (CA).   [#31]
Video | Paper

Automating Periodontal Bone Loss Measurement via Dental Landmark Localisation
Raymond P Danks^1*, Sophia Bano¹, Anastasiya Orishko², Hong Jin Tan², Federico Moreno Sancho², Francesco D'Aiuto², Danail Stoyanov^1
1University College London (UK); ²University College London Eastman Dental Institute (London, UK).   [#46]
Video | Paper

19:35 Breaks and Posters (S8-9)

20:15 Awards and Closing

21:00 Post-IPCAI Social Event

During the conference the following prizes were awarded. We thank our Sponsors for cash and non-cash prizes.

Best Paper Award

1st place awarded to paper #02:
Predictive online 3D target tracking with population-based generative networks for image-guided radiotherapy
Liset Vázquez Romaguera, Tal Mezheritsky, Rihab Mansour, William Tanguay, Samuel Kadoury

Runner-up awarded to paper #37:
Speed-of-Sound Imaging using Diverging Waves
Richard Rau, Dieter Schweizer, Valery Vishnevskiy, Orcun Goksel

Machine Learning for CAI Award

1st place awarded to paper #17:
Towards Targeted Ultrasound-guided Prostate Biopsy by Incorporating Model and Label Uncertainty in Cancer Detection
Golara Javadi, Sharareh Bayat, Samareh Samadi, Alireza Sedghi, Samira Sojoudi, Antonio Hurtado, Silvia Chang, Peter Black, Parvin Mousavi, Purang Abolmaesumi

Runner-up awarded to paper #21:
Cross-modal self-supervised representation learning for gesture and skill recognition in robotic surgery
Jie Ying Wu, Aniruddha Tamhane, Peter Kazanzides, Mathias Unberath

Bench-to-Bedside Award

1st place awarded to paper #40:
Preclinical Evaluation of a Marker-less, Real-time, Augmented Reality Guidance System for Robot Assisted Radical Prostatectomy
Megha Kalia, Apeksha Avinash, Nassir Navab, Septimiu Salcudean

Runner-up awarded to paper #33:
Domain Adaptation and Self-Supervised Learning for Surgical Margin Detection
Alice M.L. Santilli, Amoon Jamzad, Alireza Sedghi, Martin Kaufmann, Kathryn Logan, Julie Wallis, Kevin Y.M Ren, Natasja Janssen, Shaila Merchant, Jay Engel, Doug McKay, Sonal Varma, Ami Wang, Gabor Fichtinger, John F. Rudan, Parvin Mousavi

Audience Award for Best Innovation

1st place awarded to paper #44:
An Intuitive Surgical Handle Design for Robotic Neurosurgery
Emmanouil Dimitrakakis, Lukas Lindenroth, George Dwyer, Holly Aylmore, Neil L Dorward, Hani J Marcus, Danail Stoyanov

Runner-up awarded to paper #32:
Tattoo tomography: Freehand 3D photoacoustic image reconstruction with an optical pattern
Niklas Holzwarth, Melanie Schellenberg, Janek Gröhl, Kris Dreher, Jan-Hinrich Nölke, Alexander Seitel, Minu D Tizabi, Beat P Müller-Stich, Lena Maier-Hein

Audience Award for Best Presentation

1st place awarded to paper #35:
Autonomous Pick-And-Place Using the dVRK
Claudia D'Ettorre, Agostino Stilli, George Dwyeer, Maxine Tran, Danail Stoyanov

Runner-up awarded to paper #08:
Metabolomics Patterns of Breast Cancer Tumors Using Mass Spectrometry Imaging
Rachel L. Theriault, Martin Kaufmann, Kevin Yi Mi Ren, Sonal Varma, Randy E. Ellis