Deep 3D Convolutional Networks to Segment Bones Affected by Severe Osteoarthritis in CT Scans for PSI-Based Knee Surgical Planning

Segmentation of bony structures in CT scans is a crucial step in knee arthroplasty based on personalized surgical instruments (PSI). As a matter of fact, the success of the surgery depends on the quality of the matching between the patient-specific resection jigs, manufactured exploiting the patient...

Full description

Bibliographic Details
Main Authors: Davide Marzorati, Mattia Sarti, Luca Mainardi, Alfonso Manzotti, Pietro Cerveri
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9241701/
id doaj-c4d5b4a0807443fbb9f701aa7905f201
record_format Article
spelling doaj-c4d5b4a0807443fbb9f701aa7905f2012021-03-30T04:16:04ZengIEEEIEEE Access2169-35362020-01-01819639419640710.1109/ACCESS.2020.30344189241701Deep 3D Convolutional Networks to Segment Bones Affected by Severe Osteoarthritis in CT Scans for PSI-Based Knee Surgical PlanningDavide Marzorati0https://orcid.org/0000-0003-3980-8296Mattia Sarti1https://orcid.org/0000-0001-5095-1857Luca Mainardi2https://orcid.org/0000-0002-6276-6314Alfonso Manzotti3https://orcid.org/0000-0003-1791-6800Pietro Cerveri4https://orcid.org/0000-0003-3995-8673Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, ItalyDepartment of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, ItalyDepartment of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, ItalyDepartment of Orthopaedics and Trauma, Luigi Sacco Hospital, ASST FBF-Sacco, Milan, ItalyDepartment of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, ItalySegmentation of bony structures in CT scans is a crucial step in knee arthroplasty based on personalized surgical instruments (PSI). As a matter of fact, the success of the surgery depends on the quality of the matching between the patient-specific resection jigs, manufactured exploiting the patient bony surfaces attained by segmentation, and true patient surfaces. Severe pathological conditions as chronic osteoarthritis, deteriorating the cartilages, narrowing the intra-articular spaces and leading to bone impingement, complicate the segmentation making the recognition of bony boundaries sub-optimal for traditional semi-automated methods and often extremely difficult even for expert radiologists. Deep convolutional neural networks (CNNs) have been investigated in the last years towards automatic labeling of diagnostic images, especially harnessing the encoding-decoding U-Net architecture. In this article, we implemented deep CNNs to encompass the concurrent segmentation of the distal femur and the proximal tibia in CT images and evaluate how segmentation uncertainty may impact on the surgical planning. A retrospective set of 200 knee CT scans of patients was used to train the network and test the segmentation performances. Tests on a subset of 20 scans provided median dice, sensitivity and positive predictive value indices greater than 96% for both shapes, with median 3D reconstruction error in the range of 0.5mm. Median 3D errors on both PSI femoral and tibial contact areas and surgical cut alignments were less than 2mm and 2°, respectively, which can be considered clinically acceptable. These results substantiate that deep CNN architectures can disclose the opportunity of segmenting bone shapes in CT scans for PSI-based surgical planning with promising accuracy. However, we observed that segmentation scores alone cannot be taken as representative of the 3D errors at the contact areas of the PSI. Therefore when comparing segmentation algorithms of PSI-based surgical planning the 3D errors should be explicitly analyzed.https://ieeexplore.ieee.org/document/9241701/3D U-netbone segmentationCT~imagesdeep learningknee arthroplastyosteoarthritis
collection DOAJ
language English
format Article
sources DOAJ
author Davide Marzorati
Mattia Sarti
Luca Mainardi
Alfonso Manzotti
Pietro Cerveri
spellingShingle Davide Marzorati
Mattia Sarti
Luca Mainardi
Alfonso Manzotti
Pietro Cerveri
Deep 3D Convolutional Networks to Segment Bones Affected by Severe Osteoarthritis in CT Scans for PSI-Based Knee Surgical Planning
IEEE Access
3D U-net
bone segmentation
CT~images
deep learning
knee arthroplasty
osteoarthritis
author_facet Davide Marzorati
Mattia Sarti
Luca Mainardi
Alfonso Manzotti
Pietro Cerveri
author_sort Davide Marzorati
title Deep 3D Convolutional Networks to Segment Bones Affected by Severe Osteoarthritis in CT Scans for PSI-Based Knee Surgical Planning
title_short Deep 3D Convolutional Networks to Segment Bones Affected by Severe Osteoarthritis in CT Scans for PSI-Based Knee Surgical Planning
title_full Deep 3D Convolutional Networks to Segment Bones Affected by Severe Osteoarthritis in CT Scans for PSI-Based Knee Surgical Planning
title_fullStr Deep 3D Convolutional Networks to Segment Bones Affected by Severe Osteoarthritis in CT Scans for PSI-Based Knee Surgical Planning
title_full_unstemmed Deep 3D Convolutional Networks to Segment Bones Affected by Severe Osteoarthritis in CT Scans for PSI-Based Knee Surgical Planning
title_sort deep 3d convolutional networks to segment bones affected by severe osteoarthritis in ct scans for psi-based knee surgical planning
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description Segmentation of bony structures in CT scans is a crucial step in knee arthroplasty based on personalized surgical instruments (PSI). As a matter of fact, the success of the surgery depends on the quality of the matching between the patient-specific resection jigs, manufactured exploiting the patient bony surfaces attained by segmentation, and true patient surfaces. Severe pathological conditions as chronic osteoarthritis, deteriorating the cartilages, narrowing the intra-articular spaces and leading to bone impingement, complicate the segmentation making the recognition of bony boundaries sub-optimal for traditional semi-automated methods and often extremely difficult even for expert radiologists. Deep convolutional neural networks (CNNs) have been investigated in the last years towards automatic labeling of diagnostic images, especially harnessing the encoding-decoding U-Net architecture. In this article, we implemented deep CNNs to encompass the concurrent segmentation of the distal femur and the proximal tibia in CT images and evaluate how segmentation uncertainty may impact on the surgical planning. A retrospective set of 200 knee CT scans of patients was used to train the network and test the segmentation performances. Tests on a subset of 20 scans provided median dice, sensitivity and positive predictive value indices greater than 96% for both shapes, with median 3D reconstruction error in the range of 0.5mm. Median 3D errors on both PSI femoral and tibial contact areas and surgical cut alignments were less than 2mm and 2°, respectively, which can be considered clinically acceptable. These results substantiate that deep CNN architectures can disclose the opportunity of segmenting bone shapes in CT scans for PSI-based surgical planning with promising accuracy. However, we observed that segmentation scores alone cannot be taken as representative of the 3D errors at the contact areas of the PSI. Therefore when comparing segmentation algorithms of PSI-based surgical planning the 3D errors should be explicitly analyzed.
topic 3D U-net
bone segmentation
CT~images
deep learning
knee arthroplasty
osteoarthritis
url https://ieeexplore.ieee.org/document/9241701/
work_keys_str_mv AT davidemarzorati deep3dconvolutionalnetworkstosegmentbonesaffectedbysevereosteoarthritisinctscansforpsibasedkneesurgicalplanning
AT mattiasarti deep3dconvolutionalnetworkstosegmentbonesaffectedbysevereosteoarthritisinctscansforpsibasedkneesurgicalplanning
AT lucamainardi deep3dconvolutionalnetworkstosegmentbonesaffectedbysevereosteoarthritisinctscansforpsibasedkneesurgicalplanning
AT alfonsomanzotti deep3dconvolutionalnetworkstosegmentbonesaffectedbysevereosteoarthritisinctscansforpsibasedkneesurgicalplanning
AT pietrocerveri deep3dconvolutionalnetworkstosegmentbonesaffectedbysevereosteoarthritisinctscansforpsibasedkneesurgicalplanning
_version_ 1724182128504078336