Jeff Siewerdsen is Vice-Chair and John C. Malone Professor of Biomedical Engineering at Johns Hopkins University. He is also Co-Director of the Carnegie Center for Surgical Innovation and holds cross-appointment in Computer Science, Radiology, Neurosurgery, and the Armstrong Institute for Patient Safety and Quality. He obtained his PhD in Physics at the University of Michigan (1998), after which he was a Research Scientist at William Beaumont Hospital (1998-2002) and then a Senior Scientist at the Ontario Cancer Institute / University of Toronto (2002-2009). His main interests are in the physics of medical imaging, digital x-ray and cone-beam CT systems for diagnostic and image-guided procedures, and multi-modality image registration and analytics. His current and previous professional activities include service to the AAPM (Science Council, Board of Directors, and Scientific Program Director), the SPIE (Program Committees for Physics of Medical Imaging and Image-Guided Procedures), the RSNA (Program Committee Liaison), and the APS (Program Director and Committee Member for the Topic Group on Medical Physics, GMED). He is Fellow of the AAPM (FAAPM) and AIMBE (FAIMBE).
This will count as one of your downloads.
You will have access to both the presentation and article (if available).
The scintillator design includes reflective coatings applied to the laser-cut grooves to improve optical isolation between pixels. Such coatings are created by atomic layer deposition (ALD), a unique approach, which permits formation of reflectors over inter-pixel grooves with aspect ratios as high as 140:1. Here we present initial results quantifying performance gains in CMOS detector resolution and their impact on the quality of bone microstructure segmentation. We demonstrate 77% gain in spatial resolution at 2 lp/mm and extension of the limiting resolution from 3 lp/mm to 4.5 lp/mm for the CMOS detector with a pixelated screen compared to a commercial sensor. In a bench-top CBCT study emulating diagnostic systems for orthopedic applications (extremity CBCT), we achieved >0.75 correlations in metrics of trabecular microarchitecture between pixelated CsI:Tl based CBCT and gold-standard micro-CT. The pixelated scintillator is expected to have significant impact for many other applications including mammography and digital radiography, where resolution and dose efficiency (DQE) of the detector are of critical importance.
We assessed interventional radiologists’ task-based image quality preferences for two- and three-dimensional images obtained with a complementary metal–oxide semiconductor (CMOS) flat-panel detector versus a hydrogenated amorphous silicon (a-Si:H) flat-panel detector. CMOS and a-Si:H detectors were implemented on identical mobile C-arms to acquire radiographic, fluoroscopic, and cone-beam computed tomography (CBCT) images of cadavers undergoing simulated interventional procedures using low- and high-dose settings. Images from both systems were displayed side by side on calibrated, diagnostic-quality displays, and three interventional radiologists evaluated task performance relevant to each image and ranked their preferences based on visibility of pertinent anatomy and interventional devices. Overall, CMOS images were preferred in fluoroscopy (
Convolutional neural networks (CNNs) offer a promising means to achieve fast deformable image registration with accuracy comparable to conventional, physics-based methods. A persistent question with CNN methods, however, is whether they will be able to generalize to data outside of the training set. We investigated this question of mismatch between train and test data with respect to first- and second-order image statistics (e.g., spatial resolution, image noise, and power spectrum). A UNet-based architecture was built and trained on simulated CT images for various conditions of image noise (dose), spatial resolution, and deformation magnitude. Target registration error was measured as a function of the difference in statistical properties between the test and training data. Generally, registration error is minimized when the training data exactly match the statistics of the test data; however, networks trained with data exhibiting a diversity in statistical characteristics generalized well across the range of statistical conditions considered. Furthermore, networks trained on simulated image content with first- and second-order statistics selected to match that of real anatomical data were shown to provide reasonable registration performance on real anatomical content, offering potential new means for data augmentation. Characterizing the behavior of a CNN in the presence of statistical mismatch is an important step in understanding how these networks behave when deployed on new, unobserved data. Such characterization can inform decisions on whether retraining is necessary and can guide the data collection and/or augmentation process for training.
Volume-of-interest (VOI) imaging is a strategy in computed tomography (CT) that restricts x-ray fluence to particular anatomical targets via dynamic beam modulation. This permits dose reduction while retaining image quality within the VOI. VOI-CT implementation has been challenged, in part, by a lack of hardware solutions for tailoring the incident fluence to the patient and anatomical site, as well as difficulties involving interior tomography reconstruction of truncated projection data. We propose a general VOI-CT imaging framework using multiple aperture devices (MADs), an emerging beam filtration scheme based on two binary x-ray filters. Location of the VOI is prescribed using two scout views at anterior–posterior (AP) and lateral perspectives. Based on a calibration of achievable fluence field patterns, MAD motion trajectories were designed using an optimization objective that seeks to maximize the relative fluence in the VOI subject to minimum fluence constraints. A modified penalized-likelihood method is developed for reconstruction of heavily truncated data using the full-field scout views to help solve the interior tomography problem. Physical experiments were conducted to show the feasibility of noncentered and elliptical VOI in two applications—spine and lung imaging. Improved dose utilization and retained image quality are validated with respect to standard full-field protocols. We observe that the contrast-to-noise ratio (CNR) is 40% higher compared with low-dose full-field scans at the same dose. The total dose reduction is 50% for equivalent image quality (CNR) within the VOI.
Methods: An atlas was constructed with segmented pelvis shapes containing standard reference trajectories for screw placement. A statistical shape model computed from the atlas is used for deformable registration to the patient’s preoperative CT (without segmentation). By transferring the reference trajectories and surrounding acceptance windows (i.e., volumetric corridors of acceptable device placement) from the atlas, the system automatically computes reliable Kwire and screw trajectories for guidance (overlay in fluoroscopy) and QA.
Results: A leave-one-out analysis was performed to evaluate the accuracy or registration and overlay. The registration achieved average surface registration accuracy of 1.82 ± 0.39 mm. Automatically determined trajectories conformed within acceptable cortical bone margins, maintaining 3.75 ± 0.68 mm distance from cortex in narrow bone corridors and demonstrating accurate registration and surgical trajectory definition without breaching cortex.
Conclusions: The framework proposed in this work allows for multi-atlas based automatic planning of surgical trajectory without tracker or manual segmentation. The planning information can be further used to facilitate intraoperative guidance and post-operatively quality assurance in a manner consistent with surgical workflow.
Methods. Two novel methodologies predicate the work: (1) Known-Component Registration (KC-Reg) for 3D localization of the patient and interventional devices from 2D radiographs; and (2) Penalized-Likelihood reconstruction (PLH) for improved 3D image quality and dose reduction. A thorough assessment of geometric stability, dosimetry, and image quality was performed to define algorithm parameters for imaging and guidance protocols. Laboratory studies included: evaluation of KC-Reg in localization of spine screws delivered in cadaver; and PLH performance in contrast, noise, and resolution in phantoms/cadaver compared to filtered backprojection (FBP).
Results. KC-Reg was shown to successfully register screw implants within ~1 mm based on as few as 3 radiographs. PLH was shown to improve soft-tissue visibility (61% improvement in CNR) compared to FBP at matched resolution. Cadaver studies verified the selection of algorithm parameters and the methods were successfully translated to clinical studies under an IRB protocol.
Conclusions. Model-based registration and reconstruction approaches were shown to reduce dose and provide improved visualization of anatomy and surgical instrumentation. Immediate future work will focus on further integration of KC-Reg and PLH for Known-Component Reconstruction (KC-Recon) to provide high-quality intraoperative imaging in the presence of dense instrumentation.
Method: Registration of 2D US (slice) images is performed via the initialization obtained from a fast dictionary search that determines probe pose within a predefined set of pose configurations. 2D slices are extracted from a static 3D US (volume) image to construct a feature dictionary representing different probe poses. Haar features are computed in a fourlevel pyramid that transforms 2D image intensities to a 1D feature vector, which are in turn matched to the 2D target image. 3D-2D registration was performed with the Haar-based initialization with normalized cross-correlation as the metric and Powell’s method as the optimizer. Reduction to 1D feature vectors presents the potential for major gains in speed compared to registration of the 3D and 2D images directly. The method was validated in experiments conducted in a lumbar spine phantom and a cadaver specimen with known translations imparted by a computerized motion stage.
Results: The Haar feature matching method demonstrated initialization accuracy (mean ± std) = (1.9 ± 1.4) mm and (2.1 ± 1.2) mm in phantom and cadaver studies, respectively. The overall registration accuracy was (2.0 ± 1.3) mm and (1.7 ± 0.9) mm, and the initialization was a necessary and important step in the registration process.
Conclusions: The proposed image-based registration method demonstrated promising results for compensating motion of the US probe. This image-based solution could be an important step toward an entirely image-based, real-time registration method of 2D US to 3D US and pre-procedure MRI, eliminating hardware-based tracking systems in a manner more suitable to clinical workflow.
Methods: The study involved 35 transilliac bone biopsy samples imaged on extremity CBCT (voxel size 75 μm, imaging dose ~13 mGy) and gold standard μCT (voxel size 7.67 μm). CBCT image segmentation was performed using (i) global Otsu’s thresholding, (ii) Bernsen’s local thresholding, (iii) Bernsen’s local thresholding with additional histogram-based global pre-thresholding, and (iv) the same as (iii) but combined with contrast enhancement using a Laplacian Pyramid. Correlations between extremity CBCT with the different segmentation algorithms and gold standard μCT were investigated for measurements of Bone Volume over Total Volume (BV/TV), Trabecular Thickness (Tb.Th), Trabecular Spacing (Tb.Sp), and Trabecular Number (Tb.N).
Results: The combination of local thresholding with global pre-thresholding and Laplacian contrast enhancement outperformed other CBCT segmentation methods. Using this optimal segmentation scheme, strong correlation between extremity CBCT and μCT was achieved, with Pearson coefficients of 0.93 for BV/TV, 0.89 for Tb.Th, 0.91 for Tb.Sp, and 0.88 for Tb.N (all results statistically significant). Compared to a simple global CBCT segmentation using Otsu’s algorithm, the advanced segmentation method achieved ~20% improvement in the correlation coefficient for Tb.Th and ~50% improvement for Tb.Sp.
Conclusions: Extremity CBCT combined with advanced image pre-processing and segmentation achieves high correlation with gold standard μCT in measurements of trabecular microstructure. This motivates ongoing development of clinical applications of extremity CBCT in in-vivo evaluation of bone health e.g. in early osteoarthritis and osteoporosis.
Methods: CT images from 41 subjects (21 males, 20 females) were derived from the Cancer Imaging Archive (TCIA) and segmented using manual/semi-automatic methods. A statistical shape model was constructed and incorporated in an active shape model (ASM) registration framework for atlas-to-patient registration. Further, we introduce a registration method that exploits clusters in the underlying distribution to iteratively perform registrations after selecting a patient relevant cluster (sub-atlas) that represents similar shape characteristics to the image being registered. Experiments were performed to evaluate surface-to-surface and atlas-to patient registration algorithms using this clustered iterative model. Initial investigation of improved registration based on using similar shapes, was first explored through the use of gender as a categorical way of selecting a possible sub-atlas for registration.
Results: The RMSE surface-to-surface registration error (mean ± std) was reduced from (2.1 ± 0.2) mm when registering according to the entire atlas (N=40 members) to (1.8 ± 0.1) mm when registering within clusters based on similarity of principal components (N=20 members), showing improved accuracy (p<0.001) with fewer atlas members – an efficiency gained by virtue of the proposed approach. The atlas showed clear clusters in the first two principal components corresponding to gender, and the proposed method demonstrated improved accuracy when using ASM registration as well as when applied to a coherent-point drift (CPD) non-rigid deformable registration.
Conclusions: The proposed framework improved atlas-to-patient registration accuracy and increased the efficiency of statistical shape models (i.e., equivalent registration using fewer atlas members) by guiding member selection according to similarity in principal components.
Methods: Important aspects of CBCT angiography were investigated, weighting tradeoffs among the magnitude of iodine enhancement (peak contrast), the degree of data consistency, and the degree of data sparsity. Simulation studies were performed across a range of CBCT half-scan acquisition speed ranging ~3 – 17 s. Experiments were conducted using a CBCT prototype and an anthropomorphic neurovascular phantom incorporating a vessel with contrast injection with a time-attenuation (TAC) injection giving low data consistency but high peak contrast. Images were reconstructed using filtered back-projection (FBP), penalized likelihood (PL), and the RoD algorithm. Data were evaluated in terms of root mean square error (RMSE) in image enhancement as well as overall image noise and artifact.
Results: Feasibility was demonstrated for 3D angiographic assessment in CBCT images acquired across a range of data consistency and sparsity. Compared to FBP, the RoD method reduced the RMSE in reconstructed images by 50.0% in simulation studies (fixed peak contrast; variable data consistency and sparsity). The improvement in RMSE compared to PL reconstruction was 28.8%. The phantom experiments investigated conditions of low data consistency, RoD provided a 15.6% reduction in RMSE compared to FBP and a 16.3% reduction compared to PL, showing the feasibility of RoD method for slow-rotating CBCT-A system.
Conclusions: Simulations and phantom experiments show the feasibility and improved performance of the RoD approach compared to FBP and PL reconstruction, enabling 3D neuro-angiography on a slowly rotating CBCT system (e.g., 17.1s for a half-scan). The algorithm is relatively robust against data sparsity and is sensitive in detecting low levels of contrast enhancement from the baseline (mask) scan. Tradeoffs among peak contrast, data consistency, and data sparsity are demonstrated clearly in each experiment and help to guide the development of optimal contrast injection protocols for future preclinical and clinical studies.
Methods: The prototype CMOS-based CBCT involves a DALSA Xineos3030 detector (99 μm pixels) with 400 μm-thick CsI scintillator and a compact 0.3 FS rotating anode x-ray source. We compare the performance of CMOS CBCT to an a- Si:H FPD scanner built on a similar gantry, but using a Varian PaxScan2530 detector with 0.137 mm pixels and a 0.5 FS stationary anode x-ray source. Experimental studies include measurements of Modulation Transfer Function (MTF) for the detectors and in 3D image reconstructions. Image quality in clinical scenarios is evaluated in scans of a cadaver ankle. Metrics of trabecular microarchitecture (BV/TV, Bone Volume/Total Volume, TbSp, Trabecular Spacing, and TbTh, trabecular thickness) are obtained in a human ulna using CMOS CBCT and a-Si:H FPD CBCT and compared to gold standard μCT.
Results: The CMOS detector achieves ~40% increase in the f20 value (frequency at which MTF reduces to 0.20) compared to the a-Si:H FPD. In the reconstruction domain, the FWHM of a 127 μm tungsten wire is also improved by ~40%. Reconstructions of a cadaveric ankle reveal enhanced modulation of trabecular structures with the CMOS detector and soft-tissue visibility that is similar to that of the a-Si:H FPD system. Correlations of the metrics of bone microarchitecture with gold-standard μCT are improved with CMOS CBCT: from 0.93 to 0.98 for BV/TV, from 0.49 to 0.74 for TbTh, and from 0.9 to 0.96 for TbSp.
Conclusion: Adoption of a CMOS detector in extremity CBCT improved spatial resolution and enhanced performance in metrics of bone microarchitecture compared to a conventional a-Si:H FPD. The results support development of clinical applications of CMOS CBCT in quantitative imaging of bone health.
Methods: Two mobile C-arms were equipped with CMOS (Xineos 3030HS) and a-Si:H (PaxScan 3030X) FPDs. Technical assessment includes measurement of spatial resolution (MTF), image noise (NPS), and detective quantum efficiency (DQE). Evaluation of CBCT performance considers soft tissue visibility including axial image MTF, NPS, and noise-equivalent quanta (NEQ).
Results: The CMOS detector exhibited lower readout noise and slightly higher spatial resolution as expected. The a- Si:H detector showed about 10-15% higher DQE at low spatial frequencies while the CMOS detector showed greater resilience in DQE at higher spatial frequencies. In matched resolution CBCT, both detectors showed roughly equivalent performance.
Conclusion: CMOS detectors benefit performance with respect to high-frequency tasks, but the current work did not demonstrate strong advantage with respect to low-contrast soft-tissue visualization, in part due to light losses in scintillator-semiconductor coupling. Additional advantages include improved frame rate (reduced CBCT scan time). Ongoing work includes further investigation of modified bandwidth filters to take better advantage of underlying noiseresolution properties.
Methods: Novel predictors for estimation of local spatial resolution and noise properties are developed for PL reconstruction that include a physical model for blur and correlated noise in flat-panel cone-beam CT (CBCT) acquisitions. Prospective predictions (e.g., without reconstruction) of local point spread function and and local noise power spectrum (NPS) model are applied, compared, and validated using a flat-panel CBCT test bench. Imaging conditions investigated include two acquisition strategies (an unmodulated X-ray technique and automatic exposure control) as well as varying regularization strength.
Results: Comparisons between prediction and physical measurements show excellent agreement for both spatial resolution and noise properties. In comparison, traditional prediction methods (that ignore blur/correlation found in flat-panel data) fail to capture important data characteristics and show significant mismatch.
Conclusion: Novel image property predictors permit prospective assessment of flat-panel CBCT using MBIR. Such predictors enable standard and task-based performance assessments, and are well-suited to evaluation, control, and optimization of the CT imaging chain (e.g., x-ray technique, reconstruction parameters, novel data acquisition methods, etc.) for improved imaging performance and/or dose utilization.
Methods: We apply a statistical framework that incorporates objective image quality factors such as spatial resolution and image noise combined with a statistical representation of anatomical clutter to predict the root-mean-squared error (RMSE) of transformation parameters in a rigid registration. Model predictions are compared to simulation studies in CT-to-CT slice registration using the cross-correlation (CC) similarity metric.
Results: RMSE predictions are shown to accurately model the impact of dose and soft-tissue clutter on measured RMSE performance. Further, these predictions reveal dose levels at which the registration becomes soft-tissue clutter limited, where further increase provides no improvement in registration performance.
Conclusions: Incorporating tissue deformation into a statistical registration model is an important step in understanding the limits of image registration performance and selecting pertinent registration methods for a particular registration task. The generalized noise model and RMSE analysis provide insight on how to optimize registration tasks with respect to image acquisition protocol (e.g., dose, reconstruction parameters) and registration method (e.g., level of blur).
Methods: The method is initialized with coarse registrations of a set of atlas images to the fixed input image. The initial registrations are then refined separately for the tibia and femur and the best matching atlas is selected. Finally, the anatomical landmarks of the best matching atlas are transformed onto the input image by deforming a surface model of the atlas to fit the shape of the tibial plateau in the input image (a mesh-to-volume registration). We apply the method to weight-bearing volumetric images of the knee obtained from 23 subjects using an extremity cone-beam CT system. Results of the automated algorithm were compared to an expert radiologist for measurements of Static Alignment (SA), Medial Tibial Slope (MTS) and Lateral Tibial Slope (LTS).
Results: Intra-reader variability as high as ~10% for LTS and 7% for MTS (ratio of standard deviation to the mean in repeated measurements) was found for expert radiologist, illustrating the potential benefits of an automated approach in improving the precision of the metrics. The proposed method achieved excellent registration of the atlas mesh to the input volumes. The resulting automated measurements yielded high correlations with expert radiologist, as indicated by correlation coefficients of 0.72 for MTS, 0.8 for LTS, and 0.89 for SA.
Conclusions: The automated method for measurement of anatomical metrics of the tibiofemoral joint achieves high correlation with expert radiologist without the need for time consuming and error prone manual selection of landmarks.
Joint optimization of fluence field modulation and regularization in task-driven computed tomography
Methods: The tradeoffs in dose and image quality were investigated as a function of analytical (FBP) and model-based iterative reconstruction (PWLS) algorithm parameters using phantoms with ICH-mimicking inserts. Image quality in clinical applications was evaluated in a human cadaver imaged with simulated ICH. Objects outside of the field of view (FOV), such as the head-holder, were found to introduce challenging truncation artifacts in PWLS that were mitigated with a novel multi-resolution reconstruction strategy. Following phantom and cadaver studies, the scanner was translated to a clinical pilot study. Initial clinical experience indicates the presence of motion in some patient scans, and an image-based motion estimation method that does not require fiducial tracking or prior patient information was implemented and evaluated.
Results: The weighted CTDI for a nominal scan technique was 22.8 mGy. The high-resolution FBP reconstruction protocol achieved < 0.9 mm full width at half maximum (FWHM) of the point spread function (PSF). The PWLS soft-tissue reconstruction showed <1.2 mm PSF FWHM and lower noise than FBP at the same resolution. Effects of truncation in PWLS were mitigated with the multi-resolution approach, resulting in 60% reduction in root mean squared error compared to conventional PWLS. Cadaver images showed clear visualization of anatomical landmarks (ventricles and sulci), and ICH was conspicuous. The motion compensation method was shown in clinical studies to restore visibility of fine bone structures, such as the subtle fracture, cranial sutures, and the cochlea as well as subtle low-contrast structures in the brain parenchyma.
Conclusion: The imaging performance of the prototype suggests sufficient quality for ICH imaging and motivates continued clinical studies to assess the diagnosis utility of the CBCT system in realistic clinical scenarios at the point of care.
Methods: We implemented a task-driven imaging framework to optimize orbit parameters that maximize detectability index d'. This framework utilizes a specified Fourier domain task function and an analytical model for system spatial resolution and noise. Two experiments were conducted to test the framework. First, a simple task was considered consisting of frequencies lying entirely on the fz-axis (e.g., discrimination of structures oriented parallel to the central axial plane), and a “circle + arc” orbit was incorporated into the framework as a means to improve sampling of these frequencies, and thereby increase task-based detectability. The orbit was implemented on a robotic C-arm (Artis Zeego, Siemens Healthcare). A second task considered visualization of a cochlear implant simulated within a head phantom, with spatial frequency response emphasizing high-frequency content in the (fy, fz) plane of the cochlea. An optimal orbit was computed using the task-driven framework, and the resulting image was compared to that for a circular orbit.
Results: For the fz-axis task, the circle + arc orbit was shown to increase d' by a factor of 1.20, with an improvement of 0.71 mm in a 3D edge-spread measurement for edges located far from the central plane and a decrease in streak artifacts compared to a circular orbit. For the cochlear implant task, the resulting orbit favored complementary views of high tilt angles in a 360° orbit, and d' was increased by a factor of 1.83.
Conclusions: This work shows that a prospective definition of imaging task can be used to optimize source-detector orbit and improve imaging performance. The method was implemented for execution of non-circular, task-driven orbits on a clinical robotic C-arm system. The framework is sufficiently general to include both acquisition parameters (e.g., orbit, kV, and mA selection) and reconstruction parameters (e.g., a spatially varying regularizer).
Methods: The proposed method uses a calibration phantom consisting of multiple line-shaped wire segments. Geometric models relating the 3D line equations of the wires to the 2D line equations of their projections are used as the basis for system geometry estimation. This method was tested using a mobile C-arm CT system and comparisons were made to standard BB-based calibrations. Simulation studies were also conducted using a sinusoid-on-sphere orbit. Calibration performance was quantified in terms of Point Spread Function (PSF) width and back projection error. Visual image quality was assessed with respect to spatial resolution in trabecular bone in an anthropomorphic head phantom.
Results: The wire-based calibration method performed equal to or better than BB-based calibrations in all evaluated metrics. For the sinusoidal scans, the method provided reliable calibration, validating its application to non-circular trajectories. Furthermore, the ability to improve image quality using non-circular orbits in conjunction with this calibration method was demonstrated.
Conclusion: The proposed method has been shown feasible for conventional circular CBCT scans and offers a promising tool for non-circular scan orbits that can improve image quality, reduce dose, and extend field of view.
Method: Geometric calibration of the C-arm was performed offline in two rotational directions (orbit α, orbit β). Patient registration was performed using image-based 3D-2D registration with an initially acquired radiograph of the patient. This approach for patient registration eliminated the requirement for external tracking devices inside the operating room, allowing virtual fluoroscopy using commonly available systems in fluoroscopically guided procedures within standard surgical workflow. Geometric accuracy was evaluated in terms of projection distance error (PDE) in anatomical fiducials. A pilot study was conducted to evaluate the utility of virtual fluoroscopy to aid C-arm positioning in image guided surgery, assessing potential improvements in time, dose, and agreement between the virtual and desired view.
Results: The overall geometric accuracy of DRRs in comparison to the actual radiographs at various C-arm positions was PDE (mean ± std) = 1.6 ± 1.1 mm. The conventional approach required on average 8.0 ± 4.5 radiographs spent “fluoro hunting” to obtain the desired view. Positioning accuracy improved from 2.6o ± 2.3o (in α) and 4.1o ± 5.1o (in β) in the conventional approach to 1.5o ± 1.3o and 1.8o ± 1.7o, respectively, with the virtual fluoroscopy approach.
Conclusion: Virtual fluoroscopy could improve accuracy of C-arm positioning and save time and radiation dose in the operating room. Such a system could be valuable to training of fluoroscopy technicians as well as intraoperative use in fluoroscopically guided procedures.
Methods: To establish such a framework, we derived Cramer-Rao lower bounds (CRLB) for registration accuracy, revealing the underlying dependencies on image variance and gradient strength. The CRLB was analyzed as a function of image quality factors (in particular, dose) for various similarity metrics and compared to registration accuracy using CT images of an anthropomorphic head phantom at various simulated dose levels. Performance was evaluated in terms of root mean square error (RMSE) of the registration parameters.
Results: Analysis of the CRLB shows two primary dependencies: 1) noise variance (related to dose); and 2) sum of squared image gradients (related to spatial resolution and image content). Comparison of the measured RMSE to the CRLB showed that the best registration method, RMSE achieved the CRLB to within an efficiency factor of 0.21, and optimal estimators followed the predicted inverse proportionality between registration performance and radiation dose.
Conclusions: Analysis of the CRLB for image registration is an important step toward understanding and evaluating an intraoperative imaging system with respect to a registration task. While the CRLB is optimistic in absolute performance, it reveals a basis for relating the performance of registration estimators as a function of noise content and may be used to guide acquisition parameter selection (e.g., dose) for purposes of intraoperative registration.
Method: The method, called MIND Demons, solves for the deformation field between two images by optimizing an energy functional that incorporates both the forward and inverse deformations, smoothness on the velocity fields and the diffeomorphisms, a modality-insensitive similarity function suitable to multi-modality images, and constraints on geodesics in Lagrangian coordinates. Direct optimization (without relying on an exponential map of stationary velocity fields used in conventional diffeomorphic Demons) is carried out using a Gauss-Newton method for fast convergence. Registration performance and sensitivity to registration parameters were analyzed in simulation, in phantom experiments, and clinical studies emulating application in image-guided spine surgery, and results were compared to conventional mutual information (MI) free-form deformation (FFD), local MI (LMI) FFD, and normalized MI (NMI) Demons.
Result: The method yielded sub-voxel invertibility (0.006 mm) and nonsingular spatial Jacobians with capability to preserve local orientation and topology. It demonstrated improved registration accuracy in comparison to the reference methods, with mean target registration error (TRE) of 1.5 mm compared to 10.9, 2.3, and 4.6 mm for MI FFD, LMI FFD, and NMI Demons methods, respectively. Validation in clinical studies demonstrated realistic deformation with sub-voxel TRE in cases of cervical, thoracic, and lumbar spine.
Conclusions: A modality-independent deformable registration method has been developed to estimate a viscoelastic diffeomorphic map between preoperative MR and intraoperative CT. The method yields registration accuracy suitable to application in image-guided spine surgery across a broad range of anatomical sites and modes of deformation.
Methods: Experiments involved a cone-beam CT (CBCT) bench system, a robotic C-arm, and three phantoms. A robust 3D-2D registration process was used to compute the 9 degree of freedom (DOF) transformation between each projection and an existing 3D image by maximizing normalized gradient information with a digitally reconstructed radiograph (DRR) of the 3D volume. The quality of the resulting “self-calibration” was evaluated in terms of the agreement with an established calibration method using a BB phantom as well as image quality in the resulting CBCT reconstruction.
Results: The self-calibration yielded CBCT images without significant difference in spatial resolution from the standard (“true”) calibration methods (p-value >0.05 for all three phantoms), and the differences between CBCT images reconstructed using the “self” and “true” calibration methods were on the order of 10-3 mm-1. Maximum error in magnification was 3.2%, and back-projection ray placement was within 0.5 mm.
Conclusion: The proposed geometric “self” calibration provides a means for 3D imaging on general noncircular orbits in CBCT systems for which a geometric calibration is either not available or not reproducible. The method forms the basis of advanced “task-based” 3D imaging methods now in development for robotic C-arms.
Methods. Using fast, robust 3D-2D registration in combination with 3D models of known components (surgical devices), the 3D pose determination was solved to relate known components to 2D projection images and 3D preoperative CT in near-real-time. Exact and parametric models of the components were used as input to the algorithm to evaluate the effects of model fidelity. The proposed algorithm employs the covariance matrix adaptation evolution strategy (CMA-ES) to maximize gradient correlation (GC) between measured projections and simulated forward projections of components. Geometric accuracy was evaluated in a spine phantom in terms of target registration error at the tool tip (TREx), and angular deviation (TREΦ) from planned trajectory.
Results. Transpedicle surgical devices (probe tool and spine screws) were successfully guided with TREx<2 mm and TREΦ <0.5° given projection views separated by at least >30° (easily accommodated on a mobile C-arm). QA of the surgical product based on 3D-2D registration demonstrated the detection of pedicle screw breach with TREx<1 mm, demonstrating a trend of improved accuracy correlated to the fidelity of the component model employed.
Conclusions. 3D-2D registration combined with 3D models of known surgical components provides a novel method for near-real-time guidance and quality assurance using a mobile C-arm without external trackers or fiducial markers. Ongoing work includes determination of optimal views based on component shape and trajectory, improved robustness to anatomical deformation, and expanded preclinical testing in spine and intracranial surgeries.
A clinical pilot study of a modular video-CT augmentation system for image-guided skull base surgery