|
1.IntroductionOver the last decade, extensive progress has been made in diffuse optics toward developing quantitative, wide field, rapid, and inexpensive methods to visualize the physiological properties of living tissues. Among the numerous approaches proposed in this direction, the most recent ones rely on the spatial modulation of the light and processing in the frequency domain.1–3 Spatial frequency-domain imaging (SFDI) techniques allow the measurement of tissues absorption and reduced scattering optical properties over an entire image at once, which are used to retrieve physiological tissues parameters.4–10 However, major limitations of such imaging system include the necessity to project several patterns of light and to illuminate sequentially at several wavelengths to extract physiological parameters, impeding the use of such technology for real-time imaging. To increase the speed of acquisition, some approaches have proposed to reduce the number of projected patterns.11–14 Methods, such as single-snapshot imaging of optical properties (SSOP), make use of a single pattern of light,11,12 and the combination of this method with temporal encoding of the wavelengths has been proposed to achieve rapid multispectral acquisitions.15,16 However, these approaches still make use of standard camera-based technology such as complementary metal–oxide–semiconductor (CMOS) or charge-coupled device (CCD) sensors that are generally expensive, monochromatic, limited in dynamic range, and importantly are limiting for multi- and hyperspectral imaging configurations. In front of these limitations, compressive optics is a promising alternative to conventional imaging for diffuse optics. In particular, single-pixel cameras (SPCs) exhibit increased sensitivity and higher dynamic range due to efficient electronic designed for high-end photodiode or single-photon detector,17 as well as low-cost multispectral imaging capabilities.18–21 In this paper, we explore numerically, using real SSOP data, the possibilities and limitations offered by compressive optics for real-time implementation using SSOP associated to an SPC (Fig. 1). In particular, we compressed existing SSOP data using compressive optics algorithms to evaluate the accuracy in extracting optical properties and the theoretical acquisition time required as a function of the compression rate of the SPC acquisition. 2.Materials and Methods2.1.Single-Snapshot Imaging of Optical PropertiesThe standard SFDI method requires to acquire several images of the scene sequentially at two different spatial frequencies (e.g., and ) and three different phases (0 deg, 120 deg, and 240 deg) to obtain the modulation amplitude of each spatial frequency.3 In comparison, the SSOP method requires the acquisition of a single image and relies on filtering in the Fourier domain to extract the amplitude modulation at two spatial frequencies: and the projected spatial frequency (e.g., ). From these measurements, diffuse reflectances at these spatial frequencies are obtained by calibration using a phantom with known optical properties.3 The measured diffuse reflectances allow to extract the absorption as well as the reduced scattering properties from a precomputed look-up table.24,25 2.2.Compressed SensingAn SPC is an experimental setup that can measure the dot product of a scene and some user-defined pattern. See Ref. 26 for a review of this approach. The key idea is to acquire by hardware a compressed version of the scene by measuring where represents the image of the scene, represents the pattern that is loaded on the spatial light modulator, and denotes the number of pixels of the spatial light modulator.The image can be recovered by postprocessing a collection of measurements , , obtained for different patterns , where represents the number of patterns. Let be the measurement vector and be the measured patterns. Assuming that the measurement vector is a compressed version of the scene, we estimate the scene by the least-squares method: for which fast implementations are available.27 In this paper, we choose the patterns as Daubechie wavelets with four vanishing moments, which is a common choice in image compression.27 The wavelet patterns to acquire are determined iteratively during acquisition according to the adaptive basis scan wavelet prediction strategy described in Ref. 28.The number of pattern is an acquisition parameter. Large numbers of patterns lead to high image quality but long acquisitions. We define the acquisition compression ratio (in %) as: 2.3.Data Processing and Results AnalysisTo evaluate the performances of an SSOP-SPC system, we acquired a set of hand images at multiple spatial frequencies (, 0.1, 0.2, 0.3, and ) at a wavelength of 665 nm and three evenly distributed phases (SFDI acquisition).29 This range of spatial frequencies was chosen for investigating the trade-off between compression ratio and image quality, in the context of SSOP-SPC.30 Then, we compressed a single-phase image from the set of images acquired with SFDI to simulate the acquisition of a single SSOP image by an SPC, with increasing compression ratios of 0%, 50%, 90%, 98%, 99%, and 99.5% using the adaptive basic scan described above with . The resulting images are shown in Fig. 2. Each of the simulated SSOP-SPC images was then processed using the SSOP method to extract the absorption and reduced scattering maps. The SSOP-SPC approach was evaluated by comparing the absorption and reduced scattering maps recovered from the original SFDI images and from the SSOP-SPC images. This comparison was done by measuring the mean percentage error in absorption and reduced scattering over a region of interest (see Fig. 3) given by the following equation: where are the image pixel size and represents either or . We also computed the theoretical SPC acquisition time according to: where (in kHz) represents the digital micromirror device refresh rate, set to 20 kHz.3.ResultsThe results of the absorption and reduced scattering coefficient recovered by the SFDI method and by the SSOP-SPC method at the different compression rates are shown in Figs. 3 and 4, respectively. These figures make it possible to visually assess the qualitative degradation of the images extracted based on different compression rates and the change in reduced scattering due to the more superficial measurement when the spatial frequency is increasing. Results quantifying the mean and standard deviation percentage error in absorption and reduced scattering are presented in Tables 1 and 2, respectively. These tables show the average percent error based on the compression rate at each spatial frequency projected. Bold values are the results similar to the SFDI reference measurement. Overall, good results (i.e., without major difference in errors compared to the 0% compression rate results) can be obtained with 99.5% compression rate at , 99% compression rate at , and 90% compression rate at . The method is not usable without significant inaccuracies for . Table 1Mean and standard deviation percentage error in absorption.
Note: Bold values are the results similar to the SFDI reference measurement. Table 2Mean and standard deviation percentage error in reduced scattering.
Note: Bold values are the results similar to the SFDI reference measurement. These tables also shows that best overall performances indicated by the lowest mean percentage error are obtained with a spatial frequency of . Overall, the bold values show almost constant mean percentage error for one given spatial frequency that could be used to perform SSOP imaging with an SPC. Results of minimum theoretical acquisition time are reported in Table 3 using a 20-kHz DMD with a single photodetector synchronized with the DMD refresh rate (i.e., acquisition time of ). Logically, acquisition time decreases with compression rate and is not dependent on the spatial frequency of patterns projected on the scene. In summary, best overall performance in both acquisition time and accuracy, shown in bold fonts, are obtained at 99% compression rate with and a resulting acquisition time 520 ms. Table 3Minimum theoretical acquisition time in second.
Note: Bold values are the results similar to the SFDI reference measurement. 4.DiscussionIn this study, we evaluated the potential of using an SPC in an SSOP system. To this end, images were acquired on an experimental SFDI system at different spatial frequencies and compressed at different compression rates according to the adaptive basis scan wavelet prediction strategy. These images were then processed using the SSOP processing method to extract their optical properties. Finally, these results were compared to the SFDI processing results on the original images. In summary, this study shows that at spatial frequencies of 0.1 and optical properties can be extracted accurately with a 99% compression rate resulting in a 520-ms theoretical acquisition time. When adding the constraint for a good quality image, SSOP-SPC imaging can be performed optimally at with a compression rate of 99%. At higher spatial frequencies, while better precision in extracting optical properties and improved image quality can be obtained at low compression rates, degradations at higher compression rates significantly impacts the precision of the extracted optical properties, limiting its potential for fast imaging. This study highlights the trade-off that exists between the choice of the spatial frequency used for acquisition and the capacity for the SSOP-SPC method to perform in real time. As evidenced through the results, the choice of the spatial frequency has naturally a direct consequence on the image quality when using SSOP. Decreasing spatial frequency in SSOP-SPC allows faster acquisition but results in image degradation.30 This study reveals that more technological progress is necessary for using SSOP with an SPC in real time. Using the current technology (20-kHz DMD), 520-ms acquisition time is obtained at 99% compression rate when a scientific CMOS camera can reach up to 200 frames per second (i.e., 5-ms acquisition time), nearly a 100-fold difference. In addition, at a spatial frequency of , where best precision is obtained, it would take 5.24 s of acquisition time at 90% of compression rate. It is clear that faster spatial light modulator technology is required to be able to use the SSOP-SPC method in real time. Despite this limitation, it is important to remember a few points. First, an SPC is potentially more sensitive than the conventional CMOS or CCD cameras in the near-infrared, a wavelength band that is regularly used in diffuse optics. It will, therefore, not be necessary to increase the exposure time as much as with a conventional camera. Second, the main interest in using a single-pixel architecture is the potential for multi- or hyperspectral measurements. Current SFDI hyperspectral measurements typically require tunable filters, filter wheel, and sequential acquisition on a single camera or a hyperspectral camera.10,31–34 None of these technologies is either cost-effective or allows real-time measurement. A single-pixel architecture can easily scale to several wavelengths by replacing the photosensor in SPC with line array of photosensors. 5.ConclusionIn this paper, we explore the possibilities and limitations offered by compressive optics for real-time implementation using SSOP associated to an SPC. In particular, we evaluate the accuracy in extracting optical properties and the theoretical acquisition time required as a function of the compression rate of the SPC acquisition. The results show that usable optical properties with errors in absorption and 5% in reduced scattering can be extracted at a spatial frequency of with a compression rate of 99% resulting in a 520-ms acquisition time. This work contributes to the exploration of the benefits of SPC in the development of diffuse optical imaging. AcknowledgmentsFunding for this research was provided by the European Research Council (ERC) under the European Union’s Horizon 2020 Research and Innovation Program under Grant Agreement No. 715737 (QuantSURG); France Life Imaging WP3, the French program “Investissement d’Avenir” run by the “Agence Nationale de la Recherche” under Grant Agreement No. ANR-11-INBS-006; the University of Strasbourg IdEx; and the ICube Laboratory. ReferencesN. Dognitz and G. Wagnieres,
“Determination of tissue optical properties by steady-state spatial frequency-domain reflectometry,”
Lasers Med. Sci., 13
(1), 55
–65
(1998). https://doi.org/10.1007/BF00592960 Google Scholar
D. J. Cuccia et al.,
“Quantitation and mapping of tissue optical properties using modulated imaging,”
J. Biomed. Opt., 14
(2), 024012
(2009). https://doi.org/10.1117/1.3088140 JBOPFO 1083-3668 Google Scholar
J. P. Angelo et al.,
“Review of structured light in diffuse optical imaging,”
J. Biomed. Opt., 24
(7), 071602
(2018). https://doi.org/10.1117/1.JBO.24.7.071602 JBOPFO 1083-3668 Google Scholar
A. Mazhar et al.,
“Spatial frequency domain imaging of port wine stain biochemical composition in response to laser therapy: a pilot study,”
Lasers Surg. Med., 44
(8), 611
–621
(2012). https://doi.org/10.1002/lsm.22067 LSMEDI 0196-8092 Google Scholar
A. M. Laughney et al.,
“Spectral discrimination of breast pathologies in situ using spatial frequency domain imaging,”
Breast Cancer Res., 15
(4), R61
(2013). https://doi.org/10.1186/bcr3455 BCTRD6 Google Scholar
J. T. Nguyen et al.,
“A novel pilot study using spatial frequency domain imaging to assess oxygenation of perforator flaps during reconstructive breast surgery,”
Ann. Plast. Surg., 71
(3), 308
–315
(2013). https://doi.org/10.1097/SAP.0b013e31828b02fb APCSD4 Google Scholar
U. Sunar et al.,
“Quantification of PpIX concentration in basal cell carcinoma and squamous cell carcinoma models using spatial frequency domain imaging,”
Biomed. Opt. Express, 4
(4), 531
–537
(2013). https://doi.org/10.1364/BOE.4.000531 BOEICL 2156-7085 Google Scholar
III D. M. McClatchy et al.,
“Wide-field quantitative imaging of tissue microstructure using sub-diffuse spatial frequency domain imaging,”
Optica, 3
(6), 613
–621
(2016). https://doi.org/10.1364/OPTICA.3.000613 Google Scholar
S. Nandy et al.,
“Characterizing optical properties and spatial heterogeneity of human ovarian tissue using spatial frequency domain imaging,”
J. Biomed. Opt., 21
(10), 101402
(2016). https://doi.org/10.1117/1.JBO.21.10.101402 JBOPFO 1083-3668 Google Scholar
M. Ghijsen et al.,
“Quantitative real-time optical imaging of the tissue metabolic rate of oxygen consumption,”
J. Biomed. Opt., 23
(3), 036013
(2018). https://doi.org/10.1117/1.JBO.23.3.036013 JBOPFO 1083-3668 Google Scholar
J. Vervandier and S. Gioux,
“Single snapshot imaging of optical properties,”
Biomed. Opt. Express, 4
(12), 2938
–2944
(2013). https://doi.org/10.1364/BOE.4.002938 BOEICL 2156-7085 Google Scholar
M. van de Giessen, J. P. Angelo and S. Gioux,
“Real-time, profile-corrected single snapshot imaging of optical properties,”
Biomed. Opt. Express, 6
(10), 4051
–4062
(2015). https://doi.org/10.1364/BOE.6.004051 BOEICL 2156-7085 Google Scholar
K. P. Nadeau, A. J. Durkin and B. J. Tromberg,
“Advanced demodulation technique for the extraction of tissue optical properties and structural orientation contrast in the spatial frequency domain,”
J. Biomed. Opt., 19
(5), 056013
(2014). https://doi.org/10.1117/1.JBO.19.5.056013 JBOPFO 1083-3668 Google Scholar
Z. R. Hoffman and C. A. DiMarzio,
“Single-image structured illumination using Hilbert transform demodulation,”
J. Biomed. Opt., 22
(5), 056011
(2017). https://doi.org/10.1117/1.JBO.22.5.056011 JBOPFO 1083-3668 Google Scholar
M. B. Applegate and D. Roblyer,
“High-speed spatial frequency domain imaging with temporally modulated light,”
J. Biomed. Opt., 22
(7), 076019
(2017). https://doi.org/10.1117/1.JBO.22.7.076019 JBOPFO 1083-3668 Google Scholar
E. Aguenounon et al.,
“Real time hyperspectral imaging using high frame rate video camera and GPGPU processing,”
in SIGNAL, Third Int. Conf. Adv. Signal, Image and Video Process.,
(2018). Google Scholar
R. H. Hadfield,
“Single-photon detectors for optical quantum information applications,”
Nat. Photonics, 3
(12), 696
–705
(2009). https://doi.org/10.1038/nphoton.2009.230 NPAHBY 1749-4885 Google Scholar
M. Torabzadeh et al.,
“Compressed single pixel imaging in the spatial frequency domain,”
J. Biomed. Opt., 22
(3), 030501
(2017). https://doi.org/10.1117/1.JBO.22.3.030501 JBOPFO 1083-3668 Google Scholar
A. Farina et al.,
“Multiple-view diffuse optical tomography system based on time-domain compressive measurements,”
Opt. Lett., 42
(14), 2822
–2825
(2017). https://doi.org/10.1364/OL.42.002822 OPLEDP 0146-9592 Google Scholar
Q. Pian, R. Y. Yao and X. Intes,
“Hyperspectral wide-field time domain single-pixel diffuse optical tomography platform,”
Biomed. Opt. Express, 9
(12), 6258
–6272
(2018). https://doi.org/10.1364/BOE.9.006258 BOEICL 2156-7085 Google Scholar
F. Rousset et al.,
“Time-resolved multispectral imaging based on an adaptive single-pixel camera,”
Opt. Express, 26
(8), 10550
–10558
(2018). https://doi.org/10.1364/OE.26.010550 OPEXFF 1094-4087 Google Scholar
S. Belanger et al.,
“Real-time diffuse optical tomography based on structured illumination,”
J. Biomed. Opt., 15
(1), 016006
(2010). https://doi.org/10.1117/1.3290818 JBOPFO 1083-3668 Google Scholar
M. Ochoa et al.,
“Assessing patterns for compressive fluorescence lifetime imaging,”
Opt. Lett., 43
(18), 4370
–4373
(2018). https://doi.org/10.1364/OL.43.004370 OPLEDP 0146-9592 Google Scholar
J. Angelo et al.,
“Ultrafast optical property map generation using lookup tables,”
J. Biomed. Opt., 21
(11), 110501
(2016). https://doi.org/10.1117/1.JBO.21.11.110501 JBOPFO 1083-3668 Google Scholar
S. Panigrahi and S. Gioux,
“Machine learning approach for rapid and accurate estimation of optical properties using spatial frequency domain imaging,”
J. Biomed. Opt., 24
(7), 071606
(2018). https://doi.org/10.1117/1.JBO.24.7.071606 JBOPFO 1083-3668 Google Scholar
M. F. Duarte et al.,
“Single-pixel imaging via compressive sampling,”
IEEE Signal Process. Mag., 25
(2), 83
–91
(2008). https://doi.org/10.1109/MSP.2007.914730 ISPRE6 1053-5888 Google Scholar
I. Daubechies, Ten Lectures on Wavelets, Society for Industrial and Applied Mathematics, Philadelphia, Pennsylvania
(1992). Google Scholar
F. Rousset et al.,
“Adaptive basis scan by wavelet prediction for single-pixel imaging,”
IEEE Trans. Comput. Imaging, 3
(1), 36
–46
(2017). https://doi.org/10.1109/TCI.2016.2637079 Google Scholar
M. Schmidt et al.,
“Real-time, wide-field, and quantitative oxygenation imaging using spatiotemporal modulation of light,”
J. Biomed. Opt., 24
(7), 071610
(2019). https://doi.org/10.1117/1.JBO.24.7.071610 JBOPFO 1083-3668 Google Scholar
E. Aguenounon et al.,
“Single snapshot of optical properties image quality improvement using anisotropic 2D windows filtering,”
J. Biomed. Opt., 24
(7), 071611
(2019). https://doi.org/10.1117/1.JBO.24.7.071611 JBOPFO 1083-3668 Google Scholar
J. R. Weber et al.,
“Multispectral imaging of tissue absorption and scattering using spatial frequency domain imaging and a computed-tomography imaging spectrometer,”
J. Biomed. Opt., 16
(1), 011015
(2011). https://doi.org/10.1117/1.3528628 JBOPFO 1083-3668 Google Scholar
S. Gioux et al.,
“First-in-human pilot study of a spatial frequency domain oxygenation imaging system,”
J. Biomed. Opt., 16
(8), 086015
(2011). https://doi.org/10.1117/1.3614566 JBOPFO 1083-3668 Google Scholar
A. Mazhar et al.,
“Implementation of an LED-based clinical spatial frequency domain imaging system,”
Proc. SPIE, 8254 82540A
(2012). https://doi.org/10.1117/12.909813 PSISDG 0277-786X Google Scholar
M. Ghijsen et al.,
“Real-time simultaneous single snapshot of optical properties and blood flow using coherent spatial frequency domain imaging (cSFDI),”
Biomed. Opt. Express, 7
(3), 870
–882
(2016). https://doi.org/10.1364/BOE.7.000870 BOEICL 2156-7085 Google Scholar
BiographyFoudil Dadouche received his engineering degree from the University of Sciences and Technology of Oran, Algeria, and his electronic master’s and PhD degrees from the University of Pierre and Marie Curie (Paris VI). He joined the University of Strasbourg as an associate professor in 2010. He is member of the ICube Laboratory. His main research interests include imaging systems, digital electronics, and photovoltaics. Nicolas Ducros received his MSc in electrical engineering and MSc in biomedical engineering, both from the University of Strasbourg, France, in 2006. He obtained his PhD in electrical engineering from the University of Lyon, in 2009. After a postdoctoral fellowship at Politecnico Milan, he became an associate professor at the University of Lyon with the Biomedical Imaging Laboratory CREATIS. His research interests include image processing and inverse problems. |