Coded aperture snap shot spectral imager (CASSI) is a potential method to get hyperspectral images. One of the latest designs of CASSI is a dual-camera design, which adds a grayscale camera to capture the same scene. In this paper, an improved method based on two-step iterative shrinkage thresholding algorithms (TwIST) is proposed to utilize the images containing the information of the structure of the objects from the grayscale camera more efficiently. The information come from the auxiliary camera and the CASSI detector is used to construct an estimated 3D hyperspectral data. Then we use TwIST and TV regularization to reconstruct the residual image based on the residual data. The final reconstructed hyperspectral image equals the sum of the estimated image and the reconstruct residual image. This method ensures that the result is more similar to the structure of the original image. The simulation results show that our method improves the image quality of the reconstructed hyperspectral images for all the data we have tried. The simulation results show that our method improves the image quality of the reconstructed hyperspectral images and use less run time compared to the original method. The corresponding peak signal-to-noise ratio (PSNR) is increased by 8.99 dB. The structural similarity (SSIM) is increased by 0.0757. The spectrum angular mapper (SAM) is reduced by 0.1987.
In recent years, Augmented reality (AR) technology has gained great attention. One critical component of AR devices is the see-through optical combiner. Several approaches have been proposed, such as using either refractive, reflective, diffractive, holographic optics, or a combination of them. Meta-surfaces can realize the design of more required optical element due to its superb abilities of controlling the amplitude, phase, polarization or other parameters of wave-front at subwavelength scale. Thus, we proposed a waveguide coupler based on a polarization independent doublet meta-surface, which can realize field of view (FOV) to 50° at the wavelength of 638 nm. Compare to the diffractive grating based optical combiner architecture, our doublet meta-surfaces improve the problem of FOV limited by the refractive index of the waveguide and uneven brightness in AR display devices. The polarization independent doublet meta-surfaces presented in this paper can provide a large phase mutation rate to achieve a large deflection angle. The meta-surfaces consist of a group of Silicon nanofins with different side length, but same height arranged on a rectangle glass substrate lattice with the reflection index of 1.764. Each unit structure has different electromagnetic responses to plane electromagnetic waves with different incident angles. By designing the shape and size of each silicon nanorods and other parameters, the phase and amplitude modulation we need can be achieved. Here we only consider one-dimensional eye-box expansion at a single wavelength. The design approach can be generalized to two-dimensional eye-box expansion. Besides, full-color display can be achieved by coordination of the coupling-in and coupling-out device in waveguides.
Designing a general method of freeform optics for illuminating hard-to-reach areas is a challenging but rewarding issue. Most of the current designs of freeform illumination optics are valid in the applications in which the region of interest is easily accessible. However, there are some applications in which the region of interest is inaccessible due to the obstacles that cannot be removed and high-quality illumination is still needed (this is usually the case in endoscopic lighting). In this paper, we present a general formulation of designing freeform lenses for illuminating hard-to-reach areas. In this method, the freeform lens consists of two elaborately designed surfaces, by which both the irradiance distribution and wave-front of the light beam are manipulated in a desired manner. The light beam after refraction by the freeform lens is further guided through a light-guiding system to produce a prescribed illumination on a target plane which is inaccessible. Here, the light-guiding system can be a light-guiding element [e.g., a gradient refractive index (GRIN) lens] or an optical system that consists of several optical components. The properties of the light-guiding system are taken into account in the tailoring of the freeform lens profiles to guarantee the prescribed illumination on the target plane. The result shows that the design of freeform optics for illuminating hard-to-reach areas in the presence of a light-guiding system can still be formulated into an Monge–Ampère equation (MA) with a nonlinear boundary condition. Two examples are given to demonstrate the elegance of this method in designing freeform optics for illuminating hard-to-reach areas.
Spectral imaging can capture both spatial and spectral data of a scene, providing an efficient technique for analysis and identification. To improve the efficiency of data acquisition, compressive sensing (CS) methods have been introduced into spectral imaging systems. In this work, we propose a novel macropixel segmentation method to realize effective and non-mechanical single-pixel multispectral imaging. A series of macropixel-based patterns are designed to modulate data cube of target object. Spatial light modulator (SLM) and multispectral filter array are utilized to generate such patterns. CS algorithm is used to recover data cube from 1-D signal acquired by a single-pixel detector. Alignment of binary patterns with the subareas of macropixel filter array is conducted in the experimental set-up. Without mechanical or dispersive structure, the proposed method holds great potential in miniaturization and integration of spectral imaging devices.
Fourier ptychographic microscopy (FPM) is a recently developed computational imaging technology, which can bypass the limitation of optical-spatial-bandwidth product to achieve imaging with both high resolution and wide field-of-view. Original FPM setup is limited to image thin samples with angle-varied illuminations. A diffuser scanning FPM method, which scans a diffuser with unknown profile between the object and objective lens to modulate the complex exit wavefront of the object, is implemented to address this 3D refocusing problem. However, since the profile of the diffuser is unknown, the number of images required for method to converge is large. A mechanical translation stage is also required, which may introduce the systematic error of the position. In this paper, we propose a new FPM method with wavefront modulation imposed by spatial light modulator (SLM). The SLM is placed between the object and the objective lens to produce specific pattern profile, which is used to modulate the complex exit wavefront of the object. Fourier ptychographic phase retrieval process is employed to recovery the complex exit wavefront of the object. With the use of SLM, it is unnecessary to employ 2D motorized translation stage to move the imposed pattern profile so that the error of translation stage is eliminated. Moreover, since the imposed pattern profile is known, the number of images required for the algorithm to converge is reduced. Simulation and experiment are performed to validate the effectiveness of our proposed method. Compared with the method, which utilizes unknown diffuser, our method can achieve a more accurate reconstruction result with a faster data acquisition and higher convergence speed.
Fourier ptychographic microscopy (FPM) is a recently developed computational imaging technology, which achieves high-resolution imaging with a wide filed-of-view by overcoming the limitation of the optical spatial-bandwidth-product (SBP). In the traditional FPM system, the aberration of the optical system is ignored, which may significantly degrade the reconstruction results. In this paper, we propose a novel FPM reconstruction method based on the forward neural network models with aberration correction, termed FNN-AC. Zernike polynomials are used to indicate the wavefront aberration in our method.Both the spectrum of the sample and coefficients of different Zernike modes are treated as the learnable weights in the trainable layers.By minimizing the loss function in the training process, the coefficients of different Zernike modes can be trained, which can be used to correct the aberration of the optical system. Simulation has been performed to verify the effectiveness of the FNN-AC.
Metasurface optical elements such as metalenses have drawn great attentions for their capabilities of manipulating wavefront versatilely and miniaturizing traditional optical devices into ultrathin counterparts, and multi-functional metasurfaces such as bifocal metalenses have attracted tremendous interests due to their potential in system integration. In this paper, an approach to design polarization-dependent bifocal metalenses which are able to independently generate longitudinally or transversely bifocal spots under the incidence of circularly polarized light with arbitrary ellipticity is proposed and demonstrated by full-wave simulations. When the designed devices are illuminated with elliptically polarized lights at wavelength of 532 nm, both of the helicity-multiplexed bifocal spots appear simultaneously, and the relative intensity of both focal spots can be tuned in terms of the ellipticity of the polarization state. In addition, a polarization-independent metalens based on geometric phase modulation is illustrated and the focusing efficiency of it maintains stable ignoring the polarization state of the incident waves, which could be of vital importance in real applications. This design is of enormous potential of being applied in real compact optical systems such as imaging, display, microscopy, tomography, optical data storage and so on.
The optical combiner is an important part of the optical see-through augmented reality display system. Waveguide is an appropriate solution due to its advantages such as light weight and compact structure. Because grating has replicability, it is a promising solution to the waveguide’s coupler for mass-production. In this paper, a grating coupler for waveguide is designed by using the rigorous coupled wave analysis (RCWA) to increase the accuracy of the simulation due to the critical dimension is similar to the wavelength. The uniformity of the diffraction efficiency is considered as an important parameter for a better displaying performance. The downhill algorithm is used to optimize the parameters of the grating. In order to obtain a large field of view, the thickness of the grating should be controlled carefully. Finally, two gratings are designed for the waveguide which can extend pupil horizontally. The displaying performance of the waveguide is simulated, and the grating couplers are fabricated by the nanoimprint lithography method. The characteristics of the gratings are tested such as transmittance and diffraction efficiency. The results show the proposed gratings can be utilized for waveguide’s coupler. It is believed that our results will give a better alternative for the augmented reality display system.
In compressive spectral imaging, three-dimensional spatio-spectral data cubes are recovered from two-dimensional projections. The quality of the compressive-sensing-based reconstruction is dependent on the coherence of the sensing matrix, which is determined by the system projection and the sparse prior. Studies on the optimization of the system projection, which mainly deals with the coded aperture, successfully decreases the coherence of the sensing matrix and improves the reconstruction quality. However, the optimization of the sparse prior considering the relationship between the system projection and the sparse prior remains a challenge. In this paper, we propose a gradient-descent-based sparse prior optimization algorithm for the coherence minimization of the sensing matrix in compressive spectral imaging. The Frobenius norm coherence is introduced as the cost function for the optimization, and the overcomplete dictionary is chosen as the sparse prior to solve the optimal sparse representation in the reconstruction as it provides higher degree of freedom for optimization compared to common orthogonal bases. The optimized dictionary effectively decreases the coherence of the sensing matrix from 0.880 to 0.604 and significantly improves the quantitative image quality metrics of the reconstructed hyperspectral images with the corresponding peak signal-to-noise ratio (PSNR) increased by 9 dB, the structural similarity (SSIM) above 0.98, and the spectrum angular mapper (SAM) below 0.1. Furthermore, the requirement of the sampling snapshots is reduced, which is shown by similar image quality metrics between the reconstructed hyperspectral images of only 1 snapshot with the optimized dictionary and of more than 5 snapshots with the non-optimized dictionary.
Artificial neural networks are computational models enlightened by biological neural networks, playing a significant role in image recognition, language translation and computer vision fields, etc. In this paper, we propose a fully optical neural network based on programmable nanophotonic processor (PNP) to realize digit recognition. The architecture includes 4 layers cascaded Mach–Zehnder interferometers (MZIs), which could theoretically execute matrix functions corresponding to a two-layer fully connected ANN with four inputs. We simulate cascaded MZIs and adjust phase shifters to match weight matrices calculated by ANN in computer beforehand. The accuracy of 4-class handwritten digits in ONN is 80.29% due to the compressed input data. The accuracy of 10-class digits could achieve 99.23% when the input node merely increases to 36. The results demonstrate the handwritten digits could be recognized effectively through PNP in ONN and the construction of PNP could be extended for more complex recognition systems.
To obtain surreal and richer visual experience, augmented reality (AR) technology has been widely used in various areas. As a popular solution of AR, display using computer generated hologram (CGH) is often accompanied by blurring which is caused by uncontrolled interference. In this paper, a modified algorithm based on double-phase hologram (DPH) algorithm is proposed to reduce speckle noise in holographic reconstruction. The macro-pixels in the original hologram are separated into multiple sub-holograms, and these sub-holograms are displayed alternately in high frequency, which reduces the speckle noise generated from the interference between adjacent macro-pixels. Meanwhile, the method is less time-consuming than the traditional Gerchberg-Saxton algorithm because no iteration is needed. The simulation and the optical experiment based on liquid crystal on silicon (LCoS) have been conducted, and the results confirm the feasibility of the proposed method to improve the image quality.
Convolutional neural networks (CNNs) is becoming a critical role for deep learning-based computer vision applications. Through CNN we can extract meaningful information out of massive sensor data. Vision applications use this information to analyze the mainstream trends of the data and take immediate action based on these trends. However, CNN's energy consumption and bandwidth limitations make it difficult for CNN network systems to deploy in mobile systems with stringent energy limits. In this paper, we explore the simulation and the hardware method of optical convolution for low power image processing, which is inspired by the bio-image sensor Angle sensitive pixel (ASP). This optical computation method may be used to substitute the first convolution layer of the CNN network due to its energy-saving features and speed of light processing time. We adopt two-layer of customized transmission grating to perform this optical convolution computing. By generating the Talbot effect, the two-layer grating structure can perform optical convolution computation using Gabor wavelet filters, which will cause zero electrical power. We demonstrate both simulation and experiment results for optical convolution through our algorithm and prototype system, the convolution results can extract different meaningful information about the original image, which is very similar to edge filtering. This optical operation will hopefully be used to replace the first convolution layer of CNN since it can effectively reduce both the consumption of the energy power and the performing time.
We report an approach to enhance the resolution of the microscopy imaging by using the fourier ptychographic microscopy (FPM) method with a laser source and Spatial Light Modulator (SLM) to generate modulated sample illumination. The performance of the existed FPM system is limited by low illumination efficiency of the LED array. In our prototype setup, digital micromirror device (DMD) is introduced to replace the LED array as a reflective spatial light modulator and is placed at the front focal plane of the 4F system. A ring pattern sample illumination is generated by coding the micromirrors on the DMD, and converted to multi-angular illumination through the relay illumination system. A series of intensity sample images can be obtained by changing the size of the ring pattern and then used to reconstruct high resolution image through the ring pattern phase retrieval algorithm. Finally, our method is verified by an experiment using a resolution chart. The results also show that our method have higher reconstruction resolution and faster imaging speed.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.