On-chip photonic-neural-network processors have potential benefits in both speed and energy efficiency but have not yet reached the scale to compete with electronic processors. The dominant paradigm is to build integrated-photonic processors using relatively bulky discrete components connected by single-mode waveguides. A far more compact alternative is to avoid explicitly defining any components and instead sculpt the continuous substrate of the photonic processor to directly perform the computation using waves freely propagating in two dimensions. In this talk, I will present our recent work [1] on experimentally realizing this approach with a device whose refractive index as a function of space, n(x,z), can be rapidly reprogrammed. This device combines photoconductive gain with the electro-optic effect in a lithium niobate slab waveguide. Using this device, we performed neural-network inference with up to 49-dimensional input vectors in a single pass.
[1]: T. Onodera*, M.M. Stein*, et al. arXiv:2402.17750 (2024)
On-chip photonic-neural-network processors promise benefits in both speed and energy efficiency but have not yet reached the scale to compete with electronic processors. The dominant paradigm is to build integrated-photonic processors using discrete components connected by single-mode waveguides. A far more compact alternative is to avoid discrete components and instead sculpt a complex and continuous microphotonic medium in which computations are performed by multimode waves controllably propagating in two dimensions. We show our realization of this approach with a device whose refractive index as a function of space can be rapidly reprogrammed. We demonstrate optical computations much larger and more error-resilient than previous photonic chips relying on discrete components. We argue that beyond photonic-neural-network processors, devices with such arbitrarily programmable index distributions enable the realization of a wide range of photonic functionality.
We report on the realization of an on-chip waveguide platform capable of creating arbitrary two-dimensional refractive index profiles in situ and in real-time. The device exhibits complex multimode dynamics which we train to perform machine learning. We tune the refractive index profile in situ using a backpropagation algorithm to perform audio and image classification with up to 50-dimensional inputs. The two-dimensional programmability is realized by sandwiching a photoconductive film and a lithium niobate slab waveguide between two flat electrodes. While applying voltage between the electrodes, we program the effective index of the waveguide by projecting different light patterns onto the photoconductive film. The effective index increases by 10^-3 in illuminated regions via the electro-optic effect, free from any measurable memory effects or cyclic degradation. In conclusion, we developed a photonics platform with versatile spatial programmability that opens new avenues for optical computing and photonic inverse-design.
Photonic neural networks have been developed as a hardware platform to accelerate machine-learning inference. Digital micromirror devices (DMDs) have been playing a critical role in developing a variety of photonic neural networks for their ability to manipulate millions of optical spatial modes in a 2D plane at >10 kHz frame rate. DMDs have not only enabled high-throughput machine-learning inference but also made hardware-in-the-loop training possible with photonic neural networks. In this talk, we will review the functions of DMDs in a plethora of photonic-neural-network architectures and discuss how MEMS-based technologies can enable novel photonic neural networks in future.
Linear optics has been long applied to image compression. However, it is widely known that nonlinear neural networks outperform linear models in terms of feature extraction and image compression. Here, we show a nonlinear multilayer optical neural network using a commercially available image intensifier as a scalable optical-to-optical nonlinear activation function. We experimentally demonstrated that nonlinear ONNs outperform linear optical linear encoders in a variety of non-trivial machine vision tasks at a high image compression ratio (up to 800:1). We have shown that nonlinear ONNs can directly process optical inputs from physical objects under natural illumination, which provides a new pathway towards high-volume, high-throughput, and low-latency machine vision processing.
In conventional approaches to computer-vision tasks such as object recognition, a camera digitally records a high-resolution image and an algorithm is run to extract information from the image. Alternative image-sensing schemes have been proposed that extract high-level features from a scene using optical components, filtering out irrelevant information ahead of conversion from the optical to electronic domains by an array of detectors (e.g., a CMOS image sensor). In this way, images are compressed into a low-dimensional latent space, allowing computer-vision applications to be realized with fewer detectors, fewer photons, and reduced digital post-processing, which enables low-latency processing. Optical neural networks (ONNs) offer a powerful platform for such image compression/feature extraction in the analog, optical domain. While ONNs have been successfully implemented using only linear operations, which can still be leveraged for computer-vision applications, it is well known that adding nonlinearity (a prerequisite for depth) enables neural networks to perform more complex processing. Our work realizes a multilayer ONN preprocessor for image sensing, using a commercial image intensifier as an optoelectronic, optical-to-optical nonlinear activation function. The nonlinear ONN preprocessor achieves compression ratios up to 800:1. At high compression ratios, the nonlinear ONN outperforms any linear preprocessor in terms of classification accuracy on a variety of tasks. Our experiments demonstrate ONN image sensors with incoherent light, but emerging technologies such as metasurfaces, large-scale laser arrays, and novel optoelectronic materials, will provide the means to realize a variety of multilayer ONN preprocessors that act on coherent and/or quantum light.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.