|
Spectral imaging is a powerful technology that uses spatially referenced spectral signatures to create informative visual maps of sample surfaces that can reveal more than what conventional RGB-visual images can show. Indeed, different spectroscopy modalities can provide different information about the same sample: for instance, Laser- Induced Breakdown Spectroscopy (LIBS) imaging can detect the presence of specific elements on the surface, while Raman imaging can identify the molecular structures and compositions of the sample, both of which have potential applications in various industrial processes, from quality control to material sorting. In the path from science to technology, the increasing accessibility to such solutions and the strong market pull have opened a window of opportunity for innovative multimodal imaging solutions, where information from distinct sources is set to be combined in order to enhance the capabilities of the single modality system. However, the practical implementation of multimodal spectral imaging is still a challenge, despite its theoretical potential, and as such, it is yet to be achieved.
In this work, we will go over multimodal spectral knowledge distillation, a disruptive approach to multimodal spectral imaging techniques that tries to explore the combination of two techniques to capitalize on their individual strengths. In specific, this approach allows us to utilize one technique as an autonomous supervisor for the other, leveraging the higher degree of knowledge and interpretability of one of the techniques to increase the performance and transparency of the other. We present some example scenarios with LIBS and HSI and Raman spectroscopy and LIBS, discussing the impact of this new approach for scientific and technological applications.
|
