We demonstrate meta-optic based accelerators that can off-load computationally expensive operations into high-speed and low-power optics. The key to these architectures are the new freedoms afforded by metasurfaces such as optical edge isolation, polarization discrimination, and the ability to spatially multiplex, and demultiplex, information channels. I will discuss how these freedoms can be utilized for accelerating optical segmentation networks and objection classifiers, both based on incoherent illumination. This approach could enable compact, high-speed, and low-power image and information processing systems for a wide range of applications in machine-vision and artificial intelligence.
Eosinophilic esophagitis (EoE) is an immune-mediated, clinicopathologic disease of the esophagus. EoE is histologically characterized by the accretion of eosinophils in the esophageal epithelium. The current practice involving manual identification of the small-scale histologic features of EoE relative to the size of the esophageal biopsies can be burdensome and prone to interpreter errors. The existing automatic, computer-assisted EoE identification approaches are typically designed as a train-from-scratch setting, which is prone to overfitting. In this study, we propose to use transfer deep-learning via both the ImageNet pre-trained ResNet50 as well as the more recent Big Transfer (BiT) model to achieve automated EoE feature identification on whole slide images. As opposed to existing deep-learning-based approaches that typically focus on a single pathological phenotype, our study investigates five EoE-relevant histologic features including basal zone hyperplasia, dilated intercellular spaces, eosinophils, lamina propria fibrosis, and normal lamina propria simultaneously. From the results, the model achieved a promising testing balanced accuracy of 61.9%, which is better than that of its trained-from-scratch counterparts.
KEYWORDS: Data modeling, Performance modeling, Parallel computing, Image analysis, Instrument modeling, Process modeling, Pathology, Neural networks, Data processing, Skin cancer
Contrastive learning, a recent family of self-supervised learning, leverages pathological image analysis by learning from large-scale unannotated data. However, the state-of-the-art contrastive learning methods (e.g., SimCLR, BYOL) are typically limited by the more expensive computational hardware (with large GPU memory) as compared with traditional supervised learning approaches in achieving large training batch size. Fortunately, recent advances in the machine learning community provide multiple approaches to reduce GPU memory usage, such as (1) activation compressed training, (2) In-place activation, and (3) mixed precision training. Yet, such approaches are currently deployed independently without systematical assessments for contrastive learning. In this work, we applied these memory-efficient approaches into a self-supervised framework. The contribution of this paper is three-fold: (1) We combined previously independent GPU memory-efficient methods with self-supervised learning framework; (2) Our experiments are to maximize the memory efficiency via limited computational resources (a single GPU); (3) The self-supervised learning framework with GPU memory-efficient method allows a single GPU to triple the batch size that typically requires three GPUs. From the experimental results, contrastive learning model with larger batch size leads to higher accuracy enabled by GPU memory-efficient method on single GPU.
The unsupervised segmentation is an increasingly popular topic in biomedical image analysis. The basic idea is to approach the supervised segmentation task as an unsupervised synthesis problem, where the intensity images can be transferred to the annotation domain using cycle-consistent adversarial learning. The previous studies have shown that the macro-level (global distribution level) matching on the number of the objects (e.g., cells, tissues, protrusions etc.) between two domains resulted in better segmentation performance. However, no prior studies have exploited whether the unsupervised segmentation performance would be further improved when matching the exact number of objects at micro-level (mini-batch level). In this paper, we propose a deep learning based unsupervised segmentation method for segmenting highly overlapped and dynamic sub-cellular microvilli. With this challenging task, both micro-level and macro-level matching strategies were evaluated. To match the number of objects at the micro-level, the novel uorescence-based micro-level matching approach was presented. From the experimental results, the micro-level matching did not improve the segmentation performance, compared with the simpler macro-level matching.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.