Paper
16 May 2024 Street-to-satellite view synthesis for cross-view geo-localization
Luying Zhao, Yang Zhou, Xiaofei Hu, Wenjian Gan, Gaoshuang Huang, Chenglong Zhang, Mingbo Hou
Author Affiliations +
Proceedings Volume 13166, International Conference on Remote Sensing Technology and Survey Mapping (RSTSM 2024); 1316608 (2024) https://doi.org/10.1117/12.3029089
Event: International Conference on Remote Sensing Technology and Survey Mapping (RSTSM 2024), 2024, Changchun, China
Abstract
Cross-view geolocation, which aims to geolocate ground-view images using reference satellite imagery, is a challenging task that requires effective strategies to minimize significant disparities between images. In this paper, we propose a novel approach to address this challenge. By exploiting the projection relationship between ground images and satellite images, we are able to convert ground-view images into satellite-view images, thereby mitigating the inherent disparities between the two perspectives. To enhance the converted images further, we employ a conditional generative adversarial network (CGAN). This network generates satellite perspective images that exhibit greater consistency with the actual satellite data, thereby reducing excessive disparities and improving overall image quality. Additionally, we adopt a joint training approach in a multi-task setting, wherein we synthesize satellite images from ground images and conduct cross-view image matching. This framework facilitates mutual learning between the tasks and leads to improved performance. Empirical evaluation of our proposed method showcases significant advancements in terms of retrieval accuracy and synthesis quality when compared to existing techniques. These findings underscore the potential of our approach in addressing the challenges associated with cross-view geolocation.
(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.
Luying Zhao, Yang Zhou, Xiaofei Hu, Wenjian Gan, Gaoshuang Huang, Chenglong Zhang, and Mingbo Hou "Street-to-satellite view synthesis for cross-view geo-localization", Proc. SPIE 13166, International Conference on Remote Sensing Technology and Survey Mapping (RSTSM 2024), 1316608 (16 May 2024); https://doi.org/10.1117/12.3029089
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Satellite imaging

Image processing

Panoramic photography

Image retrieval

RELATED CONTENT

Image mosaic at pixel level
Proceedings of SPIE (October 26 2013)
Imaging through turbulence using a plenoptic sensor
Proceedings of SPIE (September 04 2015)
Towards accurate camera geopositioning by image matching
Proceedings of SPIE (March 15 2019)
Image categorization using N x M grams
Proceedings of SPIE (January 15 1997)
Indexing and retrieval in large satellite image databases
Proceedings of SPIE (November 14 2007)

Back to Top