Open Access Paper
13 September 2024 Web GIS tools to combine station observation and netCDF format data
Author Affiliations +
Proceedings Volume 13212, Tenth International Conference on Remote Sensing and Geoinformation of the Environment (RSCy2024); 132121J (2024) https://doi.org/10.1117/12.3038220
Event: Tenth International Conference on Remote Sensing and Geoinformation of the Environment (RSCy2024), 2024, Paphos, Cyprus
Abstract
The work is focused on creating an information system that can gather, store, provide access to, and offer tools for analyzing and visualizing various types of data. It includes oceanographic stations measurements, which are kept in a database tables, and various types of spatial data in netCDF format, including climatic, oceanographic forecast, and satellite observation (including SST and SLA) data. The Postgresql database was created in order to keep the oceanographic in-situ measurement data. To allow the query flexibility, the measurement profile data and metadata are stored apart. The netCDF files are kept in the form of a structural archive. The user interface (UI) was developed using JavaScript libraries (jQuery, PlotlyJS), while Open Layers provided map tools. The user interface offers: - Select and view the interactive map created from the netCDF data. Thus, the map will appear when the user selects the parameters and depth (if any). By clicking on the map, parameter data may be viewed, and plots can be made. - Select and find out station data according to parameters, date range, and cruise information. A selection of stations are presented as an interactive points on the map. Plotting and viewing station data are made possible by clicking on the map. - Overlay station data and netCDF data are displayed. Although the method was created for oceanographic data from the Black Sea, it can be applied to any other area or the entire ocean.

1.

INTRODUCTION

Scientific and environmental data are often stored in big-space data formats like netCDF. A collection of machine-independent data formats and software libraries called NetCDF (Network Common Data Form) facilitate the development, access, and exchange of array-oriented scientific data. Additionally netCDF [1] is a community standard for exchanging scientific data. It is commonly used to share and store scientific data, including many computed data types.

In-situ observation data, also referred to as point measurement data, is another crucial and frequently utilized type of information. Typically, they are profile data that comprise observations for a few parameters at a coordinate-based point and can be kept at ODV [2] or similar spreadsheet formats.

While there are numerous websites that offer tools for accessing and visualizing point measurement data [3,4] and netCDF data [5,6], there aren’t as many that compile and offer tools for utilizing both data in combination. Therefore, creating web tools that integrate point observation data and netCDF, for instance in the Black Sea region, is crucial.

2.

METHOD AND TECHNIQUES

To provide visualize and data access to netCDF format data the method mentioned at [7] was used. netCDF variables should be converted to single-band georeferencing TIFF (geoTiff) files for corresponding time, and depth and then should be stored in a structured file archive. Next, using Open Layer 7, this data may be uploaded to the map as a layer. Postgresql is used to store observation point data. Its structure was explained at [8]. An additional point layer built from JSON data was utilized to access and show them.

Open Layer 7 allows to visualize geoTiff data. It can be added as a map geotiff layer. Also, OL gives the user the possibility to visualize the value at the selected point. In practice, it shows the value under the mouse cursor.

To visualize profile data, the PlotlyJS library was used. It allows to plot data in JSON format. So the Python script selects the data corresponded to the selected station from the database, converts the request to json format, and sends it to the UI.

3.

THE SYSTEM STRUCTURE

The system was developed at the base of a client-server architecture for the Black Sea region. The general scheme of the system is shown in Figure 1. The similar structure was used in [9]. The server part includes the oceanographic database at the base of DBMS Postgresql, which includes Black Sea hydrological and hydrochemical cruise data. Dataaccess modules provide DB access and convert requests to JSON format.

Figure 1.

General scheme of the system

00059_PSISDG13212_132121J_page_2_1.jpg

The detailed scheme of the netCDF data access and visualization module is presented in Figure 2. Python script is used to process netCDF files and create corresponding semantically named files in geoTIFF formats. Further, these files are used as sources for the geoTiff layer in OpenLayers at Interactive Map.

Figure 2.

The detailed scheme of the netCDF data access and visualization module

00059_PSISDG13212_132121J_page_3_1.jpg

The javascript libraries Plotly [10], OpenLayers [11], and jQuery [12] were used to develop the user interface. The JSON format is used to provide data exchange.

THE USER INTERFACE ALLOWS:

  • - Select and visualize netCDF data as an interactive map. So the user can select parameters and depth (if present), and the map will be shown. It allows viewing parameter data by clicking on the map and creating plots.

  • - Select and visualize station data by cruise information, date period, and parameters. Selected stations are presented on the map as interactive points. It allows viewing station data by clicking on the map and creating plots.

  • - Overlay station data and netCDF data are shown on the same map and in the in the same plots.

The UI examples are shown in Figure 3 and Figure 4. Figure 3 presents the data selection by rectangle region. The results are shown as a set of interactive points on the map; each of them corresponds to the oceanographic station. Figure4 shows the overlay layer, which presents the netCDF parameter and selected oceanographic stations.

Figure 3.

user Interface. Data selection by rectangle region

00059_PSISDG13212_132121J_page_4_1.jpg

Figure 4.

User Interface. Overlay netCDF and oceanographic stations layers

00059_PSISDG13212_132121J_page_4_2.jpg

This method was used in developing a data access and analysis system for carbon fluxes. It allows for the combination of different types of information and provides complex visualization and analysis. So it combines hydrological and climatic data, forecast data, and in-situ measurement data. Climatic and forecast data are stored in netCDF data archives; measurement data was kept as a DBMS using Postgresql.

4.

CONCLUSIONS

Combining various oceanographic data sets, verifying forecast data, and analyzing and contrasting non-homogenous data that is kept in various forms with various structures, spaces, and temporal resolutions are crucial responsibilities for academics. Thus, these systems offer the ability to work with many data types and offer tools that are easy to use.

ACKNOWLEDGEMENTS

The work was developed within the framework of the MHI RAS state task on themes No. FNNN-2023-0001, “Ensuring climate and bio-geochemical monitoring of carbon fluxes in the Black Sea base on long-term observations data and numerical simulation results” (“Carbon”) and themes No FNNN-2024-0012 “Analysis, diagnosis and real-time forecast of the state of hydrophysical and hydrochemical fields of marine water areas based on mathematical modeling using data from remote and in situ methods of measurements” (“Operational Oceanology”)

REFERENCES

[7] 

Zhuk, E., “Using GIS technology for visualizing marine environmental data in netCDF format,” RSCy 2023 Ayia Napa, T.12786 127861W (2023) https://doi.org/10.1117/12.2681785 Google Scholar

[8] 

Zhuk, E., “GIS tool developments for online data access systems,” in Proceedings of SPIE - The International Society for Optical Engineering. 9th International Conference on Remote Sensing and Geoinformation of the Environment, 1278623 (202320232023). https://doi.org/10.1117/12.2683109 Google Scholar

[9] 

A.Yu. Basykina*, E.V. Zhuk, A.Kh. Khaliulin, “The Geo-Information System Application for Display of the Tsunami Type Long Wave Propagation Modeling Results in the Black Sea Coastal Area,” Physical Oceanography, 3 74 –81 (2017). https://doi.org/10.22449/0233-7584-2017-3-74-81 Google Scholar
(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.
Elena Zhuk "Web GIS tools to combine station observation and netCDF format data", Proc. SPIE 13212, Tenth International Conference on Remote Sensing and Geoinformation of the Environment (RSCy2024), 132121J (13 September 2024); https://doi.org/10.1117/12.3038220
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Visualization

Human-machine interfaces

Data archive systems

Databases

Geographic information systems

Climatology

Carbon

RELATED CONTENT

GIS tool developments for online data access systems
Proceedings of SPIE (September 21 2023)
WEB GIS tools to visualize sea currents data
Proceedings of SPIE (September 13 2024)
GIS applications in marine research in the Black Sea
Proceedings of SPIE (June 27 2019)
Improvements of the Black Sea oceanographic GIS
Proceedings of SPIE (June 27 2019)
Design and implementation of electronic chart marking system
Proceedings of SPIE (October 28 2006)

Back to Top