Research on metadata management of data lake

Zhixia Guo; Chenshuo Pan; Ke Chang; Xinchi Li; Shasha Cheng; XinRui Zhang

doi:10.1117/12.2660119

3 February 2023 Research on metadata management of data lake

Zhixia Guo, Chenshuo Pan, Ke Chang, Xinchi Li, Shasha Cheng, XinRui Zhang

Proceedings Volume 12511, Third International Conference on Computer Vision and Data Mining (ICCVDM 2022); 125110Q (2023) https://doi.org/10.1117/12.2660119
Event: Third International Conference on Computer Vision and Data Mining (ICCVDM 2022), 2022, Hulun Buir, China

Abstract

Metadata management plays an important role in enterprise information management. The complete metadata management system has directly affected the flexibility and high scalability of the platform. This paper summarizes several important links in metadata management technology in data warehouses and large-scale distributed file systems. This paper organizes the metadata management standards, compares various metadata management architecture technologies,and summarizes the metadata management characteristics and metadata management strategies. At the same time, this paper introduces the applicability of the current mainstream open source metadata management tools in detail, focuses on the research of cognitive metadata directory based on machine learning, and prospects the future research direction.

Citation Download Citation

Zhixia Guo, Chenshuo Pan, Ke Chang, Xinchi Li, Shasha Cheng, and XinRui Zhang "Research on metadata management of data lake", Proc. SPIE 12511, Third International Conference on Computer Vision and Data Mining (ICCVDM 2022), 125110Q (3 February 2023); https://doi.org/10.1117/12.2660119

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available