A new data process framework of industrial big data based on feature selection

Fengjuan Xu; Haitong He; Jianlei Gao; Tianyu Gong; Yaobing Li; Yun Li

doi:10.1117/12.2641163

3 October 2022 A new data process framework of industrial big data based on feature selection

Fengjuan Xu, Haitong He, Jianlei Gao, Tianyu Gong, Yaobing Li, Yun Li

Proceedings Volume 12290, International Conference on Computer Network Security and Software Engineering (CNSSE 2022); 1229012 (2022) https://doi.org/10.1117/12.2641163
Event: International Conference on Computer Network Security and Software Engineering (CNSSE 2022), 2022, Zhuhai, China

Abstract

The continuously updated and widely applied information technology and internet technology make the amount of data increase with an unimaginable speed. Subsequently, industries have also entered into the “Digital Times”, which brings challenges and opportunities for industrialization. Through industrial big data government technology, we can continuously improve the level of industrial intelligence, the management efficiency and the production efficiency of enterprises, so as to improve the competitiveness of enterprises and the country. However, in the face of this large number of industrial big data with complex and diverse data characteristics, the application of traditional data processing methods in industrial big data government is not applicable, especially in the condition of valuable and scarce computing resources. A new proper data process framework, in this paper, is proposed for industrial data, whose principle is to reasonably select data features by utilizing a max-relevance min-redundancy (mrmr) algorithm that considering the relationship between data characteristics. The effect is verified on a series of industrial datasets. And the experiments results can effectively improve the utilization and analysis efficiency of data, reduce the difficulty of data processing, improve the data storage efficiency and reduce the data storage space.

Citation Download Citation

Fengjuan Xu, Haitong He, Jianlei Gao, Tianyu Gong, Yaobing Li, and Yun Li "A new data process framework of industrial big data based on feature selection", Proc. SPIE 12290, International Conference on Computer Network Security and Software Engineering (CNSSE 2022), 1229012 (3 October 2022); https://doi.org/10.1117/12.2641163

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Data storage

Data processing

Feature extraction

Data analysis

Data modeling

Feature selection

Binary data

Show All Keywords

Keywords/Phrases

Search In:

Publication Years