Analysis of methods to prepare and transform information entering data repositories for effective management of the mining system

V.N. Zakharov, D.A. Klebanov , M.A. Makeev, D.N. Radchenko
Institute of Comprehensive Exploitation of Mineral Resources of Russian Academy of Sciences, Moscow, Russian Federation
Russian Mining Industry №5S / 2023 р. 10-17

Abstract: The article assesses the existing methods of data collection and processing in the industry and proposes an alternative option of data processing to manage mining engineering systems at various stages of their operation. It is demonstrated that the formed volume of information that comes with different frequency rates and requires dedicated processing, structuring and analysis methods forms a system of big data and serves to enhance the efficiency of implementing geotechnical processes. A possible unified structure of data acquisition from digital sources of mining engineering system is presented. An analysis is provided of possible methods to process data for analytical purposes and for searching implicit dependencies and solving problems of predictive analytics. Tools for data collection and storage are proposed to create a unified system of big data analysis for management of mining engineering systems. It is stated that in order to create a unified analytical system for collection of digital data from a mining system, it is necessary to use standard industrial protocols for data collection and storage, for instance MQTT, used as an industry standard in the Industrial Internet of Things (IIoT) systems in accordance with requirements of ISO/ IEC 20922:2016. Storage requires the use of a conventional queue broker architecture, as well as a tool for working with the time series which is required to apply machine learning and big data methods. The approach to data classification in terms of the data acquisition speed proposed in the article makes it possible to standardize the data handling principles. Since the volume of transmitted data does not depend on the frequency of acquiring information from a digital source, it is proposed to transmit all the generated data from a digital source for subsequent search of implicit dependencies between the data. It is noted that application of specific methods and algorithms to analyze data of a mining system depends primarily on the task set which is often formed as a hypothesis to be tested by identifying implicit dependencies between different data sources. In order to improve the efficiency of managing a mining system at all the stages of field development, it is proposed to apply the ELT approach, which can be an important advantage in terms of controlling the technological processes of the mining system in the future.

Keywords: mining system, big data, information systems architecture, dispatching systems, data processing, information processing methodsд

Acknowledgments: The article was written within the framework of the Russian Science Foundation Grant No.22617600142, https://rscf.ru/project/22617600142/

For citation: Zakharov V.N., Klebanov D.A., Makeev M.A., Radchenko D.N. Analysis of methods to prepare and transform information entering data repositories for effective management of the mining system. Russian Mining Industry. 2023;(5S):10–17. https://doi.org/10.30686/1609-9192-2023-5S-10-17

Article info

Received: 03.10.2023

Revised: 22.11.2023

Accepted: 02.12.2023

Information about the authors

Valerii N. Zakharov – Corresponding Member of RAS, Dr. Sci. (Eng.), Professor, Director, Institute of Comprehensive Exploitation of Mineral Resources Russian Academy of Sciences, Moscow, Russian Federation; https://orcid.org/0000-0002-9309-2391, Scopus ID 56438797200

Dmitry A. Klebanov – Cand. Sci. (Eng.), Head of Laboratory of Intelligent Systems and Digital Technologies, Institute of Comprehensive Exploitation of Mineral Resources of Russian Academy of Sciences, Moscow, Russian Federation; https://orcid.org/0000-0002-3289-9212, Scopus ID 55922194400, e-mail: This email address is being protected from spambots. You need JavaScript enabled to view it.

Mikhail A. Makeev – Research Associate, Laboratory No.3.2, Institute of Comprehensive Exploitation of Mineral Resources Russian Academy of Sciences, Moscow, Russian Federation https://orcid.org/0000-0003-0941-7606, Scopus ID 57270771800

Dmitry N. Radchenko – Cand. Sci. (Eng.), Associate Professor, Head of the Laboratory of Theoretical Fundamentals for Mining Systems Design, Institute of Comprehensive Exploitation of Mineral Resources Russian Academy of Sciences, Moscow, Russian Federation; https://orcid.org/0000-0003-1821-3840, Scopus ID 6507269210

References

1. Rylnikova M.V., Tsupkina M.V., Kirkov A.E. Technologies of big data collection and processing – the basis for increasing the reliability of primary information about rock massifs in the development of mineral deposits and technogenic formations. Izvestiya Tulskogo gosudarstvennogo universiteta. Nauki o Zemle. 2023;(1):308–327. (In Russ.) https://doi.org/10.46689/2218-5194-2023-1-1-308-327

2. Zakharov V.N., Kaplunov D.R., Klebanov D.A., Radchenko D.N. Methodical approaches to standardization of data acquisition, storage and analysis in management of geotechnical systems. Gornyi Zhurnal. 2022;(12):55–61. (In Russ.) https://doi.org/10.17580/gzh.2022.12.10

3. Zakharov V.N., Gvishiani A.D., Vaisberg L.A., Dzeranov B.V. Big Data and sustainable functioning of geotechnical systems. Gornyi Zhurnal. 2021;(11):45–52. (In Russ.) https://doi.org/10.17580/gzh.2021.11.06

4. Nambiar A., Mundra D. An overview of data warehouse and data lake in modern enterprise data management. Big Data and Cognitive Computing. 2022;6(4):132. https://doi.org/10.3390/bdcc6040132

5. Rahmani A.M., Azhir E., Ali S., Mohammadi M., Ahmed O.H., Yassin Ghafour M., Hasan Ahmed S., Hosseinzadeh M. Artificial intelligence approaches and mechanisms for big data analytics: a systematic study. PeerJ Computer Science. 2021;7:e488 https://doi.org/10.7717/peerj-cs.488