Technological equipment control system using virtual reality devices
S.A. Kizilov1, M.S. Nikitenko1, D.Yu. Khudonogov1, B. Neogi2, D.O. Verkhovtsev1
1 Federal Research Center for Coal and Coal Chemistry of the Siberian Branch of the Russian Academy of Sciences, Kemerovo, Russian Federation
2 JIS College of Engineering, Kalyani, West Bengal, India
Russian Mining Industry №5 / 2023 р. 124-129
Abstract: The article describes the developed technology of remote parameter monitoring and equipment control using virtual reality. The advantages of this technology and the VR devices have been considered in relation to the conventional way to visualize technological information of the SCADA systems on the screens. A SCADA prototype was developed based on a 3D interface displayed by means of a VR headset for operator to interact with the virtual objects. Scaled operating models of the mechanized roof support sections as part of the longwall system with servo-drives that ensure thrust and unloading of the section were used as technological equipment. The virtual control interface both reproduces the control objects and displays their response to the control inputs in an interactive mode. The paper presents a block diagram of the algorithm that features interaction between the interactive virtual objects and the physical models; a structural diagram of the software data exchange between the virtual reality and the physical objects, the front control panel on the operator's PC screen and the control interface from the virtual environment. The technology of process equipment control described in the article and based on displaying a 3D visualization of the SCADA interface allowed to change the level of operator's "immersion" into the workflow, enhancing concentration on the controlled parameters.
Keywords: virtual reality, virtual workspace, interface, 3D interface, real-time controller, control system, control device, technological equipment control, industrial process control
Acknowledgments: The work was carried out within the framework of the state task of the Federal Research Center for Coal and Coal Chemistry of the Siberian Branch of the Russian Academy of Sciences, project FWEZ-2021-0017 "Development of scientific foundations for the creation of autonomous and automated mining machines, equipment, technical and control systems based on advanced digital and robotic technologies "(Reg. No. 121121000036-1).
For citation: Kizilov S.A., Nikitenko M.S., Khudonogov D.Yu., Neogi B., Verkhovtsev D.O. Technological equipment control system using virtual reality devices. Russian Mining Industry. 2023;(5):124–129. (In Russ.) https://doi.org/10.30686/1609-9192-2023-5-124-129
Article info
Received: 29.07.2023
Revised: 06.09.2023
Accepted: 14.09.2023
Information about the authors
Sergey A. Kizilov – Scientific Fellow, Federal Research Center for Coal and Coal Chemistry of the Siberian Branch of the Russian Academy of Sciences, Kemerovo, Russian Federation; e-mail: This email address is being protected from spambots. You need JavaScript enabled to view it.
Mikhail S. Nikitenko – Cand. Sci. (Eng.), Head of laboratory, Federal Research Center for Coal and Coal Chemistry of the Siberian Branch of the Russian Academy of Sciences, Kemerovo, Russian Federation; e-mail: This email address is being protected from spambots. You need JavaScript enabled to view it.
Danila Yu. Khudonogov – Scientific researcher, Federal Research Center for Coal and Coal Chemistry of the Siberian Branch of the Russian Academy of Sciences, Kemerovo, Russian Federation; e-mail: This email address is being protected from spambots. You need JavaScript enabled to view it.
Biswarup Neogi – PhD, Dean Research & Development, Coordinator, AICTE JISCE IDEA LAB & Professor, ECE Dept. JIS College of Engineering, West Bengal, India; e-mail: This email address is being protected from spambots. You need JavaScript enabled to view it.
Daniil O. Verkhovtsev – Junior Scientific Fellow, Federal Research Center for Coal and Coal Chemistry of the Siberian Branch of the Russian Academy of Sciences, Kemerovo, Russian Federation; e-mail: This email address is being protected from spambots. You need JavaScript enabled to view it.
References
1. Samorodova L.L., Lyubimov O.V., Yakunina Yu.S. Application of SCADA Systems in the Coal Mining Industry. In: Coal in the 21st Century: Mining, Processing and Safety, Kemerovo, Russia, October 10–12, 2016. Kemerovo: Atlantis press; 2016, pp. 50–54. https://doi.org/10.2991/coal-16.2016.10
2. Nite S. Modu X.R. VR/AR enterprise insider: guidebook for virtual reality and XR. 2020. 142 p.
3. DelPreto J., Lipton J., Sanneman L., Fay A.J., Fourie C., Choi C., Rus D. Helping robots learn: A human-robot master-apprentice model using demonstrations via virtual reality teleoperation. In: 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France, 31 May 2020 – 31 August 2020, pp. 10226–10233. https://doi.org/10.1109/ICRA40945.2020.9196754
4. Lipton J.I., Fay A.J., Rus D. Baxter’s homunculus: Virtual reality spaces for teleoperation in manufacturing. IEEE Robotics and Automation Letters. 2018;3(1):179–186. https://doi.org/10.1109/LRA.2017.2737046
5. Hu J., Watkins D., Allen P. Teleoperated robot grasping in virtual reality spaces. arXiv:2301.13064. https://doi.org/10.48550/arXiv.2301.13064
6. Alnagrat A.J., Ismail R.C., Syed Idrus S.Z. The Opportunities and challenges in virtual reality for virtual laboratories. Innovative Teaching and Learning Journal. 2023;6(2):73–89. https://doi.org/10.11113/itlj.v6.91
7. Annagurdov Y., Atayeva B., Hojagulyyev P. E. Development of a mobile robot controlled by virtual reality technology. International Journal of Multidisciplinary Research Transactions. 2023;5(4):156–157. https://doi.org/10.5281/zenodo.7783075
8. Millais P., Jones S.L., Kelly R. Exploring data in virtual reality: Comparisons with 2D data visualizations. In: CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. April 2018, pp. 1–6. https://doi.org/10.1145/3170427.3188537
9. Tarasova I.V., Nikitenko M.S., Trubnikova O.A., Kukhareva I.N., Kupriyanova D.S., Sosnina A.S., Barbarash O.L. Psychophysiological changes during workspace virtualization. Fundamental and Clinical Medicine. 2021;6(2):66–74. (In Russ.) https://doi.org/10.23946/2500-0764-2021-6-2-66-74
10. Glover J., Linowes J. Complete virtual reality and augmented reality development with unity. Glover Birmingham: Packt Publishing Ltd.; 2019. 637 p.
11. Cavallo M., Dolakia M., Havlena M., Ocheltree K., Podlaseck M. Immersive insights: A hybrid analytics system for collaborative exploratory data analysis. In: 25th ACM Symposium on Virtual Reality Software and Technology. November 2019, pp. 1–12. https://doi.org/10.1145/3359996.3364242
12. Nikitenko M.S., Kizilov S.A., Ignatova A.Y., Remizov S.V., Natura E.S. Operator's workplace virtualization and approaches assessment of its graphic implementation. IOP Conference Series: Earth and Environmental Science. 2021;823:012017. https://doi.org/10.1088/1755-1315/823/1/012017
