MACHINE LEARNING METHODS AS AN ALTERNATIVE TO FACTORIZATION OF MULTIDIMENSIONAL DATA

DOI: 10.47026/1810-1909-2024-2-141-150

УДК 621.311.001.57

ББК 31.27-05

Leonid A. SLAVUTSKII, Elena V. SLAVUTSKAYA

Key words

multidimensional information flows, machine learning, decision tree, classification, links recognition, neural networks

Abstract

Multidimensional random data and information flows often have different or limited numerical dimensions. When analyzing the intra-system relationships of such data, correlation and factor analysis are ineffective.

The purpose of the study is to evaluate the possibilities of the combined use of the “decision tree” method and the artificial neural networks for the analysis of multidimensional random data.

Materials and methods. Machine learning methods are used to classify multidimensional random data with different numerical dimensions and statistical distribution. The analytical platform “Deductor” is used as the software. The experimental data set contains 27 random parameters. The system analysis was carried out on a sample of 200 to 500 values of each parameter.

Results. It is shown that the proposed approach to the system analysis of multidimensional information flows has a number of advantages over traditional correlation and factor analysis. It does not impose restrictions on statistical distributions, allows one to work with a limited data sample, and select the most significant parameters.

Conclusions. The combined use of machine learning methods allows one to significantly reduce the training sample without losing the calculations accuracy. For technical applications, this makes it possible to receive and analyze information dynamically, in real time using standard microprocessor equipment. The results can be applied in the tasks of information exchange and cybersecurity of the electric power industry.

References

1. Andreev O.N., Slavutskiy A. L., Alekseev V.V. Strukturnyy analiz elektricheskikh signalov s periodicheskim ispol’zovaniyem mnogosloynogo perseptrona[Structural Analysis of Electrical Signals with Recurrent Use of a Multilayer Perceptron]. Russian Electrical Engineering, 2022, vol. 93, no. 8, pp. 529–532. DOI 10.3103/S1068371222080028.
2. Andreev O.N., Slavutskiy A.L., Ksenofontov S.I. Modelirovaniye i neyrosetevaya obrabotka signalov perekhodnykh protsessov v elektrotekhnicheskikh kompleksakh [Modeling and neural network signal processing transients processes in electrical engineering complexes]. Cheboksary, 2023, 212 p.
3. Afanasiev A.Yu., Makarov V.G., Khannanova V.N. Identifikatsiya parametrov trekhfaznogo asinkhronnogo dvigatelya pri izmenenii nachal’nykh znacheniy otsenok v shirokom diapazone [Identification of parameters of three-phase asynchronous motor when changing the initial values of the estimates in a wide range]. Power engineering: research, equipment, technology, 2015. no. 11-12, pp. 87–96.
4. Bulychev A.V., Okhotkin G.P., Vasiliev S.A. Tsifrovaya sistema releynoy zashchity v elektricheskikh raspredelitel’nykh setyakh [A Digital Relay Protection System in Electrical Distribution Networks]. Russian Electrical Engineering, 2020, vol. 91, no.. 8, pp. 495-499. DOI 10.3103/S1068371220080064.
5. Slavutskaya E.V., Slavutskii L.A., Abrukov V.S. Vertikal’nyy sistemnyy analiz dannykh psikhodiagnostiki uchashchikhsya s ispol’zovaniyem metoda «derevo resheniy» [Vertical system analysis of students’ psycho diagnostic data using the ‘Decision Tree’ method]. Science for Education Today, 2020, vol. 10, no. 3, pp. 87–107. DOI: 10.15293/2658-6762.2003.05.
6. Vorobyev E.S., Antonov V.I., Naumov V.A. Funktsional’naya sovmestimost’ ustroystv RZA mul’tivendornykh tsifrovykh podstantsiy [Interoperability of relay protection and automation devices across multivendor digital substations]. Relay protection and automation, 2019, no. 4(37), pp. 42-45.
7. Duke V., Samoylenko A. Data Mining: uchebnyi kurs [Data Mining: training course]. St. Petersburg, Piter Publ., 2001, 386 p.
8. Koshcheev M.I., Laryukhin A.A., Slavutskiy A.L. Ispol’zovanie adaptivnykh neiroalgoritmov dlya raspoznavaniya anomal’nykh rezhimov sistem vtorichnogo oborudovaniya elektroenergetiki [Using adaptive neuroalgorithms to recognize anomalous modes of secondary equipment systems in the electrical power industry]. Vestnik Chuvashskogo universiteta, 2019, no. 1, pp. 47–58.
9. Levitin A.V. Ogranicheniya moshchi algoritmov: Derev’ya prinyatiya resheniya. Algoritmy. Vvedeniye v razrabotku i analiz [Algorithm Power Constraints: Decision Trees,” Algorithms. Introduction to Design and Analysis (Chapter 10)]. Moscow, Williams Publ., 2006, pp. 409–417.
10. Liamets Y.YA., Voronov P.I., Martynov M.V., Maslov A.N. Obucheniye releynoy zashchity na malom okne nablyudeniya [Training of relay protection with small observation window]. Elektrichestvo, 2017, no. 3, pp. 28–33.
11. Adriaens F., Lijffijt J., De Bie T. Subjectively interesting connecting trees and forests. Data Min Knowl Disc, 2019, vol. 33, pp. 1088–1124. DOI: 10.1007/s10618-019-00627-1.
12. Breiman L., Friedman J.H., Olshen R.A., Stone C.J. Classification and regression trees. Monterey C A: Wadsworth & Brooks/Cole Advanced Books & Software, 1984, 366 p.
13. Eidemiller E.G., Yustitsky V.V. Family psychotherapy: The basic principles and practical experience. International Journal of Family Psychiatry, 1989, vol. 10(3-4), pp. 325–
14. Genrikhov I.E., Djukova E.V., Zhuravlev V.I. On full regression decision trees. Pattern Recognit. Image Anal., 2017, vol. 27, pp. 1–7. DOI: 1134/S1054661817010047.
15. Grossberg S. Toward Autonomous Adaptive Intelligence: Building Upon Neural Models of How Brains Make Minds. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2021, vol. 51, no. 1, pp. 51–75. DOI: 10.1109/TSMC.2020.3041476.
16. Holena M., Pulc P., Kopp M. Classification Methods for Internet Applications. Springer. 2020. DOI: 10.1007/978-3-030-36962-0.
17. Kaiser H.F. The application of electronic computers to factor analysis. Educational and Psychological Measurement, 1960, 20, pp. 141–151.
18. Kantardzic M. Data mining: concepts, models, methods, and algorithms. John Wiley &Sons, 2011, 550 p.
19. Kulikov A., Loskutov A., Bezdushniy D., Petrov I. Decision Tree Models and Machine Learning Algorithms in the Fault Recognition on Power Lines with Branches. Energies, 2023, 16, p. 5563.
20. Kulikov A.L., Loskutov A.A., Mitrovic M. Improvement of the technical excellence of multiparameter relay protection by combining the signals of the measuring fault detectors using artificial intelligence methods. In: International Scientific and Technical Conference Smart Energy Systems (SES-2019), 2019, vol. 124. DOI 10.1051/e3sconf/201912401039.
21. Leonowicz Z., Jasinski M. Machine Learning and Data Mining Applications in Power Systems. Energies, 2022, 15, p. 1676. DOI: 10.3390/en15051676.
22. Quintero-Zuluaga J.F.. Viana-VillaP., Villegas D. Decision Tree-Based Automated Test-Bed for Performance Validation of Line Protection Relays Using a Hardware-in-the-Loop Architecture. In: IEEE Colombian Conference on Applications of Computational Intelligence (IEEE ColCACI 2020), Cali, Colombia, 2020, pp. 1–6. DOI: 10.1109/ColCACI50549.2020.9247877.
23. Rumelhart D.E., Hinton G.E., Williams R.J. Learning Internal Representations by Error Propagation. Parallel Distributed Processing. Cambridge, MA-MIT Press, 1986, vol. 1, pp. 318–362.
24. Samantaray S.R., Kamwa I., Joos G. Ensemble decision trees for phasor measurement unit-based wide-area security assessment in the operations time frame. IET Generation, Transmission & Distribution, 2010, vol. 4(12), 1334–1348. DOI: 10.1049/iet-gtd.2010.0201.
25. Schaefer E.S., Bell R.Q. Development of a parental attitude research instrument. Child Develop., 1958, vol. 29, pp. 339–361.
26. Singh V.K., Govindarasu M.A. Cyber-Physical Anomaly Detection for Wide-Area Protection Using Machine Learning. IEEE Transactions on Smart Grid, 2021, vol. 12, no. 4, pp. 3514–3526. DOI: 10.1109/TSG.2021.3066316.
27. Slavutskaya E.V., Slavutskii L.A., Nikolaev E.L. Neural Network Models for the Analysis and Visualization of Latent Dependencies: Examples of Psycho Diagnostic Data Processing. Knowledge in the Information Society: Joint Conferences XII Communicative Strategies of the Information Society (CSIS2020) and XX Professional Culture of the Specialist of the Future (PCSF2020). Cham, Springer Verlag, 2021, pp. 61–70. DOI 10.1007/978-3-030-65857-1_7.
28. Slavutskaya E., Slavutskii L., Zakharova A. Integrated Use of Data Mining Techniques for Personality Structure Analysis. Technology, Innovation and Creativity in Digital Society. Springer Nature Switzerland, 2022, vol. 345, pp. 522–533. DOI 10.1007/978-3-030-89708-6_44.

Information about the authors

Leonid A. Slavutskii – Doctor of Physical and Mathematical Sciences, Professor, Department of Automation and Control in Technical Systems, Chuvash State University, Russia, Cheboksary (lenya@slavutskii.ru; ORCID: https://orcid.org/0000-0001-6783-2985).

Elena V. Slavutskaya – Doctor of Psychological Sciences, Professor, Department of Psychology and Social Pedagogy, I.Ya. Yakovlev Chuvash State Pedagogical University, Russia, Cheboksary (slavutskayaev@gmail.com; ORCID: https://orcid.org/0000-0002-3759-6288).

For citations

Slavutskii L.A., Slavutskaya E.V. MACHINE LEARNING METHODS AS AN ALTERNATIVE TO FACTORIZATION OF MULTIDIMENSIONAL DATA. Vestnik Chuvashskogo universiteta, 2024, no. 2, pp. 141–150. DOI: 10.47026/1810-1909-2024-2-141-150 (in Russian).

Download the full article