Menu
Publications
2024
2023
2022
2021
2020
2019
2018
2017
2016
2015
2014
2013
2012
2011
2010
2009
2008
2007
2006
2005
2004
2003
2002
2001
Editor-in-Chief
Nikiforov
Vladimir O.
D.Sc., Prof.
Partners
doi: 10.17586/2226-1494-2023-23-6-1171-1177
Fuzzy logic controller algorithm for placing files in a data storage system
Read the full article ';
Article in Russian
For citation:
Abstract
For citation:
Tatarnikova T.M., Arkhiptsev E.D. Fuzzy logic controller algorithm for placing files in a data storage system. Scientific and Technical Journal of Information Technologies, Mechanics and Optics, 2023, vol. 23, no. 6, pp. 1171–1177 (in Russian). doi: 10.17586/2226-1494-2023-23-6-1171-1177
Abstract
The problem of organizing multi-level data storage is discussed. Information loses its relevance over time and the cost of storing it on highly available media, such as solid-state drives, becomes impractical. Until now, the placement of new files in the data storage system is decided horizontally — without taking into account the multi-level organization of the system. The file migration between storage system tiers occurs over time as statistics on the frequency of requested files are accumulated. All files have metadata, such as type, size, creation date and others, from which some information about the importance of the information can be extracted and then the distribution by levels of the data storage system can be implemented at the system input. A modern data storage system represented by four levels is proposed. The first Hi-End level is intended for storing critical data with the requirements of maximum access speed and reliability. The second level, Upper Mid-Range, is intended for enterprise applications that require high access speeds. The third level, Mid-Range, is proposed to be used for organizing file storage, and the fourth, Entry Level, is proposed to be used for creating backup copies and archives. The proposed algorithm for arranging files across tiers of a data storage system takes into account metrics indicating storage requirements and selecting a level of a data storage system that meets the requirements. These metrics include availability (speed of information delivery), importance (cost of data loss due to hardware and software failures), retention period, and request frequency. Metrics are extracted from the metadata of saved files. A new solution based on the functions of a fuzzy logic controller is proposed. Its operation algorithm can be integrated into the data storage system before the process of writing a new file. The algorithm includes three main steps. At the first step, file metrics are analyzed to form the corresponding input fuzzy sets. At the second step, a logical model is used to form the final fuzzy set. At the final stage, the fuzzy output result is obtained and the file is placed at the appropriate level of the data storage system. An example of how the controller works for files with different values of metric characteristics is given. A fuzzy logic controller can be integrated into the operation of a multi-level data storage system.
Keywords: big data, multi-level data storage system, data storage requirements, file metrics, fuzzy logic controller, rational storage
References
References
- Bokov S.I., Chuprinov A.A. On the role of digital economy of Russia management system based on organizing a unified information space. Nanoindustry, 2019, vol. 12, no. S(89), pp. 135–139. (in Russian). https://doi.org/10.22184/NanoRus.2019.12.89.135.139
- Challawala S., Lakhatariya J., Mehta C., Patel K. MySQL 8 for Big Data: Effective Data Processing with MySQL 8, Hadoop, NoSQL APIs, and Other Big Data Tools. Packt Publishing, 2017, 226 p.
- Lakshmanan V., Tigani J. Google BigQuery: The Definitive Guide: Data Warehousing, Analytics, and Machine Learning at Scale. O'Reilly Media, 2019, 475 p.
- Sivov V.V., Bogatyrev V.A. Data warehouse failover cluster for analytical queries in banking. Advanced Engineering Research (Rostov-on-Don), 2023, vol. 23, no. 1, pp. 76–84. https://doi.org/10.23947/2687-1653-2023-23-1-76-84
- Tatarnikova T.M., Arkhiptsev E.D. Determine the number of distributed big data storage replicas. International Conference on Soft Computing and Measurements, 2023, vol. 1, pp. 305–308. (in Russian)
- Shevtsov V.Yu., Abramov E.S. The analysis of modern data storage systems. NBI technologies, 2019, vol. 13, no. 1, pp. 25–30. (in Russian). https://doi.org/https://doi.org/10.15688/NBIT.jvolsu.2019.1.5
- Tatarnikova T.M., Poymanova E.D. Differentiated capacity extension method for system of data storage with multilevel structure. Scientific and Technical Journal of Information Technologies, Mechanics and Optics, 2020, vol. 20, no. 1, pp. 66–73. (in Russian). https://doi.org/10.17586/2226-1494-2020-20-1-66-73
- Information Storage and Management. 2nd ed. New Jersey, John Wiley & Sons Inc., 2016, 544 p.
- Popov S.G., Fridman V.S. Review of methods for dynamic distribution of data in distributed database management systems. Computing, Telecommunications and Control, 2018, vol. 11, no. 4, pp. 82–107. (in Russian). https://doi.org/10.18721/JCSTCS.11407
- Polishuk Yu.V. Relations between significance and aging of information when control big technical systems. Information Technology, 2019, vol. 25, no. 6, pp. 381–384. (in Russian). https://doi.org/10.17587/it.25.381-384
- Kish L.B., Granqvist C.G. Does information have mass? Proceedings of the IEEE, 2013, vol. 101, no. 9, pp. 1895–1899. https://doi.org/10.1109/jproc.2013.2273720
- Svetov B.Ya., Tatarnikova T.M., Poymanova E.D. Storage scaling management model. Information and Control Systems, 2020, no. 5, pp. 43–49. (in Russian). https://doi.org/10.31799/1684-8853-2020-5-43-49
- Bogatyrev V.A., Bogatyrev S.V., Bogatyrev A.V. Assessment of the readiness of a computer system for timely servicing of requests when combined with information recovery of memory after failures. Scientific and Technical Journal of Information Technologies, Mechanics and Optics, 2023, vol. 23, no. 3(145), pp. 608–617. (in Russian). https://doi.org/10.17586/2226-1494-2023-23-3-608-617
- Bogatyrev V.A., Bogatyrev S.V., Bogatyrev A.V. Reliability and timeliness of servicing requests in infocommunication systems, taking into account the physical and information recovery of redundant storage devices. Proc. of the 2022 International Conference on Information, Control, and Communication Technologies (ICCT), 2022, pp. 1–4. https://doi.org/10.1109/icct56057.2022.9976800
- Shilkina S.V., Fokina E.N. The controller of fuzzy logic in the management of technological processes. The Russian Automobile and Highway Industry Journal, 2018, vol. 15, no. 1, pp. 106–114. (in Russian). https://doi.org/10.26518/2071-7296-2018-1-106-114
- Savchenko D.V., Reznikova K.M., Smyshlyaeva A.A. Fuzzy logic and fuzzy information technology. Russian Journal of Resources, Conservation and Recycling, 2021, vol. 8, no. 1. Available at: https://resources.today/PDF/10ECOR121.pdf (accessed: 08.10.2023). (in Russian). https://doi.org/10.15862/10ECOR121
- Kiseleva E.A., Kraeva A.A., Savinova Iu.S. Overview of fuzzy logic in management. International journal of applied sciences and technology Integral, 2019, no. 3, pp. 59. (in Russian)
- Veretyokhin A.V., Yachmenova V.M. Evaluation of ecological and economic safety of an industrial enterprise using fuzzy logic tools. St. Petersburg State Polytechnical University Journal. Economics, 2017, vol. 10, no. 3, pp. 140–157. (in Russian). https://doi.org/10.18721/JE.10313