System Architecture of Data Organization for Smartcities Based on the Data Mesh Concept

The growing use of diverse software solutions has become an integral part of processes involving the selection, transmission, storage, and processing of large-scale data sets and collections characterized by volume, variety, velocity, veracity, value, variability, visualization, and more. This trend creates a heightened demand for highly efficient data processing tools capable of adapting to rapidly changing environments and heterogeneous data sources. Data warehouses and data lakes are modern information technology concepts that have been thoroughly developed and successfully implemented across a wide range of institutions and organizations to meet information needs arising from decision-making processes, which are increasingly being automated with intelligent analytical tools. An analysis of architectural decisions in the development of modern software-algorithmic systems highlights the need for a shift in computational paradigms to enable a more data-oriented approach. In this proposed model, data is considered the foundational element in process organization, while pipeline processing tools are treated as an induced secondary issue. The Data Mesh concept involves the development of an information technology architecture where data is intentionally distributed across multiple mesh nodes to prevent chaos or bottlenecks in data management processes. Thus, centralized data governance strategies are introduced to ensure consistent application of shared principles across all mesh nodes. This approach enhances the efficiency of business operations, improves organizational agility, and reduces the system’s dependency on a single point of failure, facilitating the implementation of systemic policies for continuous improvement in data management.