Дослідження методів збору та обробки даних в розподілених інформаційних системах

2021;
: 20-38
1
Lviv Polytechnik National University
2
Lviv Polytechnic National University
3
Lviv Polytechnic National University

The article is devoted to the problem of processing and analysis of large amounts of data. Today, with
the advent of sources of information that can produce large amounts of data, data collection is becoming
an increasingly complex institution. To solve this problem, a wide range of technologies for specific
purposes has been developed. However, most of them can be attributed to two paradigms of data
processing, namely streaming and batch. In this article, we will consider the above paradigms and
technologies used to build data processing solutions and try to outline several characteristics that need to
be considered when building data processing systems. Also, based on the most promising solutions, the
implementation of the system of data collection and analysis from IoT devices is given.

  1. Kleppmann M. (2017), Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems, Springfield Missouri United States, O’Reilly Media Inc., pp. 412–425.
  2. Nathan M., James W. (2001), Big Data: Principles and best practices of scalable real time data systems, New York, United States, pp. 320–343.
  3. Anand R., Jeffrey D. (2014), Mining of Massive Datasets, Stanford University, United States California, pp. 422–427.
  4. Nathan M., James W. (2014), Big Data: Principles and best practices of scalable real time data systems, New York, United States, pp. 312–226.
  5. Marr B. (2015), “Big Data: Using SMART Big Data, Analytics and Metrics to Make Better Decisions and Improve Performance”, QUIS5 Quality in Services Conference, Wiley, Karlstad, pp. 222–226.
  6. Srivatsa H., Jagadeesh M. “Big Data Imperatives: Enterprise “Big Data” Warehouse, “BI” Implementations and Analytics, Apress, New York, New York, United States, June 24, 2013, pp. 311–333.
  7. Ahmed Alaa, Haitham Hamza, Amira Kotb, “Performance Evaluation of Open Source IoT Platforms”, available at: https://www.researchgate.net/publication/330582133_Performance_Evaluatio... IoT_Platforms (Accessed 27 April 2021).
  8. Daniel Toran “IoT Platforms Comparisions”, available at: https://upcommons.upc.edu/bitstream/handle/ 2117/114211/tfg-report-daniel-toran.pdf?sequence=1&isAllowed=y (Accessed 27 April 2021).