1. CSN
  2. All Volumes and Issues
  3. Volume 5, Number 1, 2023
  4. Methods of tracking an arbitrary number of objects in real-time on a mobile platform

Methods of tracking an arbitrary number of objects in real-time on a mobile platform

CSN.
2023;
Volume 5, Number 1
: pp. 50 - 59
https://doi.org/10.23939/csn2023.01.050
Authors:
  1. Dmytro Kushnir
1
Lviv Polytechnic National University, Computer Engineering Department

The problem of choosing methods for tracking recognized objects in real-time for systems with limited hardware capabilities is considered. It was determined that for such scenarios, it is appropriate to integrate tracking methods into the device, bypassing data transmission via the Internet.

Existing methods of tracking an arbitrary number of objects in real-time are considered. Among the performance evaluation metrics, the following were used: MOTA, MOTP, F1, MT, ML, ID, and FM.

Based on the primary analysis of the effectiveness of such methods according to the metrics mentioned above, it was proposed to use the V-IOU tracking method to track recognized objects on a mobile platform in a mobile cyber-physical system.

V-IOU
Arbitrary Object Class Tracking
mobile platform
real-time
MOTA
MOTP
cyber-physical system
  1. Hambling, D. (2023), Drones killing without oversight?, New Scientist, 260(3461), 1-8. https://doi.org/10.1016/S0262-4079(23)01937-1.
  2. Kushnir, D. (2023). Methods and means of searching and recognizing objects in video images on the mobile platform in real-time. [Doctoral dissertation., Lviv Polytechnic National University»]. Institutional                repository                 of                  Lviv                  Polytechnic                 National                University. https://lpnu.ua/sites/default/files/2023/radaphd/23565/diskushnir.pdf
  3. Niu, W., Ma, X., Lin, S., Wang, S., Qian, X., Lin, X., ... & Ren, B. (2020). Patdnn: Achieving real-time dnn execution on mobile devices with pattern-based weight pruning. In Proceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems, 907–922. https://doi.org/10.1145/3373376.3378534.
  4. Thakkar, M. (2019). Beginning machine learning in iOS: CoreML Framework. Apress. https://doi.org/10.1007/978-1-4842-4297-1.
  5. Dewantoro, G., Mansuri, J., & Setiaji, F. D. (2021). Comparative Study of Computer Vision Based Line Followers Using Raspberry Pi and Jetson Nano. Jurnal Rekayasa Elektrika, 17(4). https://doi.org/10.17529/jre.v17i4.21324.
  6. Puchtler, P., & Peinl, R. (2020, September). Evaluation of deep learning accelerators for object detection at the edge. In German Conference on Artificial Intelligence (Künstliche Intelligenz). Springer, Cham. 320-326. https://doi.org/10.1007/978-3-030-58285-2_29.
  7. Parmar, M. (2016). A survey of video object tracking methods. IJEDR. 4(1). 519-524. https://www.ijedr.org/papers/IJEDR1601086.pdf.
  8. Kushnir, D. (2022) Methods and means for small dynamic objects recognition and tracking. Computers, Materials & Continua, 73(2), 3649–3655. https://doi.org/10.32604/cmc.2022.030016.
  9. Patel, S. K., & Mishra, A. (2013). Moving object tracking techniques: A critical review. Indian Journal of Computer Science and Engineering, 4(2), 95-102. https://dx.doi.org/10.2139/ssrn.3548453.
  10. Taufique, A. M. N., Minnehan, B., & Savakis, A. (2020). Benchmarking deep trackers on aerial videos. Sensors, 20(2), 547. https://doi.org/10.3390/s20020547.
  11. Zhang, X., Chen, X., Sun, W., & He, X. (2021). Vehicle Re-Identification Model Based on Optimized DenseNet121 with Joint Loss. Cmc-computers materials & continua, 67(3), 3933-3948. https://doi.org/ 10.32604/cmc.2021.016560.
  12. Sun, W., Dai, L., Zhang, X., Chang, P., & He, X. (2022). RSOD: Real-time small object detection algorithm in UAV-based traffic monitoring. Applied Intelligence, 52(8), 8448-8463. https://doi.org/10.1007/s10489- 021-02893-3.
  13. Wu, M., Cao, X., & Guo, S. (2020). Accurate detection and tracking of ants in indoor and outdoor environments. bioRxiv. https://doi.org/10.1101/2020.11.30.403816.
  14. Bochinski, E., Senst, T., & Sikora, T. (2018, November). Extending IOU based multi-object tracking by visual information. In 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) IEEE. 1-6. https://doi.org/ 10.1109/AVSS.2018.8639144.
  15. Milan, A., Leal-Taixé, L., Reid, I., Roth, S., & Schindler, K. (2016). MOT16: A benchmark for multi-object tracking. arXiv preprint arXiv:1603.00831. https://doi.org/10.48550/arXiv.1603.00831.
  16. Panteleev, O., & Oliynik, V. (2018). Method of visual multitracking in real time based on correlation filters. Adaptive systems of automatic control, 1(32), 97-106. https://doi.org/10.20535/1560-8956.32.2018.145620.
  17. Wojke, N., & Bewley, A. (2018, March). Deep cosine metric learning for person re-identification. In 2018 IEEE winter conference on applications of computer vision (WACV). IEEE. 748-756. https://doi.org/10.1109/WACV.2018.00087.
  18. Kushnir, D., & Paramud, Y. (2020). The inteligenсe algorithm of Cyber–Physical system targeting on a movable object using the smart sensor unit. Computer Systems And Networks, 2(1), 44-52. https://doi.org/10.23939/csn2020.01.044.
  19. Milan, A., Leal-Taixé, L., Reid, I., Roth, S., & Schindler, K. (2016). MOT16: A benchmark for multi-object tracking. arXiv preprint arXiv:1603.00831. https://doi.org/10.48550/arXiv.1603.00831.
  20. Kushnir, D., & Paramud, Y. (2020). The algorithm of Cyber-Physical system targeting on a movable object using the smart sensor unit. Advances In Cyber-Physical Systems, 5(1), 16-22. https://doi.org/10.23939/acps2020.01.016.