Multi-agent Coordination with Deferred Asynchronous Messaging in a Distributed Coordination Space

: cc. 83 - 90
Національний університет «Львівська політехніка»

A method of multi-agent coordination with deferred asynchronous messaging in a distributed coordination space has been proposed. The method has been based on the concept of multi-agent conditional interaction. The method has used 1) a distributed coordination space in which agents move, 2) the rules of state transitions for the coordination space nodes depending on the movements of agents, 3) the rules of agents move and state transitions depending on the states of the coordination space nodes, 4) a multi-agent coordination game based on the coordination space and the rules. The coordination space has been implemented based on the distributed shared memory of agents. The rules have been applied by exchanging deferred asynchronous messages between agents through the distributed shared memory. The agent's decisions about movement in the coordination space and their consequences are interpreted according to the rules in asynchronous messages. Delivery of messages to other agents has been deferred until these agents visit the corresponding nodes of the coordination space. This has ensured 1) mutual exclusion when agents choose conflicting actions, and 2) resilience of multi-agent coordination to agent failures and loss of coordinating messages. Four multi-agent coordination games have been considered as examples. The issue of fault tolerance of the proposed coordination method has been considered. The simulation results show that the use of the method ensures the resilience of multi-agent coordination to agent failures in the considered coordination games.

  1. Dorri, A., Kanhere, S., Jurdak, R. (2018). Multi-Agent Systems: A Survey, in IEEE Access, vol. 6. – pp. 28573‑28593, DOI: 10.1109/ACCESS.2018.2831228.
  2. Rizk, Y., Awad, M., Tunstel, E. (2018). Decision Making in Multi-Agent Systems: A Survey, in IEEE Transactions on Cognitive and Developmental Systems, vol. 10, no. 3. – pp. 514‑529, DOI: 10.1109/TCDS.2018.2840971.
  3. Sun, Z. (2018). Cooperative Coordination and Formation Control for Multi-agent Systems. Springer Cham. – 179 p. DOI: 10.1007/978-3-319-74265-6.
  4. Arup Kumar Sadhu, Amit Konar (2020). Multi-Agent Coordination: A Reinforcement Learning Approach, Wiley. – 320 p.
  5. Binyamin, S., Ben Slama, S. (2022). Multi-Agent Systems for Resource Allocation and Scheduling in a Smart Grid. Sensors, 22, 8099. – pp. 1‑40. DOI: 10.3390/s22218099.
  6. Nezamoddini, N., Gholami, A. (2022). A Survey of Adaptive Multi-Agent Networks and Their Applications in Smart Cities. Smart Cities, 5(1). – pp. 318‑346. DOI: 10.3390/smartcities5010019.
  7. Zhou, L., Zheng, Y., Zhao, Q., Xiao, F., Zhang, Y. (2022). Game-based coordination control of multi-agent systems. Systems & Control Letters. 169. – pp. 1‑24. 105376. DOI: 10.1016/j.sysconle.2022.105376.
  8. Paccagnan, D., Chandan, R., Marden, J. (2022). Utility and mechanism design in multi-agent systems: An overview. Annual Reviews in Control. 53. – pp. 315‑328. DOI: 10.1016/j.arcontrol.2022.02.002.
  9. Jin, B., Cao, M. (2022). Control using Q-learning for networked coordination games, 2022 13th Asian Control Conference (ASCC). – pp. 941‑946. DOI: 10.23919/ASCC56756.2022.9828324.
  10. Merlevede, J., Johnson, B., Grossklags, J., Holvoet, T. (2019). Time-Dependent Strategies in Games of Timing. In: Decision and Game Theory for Security. GameSec 2019. Lecture Notes in Computer Science, vol. 11836. Springer, Cham. – pp. 310‑330. DOI: 10.1007/978-3-030-32430-8_19.
  11. Smirnov, V., Wait, A. (2022). General Timing Games with Multiple Players, (April 22, 2022). – 34 p. Available at SSRN:, DOI: 10.2139/ssrn.4090339.
  12. Merlevede, J., Johnson, B., Grossklags, J., Holvoet, T. (2021). Exponential discounting in security games of timing. Journal of Cybersecurity, Volume 7, Issue 1. – pp. 1‑20. DOI: 10.1093/cybsec/tyaa008.