An extended study on addressing defender teamwork while accounting for uncertainty in attacker defender games using iterative Dec-MDPs

Multi-agent teamwork and defender-attacker security games are two areas that are currently receiving significant attention within multi-agent systems research. Unfortunately, despite the need for effective teamwork among multiple defenders, little has been done to harness the teamwork research in security games. The problem that this paper seeks to solve is the coordination of decentralized defender agents in the presence of uncertainty while securing targets against an observing adversary. To address this problem, we offer the following novel contributions in this paper: (i) New model of security games with defender teams that coordinate under uncertainty; (ii) New algorithm based on column generation that utilizes Decentralized Markov Decision Processes (Dec-MDPs) to generate defender strategies that incorporate uncertainty; (iii) New techniques to handle global events (when one or more agents may leave the system) during defender execution; (iv) Heuristics that help scale up in the number of targets and agents to handle real-world scenarios; (v) Exploration of the robustness of randomized pure strategies. The paper opens the door to a potentially new area combining computational game theory and multi-agent teamwork.

The final publication is available at IOS Press through https://dx.doi.org/10.3233/MGS-150236

Files

  • MAGS15-1.pdf

    size: 1.26 MB | mime_type: application/pdf | date: 2024-03-07 | sha256: ed6e307

Metadata

Work Title An extended study on addressing defender teamwork while accounting for uncertainty in attacker defender games using iterative Dec-MDPs
Access
Open Access
Creators
  1. Eric Shieh
  2. Albert Xin Jiang
  3. Amulya Yadav
  4. Pradeep Varakantham
  5. Milind Tambe
Keyword
  1. Game theory
  2. Dec-MDP
  3. Security
  4. Stackelberg Games
  5. Security Games
License In Copyright (Rights Reserved)
Work Type Article
Publisher
  1. Multiagent and Grid Systems
Publication Date 2015
Publisher Identifier (DOI)
  1. https://doi.org/10.3233/MGS-150236
Deposited March 07, 2024

Versions

Analytics

Collections

This resource is currently not in any collection.

Work History

Version 1
published

  • Created
  • Added MAGS15-1.pdf
  • Added Creator Eric Shieh
  • Added Creator Albert Xin Jiang
  • Added Creator Amulya Yadav
  • Added Creator Pradeep Varakantham
  • Added Creator Milind Tambe
  • Published
  • Updated Keyword, Publication Date Show Changes
    Keyword
    • Game theory, Dec-MDP, Security, Stackelberg Games, Security Games
    Publication Date
    • 2016-01-06
    • 2015
  • Updated