Event Information

CS Seminar: Jayesh Gupta, "Deep Implicit Coordination Graphs for Multi-agent Reinforcement Learning" Wednesday, October 21, 2020 1:30 p.m. For More Information: https://www.cs.umd.edu/talks/rlss Computer Science Reinforcement Learning Seminar Series (RLSS) Deep Implicit Coordination Graphs for Multi-Agent Reinforcement Learning Jayesh Gupta Stanford and Microsoft Research   ZOOM LINK: https://umd.zoom.us/j/2920984437 Abstract Multi-agent reinforcement learning (MARL) requires coordination to efficiently solve certain tasks. Fully centralized control is often infeasible in such domains due to the size of joint action spaces. Coordination graph based formalization allows reasoning about the joint action based on the structure of interactions. However, they often require domain expertise in their design. In this talk, we will discuss the recently introduced deep implicit coordination graph (DICG) architecture for such scenarios. DICG consists of a module for inferring the dynamic coordination graph structure which is then used by a graph neural network based module to learn to implicitly reason about the joint actions or values. DICG allows learning the tradeoff between full centralization and decentralization via standard actor-critic methods to significantly improve coordination for domains with large numbers of agents. PRIMARY PAPER: https://arxiv.org/abs/2006.11438 All talks are listed at https://www.cs.umd.edu/talks/rlss, and recordings and slides will be linked there a few days after the talk.