Files
Document type
ArticleVersion
Published versionPublication date
Publication license
Please use this identifier to cite or link to this item: https://hdl.handle.net/2445/224349
Multi-Objective Reinforcement Learning for Designing Ethical Multi-Agent Environments
Journal Title
Director/Tutor
Journal ISSN
Volume Title
Related resource
Abstract
This paper tackles the open problem of value alignment in multi-agent systems. In particular, we propose an approach to build an ethical environment that guarantees that agents in the system learn a joint ethically-aligned behaviour while pursuing their respective individual objectives. Our contributions are founded in the framework of Multi-Objective Multi-Agent Reinforcement Learning. Firstly, we characterise a family of Multi-Objective Markov Games (MOMGs), the socalled ethical MOMGs, for which we can formally guarantee the learning of ethical behaviours. Secondly, based on our characterisation we specify the process for building single-objective ethical environments that simplify the learning in the multi-agent system. We illustrate our process with an ethical variation of the Gathering Game, where agents manage to compensate social inequalities by learning to behave in alignment with the moral value of beneficence.
Subject (English)
Citation
Citation
RODRÍGUEZ SOTO, Manel, LÓPEZ SÁNCHEZ, Maite and RODRÍGUEZ-AGUILAR, Juan A. (Juan Antonio). Multi-Objective Reinforcement Learning for Designing Ethical Multi-Agent Environments. Neural Computing & Applications. 2023. Vol. 37, num. 25619-25644. ISSN 0941-0643. [consulted: 16 of June of 2026]. Available at: https://hdl.handle.net/2445/224349