Document type

Article

Version

Published version

Publication date

Publication license

cc by (c) Manel Rodríguez Soto, 2023
Please use this identifier to cite or link to this item: https://hdl.handle.net/2445/224349

Multi-Objective Reinforcement Learning for Designing Ethical Multi-Agent Environments

Journal Title

Director/Tutor

Journal ISSN

Volume Title

Abstract

This paper tackles the open problem of value alignment in multi-agent systems. In particular, we propose an approach to build an ethical environment that guarantees that agents in the system learn a joint ethically-aligned behaviour while pursuing their respective individual objectives. Our contributions are founded in the framework of Multi-Objective Multi-Agent Reinforcement Learning. Firstly, we characterise a family of Multi-Objective Markov Games (MOMGs), the socalled ethical MOMGs, for which we can formally guarantee the learning of ethical behaviours. Secondly, based on our characterisation we specify the process for building single-objective ethical environments that simplify the learning in the multi-agent system. We illustrate our process with an ethical variation of the Gathering Game, where agents manage to compensate social inequalities by learning to behave in alignment with the moral value of beneficence.

Citation

Citation

RODRÍGUEZ SOTO, Manel, LÓPEZ SÁNCHEZ, Maite and RODRÍGUEZ-AGUILAR, Juan A. (Juan Antonio). Multi-Objective Reinforcement Learning for Designing Ethical Multi-Agent Environments. Neural Computing & Applications. 2023. Vol. 37, num. 25619-25644. ISSN 0941-0643. [consulted: 16 of June of 2026]. Available at: https://hdl.handle.net/2445/224349

Export metadata

JSON - METS

Share record