Staff

Carnegie Mellon University researchers are exploring the complexities of multi-agent imitation learning (MAIL), a mediation strategy in which a group of agents (like drivers on a road network) are coordinated through action recommendations, despite the mediator lacking knowledge of their utility functions. The challenge of this approach lies in specifying the quality of those recommendations,…

Researchers from Carnegie Mellon University are examining the challenge of a mediator coordinating a group of strategic agents without knowledge of their underlying utility functions, referred to as multi-agent imitation learning (MAIL). This is a complex issue as it involves providing personalised, strategic guidance to each agent without a comprehensive understanding of their circumstances or…

The phenomenon of "model collapse" represents a significant challenge in artificial intelligence (AI) research, particularly impacting large language models (LLMs). When these models are continually trained on data created by earlier versions of similar models, they lose their ability to accurately represent the underlying data distribution, deteriorating in effectiveness over successive generations. Current training methods of…

The rapid development of Transformer models in natural language processing (NLP) has brought about significant challenges, particularly with memory requirements for the training of these large-scale models. A new paper addresses these issues by presenting a new methodology called MINI-SEQUENCE TRANSFORMER (MST) which optimizes memory usage during long-sequence training without compromising performance. Traditional approaches such as…