Researchers at MIT and the University of Washington have developed a model that accounts for the sub-optimal decision-making processes in humans, potentially improving the way artificial intelligence can predict human behavior.
Named 'inference budget,' the model infers an agent's computational constraints, whether human or machine, after observing a few traces of their past actions. It…
Meta has announced the release of upgraded versions of its Llama 3.1 models, spanning 8B, 70B, and 405B variations. The improvements include support in eight languages and an expanded context length of 128k. The 405B model, deemed the largest and most capable foundation model that is freely available, stands out in particular. Its high functionality…
Large language models (LLMs) have gained significant popularity recently, but evaluating them can be quite challenging, particularly for highly specialised client tasks requiring domain-specific knowledge. Therefore, Amazon researchers have developed a new evaluation approach for Retrieval-Augmented Generation (RAG) systems, focusing on such systems' factual accuracy, defined as their ability to retrieve and apply correct information…
DVC.ai has introduced DataChain, a pioneering open-source Python library fashioned to manage and curate massive-scale, unstructured data. By integrating advanced AI and machine learning abilities, DataChain aims to enhance the data processing workflow—making it an essential tool for data scientists and developers.
DataChain's chief features encompass AI-driven data curation, but it also employs local machine learning…
Reinforcement Learning from Human Feedback (RLHF) plays a pivotal role in ensuring the quality and safety of Large Language Models (LLMs), such as Gemini and GPT-4. However, RLHF poses significant challenges, including the risk of forgetting pre-trained knowledge and reward hacking. Existing practices to improve text quality involve choosing the best output from N-generated possibilities,…