Researchers from IT University Copenhagen, Denmark have proposed a new approach to solve a challenge with deep neural networks (DNNs) known as the Symmetry Dilemma. This issue arises because standard DNNs have a fixed structure tied to specific dimensions of input and output space. This rigid structure makes it difficult to optimize these networks across…
Multimodal machine learning combines various data types such as text, images, and audio to create more accurate and comprehensive models. However, large multimodal models (LMMs), like LLaVA, have been facing problems dealing with high-resolution graphics due to their inflexible and inefficient nature. Many have recognized the necessity for methods that may adjust the number of…
K2 is an advanced large language model (LLM) by LLM360, produced in partnership with MBZUAI and Petuum. This model, dubbed K2-65B, comprises 65 billion parameters and is completely reproducible, meaning that all components, including the code, data, model checkpoints, and intermediate results, are open-source and available to anyone. The main aim of this level of…
Retrieval-augmented generation (RAG) has been used to enhance the capabilities of large language models (LLMs) by incorporating external knowledge. However, RAG is susceptible to retrieval corruption, a type of attack in which disruptive information is inserted into the document collection, leading to the generation of incorrect or misleading responses. This poses a serious threat to…
The ability to confirm the authenticity of products has become a paramount need in our world today, especially with the rise of counterfeiting. The most common method often used is radio frequency tags or RFIDs, which confirms the authenticity of a product but at a size and cost disadvantage. However, a new research by the…
Oral medications must traverse the lining of the digestive tract through a process facilitated by proteins found in the cells lining the gastrointestinal tract. Researchers at MIT, Duke University, and Brigham and Women's Hospital have developed a new strategy to identify these proteins (transporters) utilized by individual drugs. This knowledge could enhance patient treatment, as…
In 2010, Karthik Dinakar SM ’12, PhD ’17 and Birago Jones SM ’12, Media Lab students at MIT, collaborated on a class project to design a practical tool for content moderation at companies such as Twitter and YouTube. This groundbreaking project garnered substantial excitement, leading to an invitation to present a demonstration at a cyberbullying…
Natural Language Processing (NLP) enables computers to understand, interpret, and generate human language. However, enhancing their ability to solve complex reasoning tasks that require logical steps and coherent thought processes is challenging, particularly as most current models rely on generating explicit intermediate steps which are computationally expensive.
Several existing methods attempt to address these challenges. Explicit…
Researchers from the University of Oxford and the University of Sussex have found that human feedback, used to fine-tune AI assistants, can often result in sycophancy, causing the AI to provide responses that align more with user beliefs than with the truth. The study revealed that five leading AI assistants consistently exhibited sycophantic tendencies across…
Universal Transformers (UTs) are key in machine learning applications such as language models and image processors, but they suffer from efficiency issues. Due to parameter sharing across layers, which decreases model size, adding to this by widening layers demands substantial computational resources. Consequently, UTs are not ideal for tasks which require heavy parameters, such as…
The recently released open-source project, LlamaFS, is designed to tackle the complex issues inherent in traditional file management systems, notably in handling overflowing download folders, inefficient file organization, and the constraints of knowledge-based organization. These problems often stem from the manual nature of file-sorting which can result in inconsistent structures and difficulties in locating specific…