Meta's advancements in open-source language models (LLMs) have led to the development of the Llama series, providing users with a platform for experimentation and innovation. Llama 2 advanced this pursuit, utilizing 2 trillion tokens of data from publicly available online sources and 1 million human annotations. The program incorporated safety and practicality by employing reinforcement…
Unleashing the Capabilities of SirLLM: Progress in Enhancing Memory Retention and Attention Systems.
The rapid advancement of large language models (LLMs) has paved the way for the development of numerous Natural Language Processing (NLP) applications, including chatbots, writing assistants, and programming tools. However, these applications often necessitate infinite input lengths and robust memory capabilities, features currently lacking in existing LLMs. Preserving memory and accommodating infinite input lengths remain…
Advancements in Large Language Models (LLMs) technology have burgeoned its use in clinical and medical fields, not only providing medical information, keeping track of patient records, but also holding consultations with patients. LLMs are equipped to generate long-form text compatible for responding to patient inquiries in a thorough manner, ensuring correct and instructive responses.
To…
Machine Translation (MT), part of Natural Language Processing (NLP), aims to automate the translation of text from one language to another using large language models (LLMs). The goal is to improve translation accuracy for better global communication and information exchange. The challenge in improving MT is using high-quality, diverse training data for instruction fine-tuning, which…
Multimodal large language models (MLLMs) are advanced artificial intelligence structures that combine features of language and visual models, increasing their efficiency across a range of tasks. The ability of these models to handle vast different data types marks a significant milestone in AI. However, extensive resource requirements present substantial barriers to their widespread adoption.
Models like…
A team of researchers, including those from the Massachusetts Institute of Technology (MIT), have created a system called StreamingLLM that allows chatbots to maintain ongoing dialogues without suffering from performance issues. The method involves a reconfiguration of the model's key-value cache—a form of memory storage—that commonly leads to models failing when the cache is overloaded…
MIT researchers have developed an antitampering cryptographic ID tag that offers improved security, lower cost and a much smaller size than traditional radio frequency tags. The previous generation of terahertz tags, like radio frequency identifiers (RFIDs), were vulnerable to tampering, as fraudsters could move the tags from genuine to counterfeit goods without the authentication system…
A team of researchers from MIT, Brigham and Women’s Hospital, and Duke University have worked together to develop a method for identifying how different drugs exit the digestive system. This is a key question in pharmacology, as it is often associated with drug interactions and efficacy. In this study, the researchers utilized a combination of…
In 2010, Media Lab students Karthik Dinakar and Birago Jones began a class project to create a tool for content moderation teams at major corporations like Twitter and YouTube. The technology, which generated significant interest, was presented at a White House cyberbullying summit as a mechanism for identifying concerning posts on social media platforms. During…
Artificial intelligence (AI) has become an integral part of many industries, including recruitment. On one hand, this technology helps recruiters scan applications more efficiently. On the other hand, job seekers can use AI to enhance their resumes and even their application photos.
Several AI tools available can transform a casual selfie to a professional headshot suitable…
A new dimension of privacy invasion has emerged with the proliferation of AI "nudify" apps, following the AI boom in Silicon Valley. These AI-powered applications strip the clothes off individuals in photographs, mostly women. The creation of non-consensual explicit content using these apps has attracted millions of online users.
A platform where these "nudify" apps continue…
