The integration of robotics into automatic assembly procedures is highly valuable but has met with issues adapting to high-mix, low-volume manufacturing. Robotic learning which enables robots to acquire assembly skills through demonstrations, not scripted processes, offers a potential resolution to this problem. However, teaching robots to perform assembly tasks from raw sensor data presents a…
MIT researchers have used a form of artificial intelligence called deep learning to identify a new classification of compounds that can effectively kill methicillin-resistant Staphylococcus aureus (MRSA), a drug-resistant bacterium accountable for over 10,000 deaths in the US each year. The researchers have demonstrated that these deep-learning-identified compounds not only have the ability to kill…
Researchers at Massachusetts Institute of Technology (MIT) are seeking to leverage deep learning technology to provide a more detailed and accurate understanding of Earth's planetary boundary layer (PBL). The definition and structure of the PBL are pivotal to improving weather forecasting, climate projections, and issues such as drought conditions.
The PBL is the lowest part of…
Language models (LMs) such as BERT or GPT-2 are faced with challenges in self-supervised learning due to a phenomenon referred to as representation degeneration. These models work by training neural networks using token sequences to generate contextual representations, with a language modeling head, often a linear layer with variable parameters, producing next-token distributions of probability.…
Researchers at MIT have introduced a new technique for artists that could revolutionise the way animated characters are brought to life in movies and games. The technique is based on barycentric coordinates, a mathematical function that defines how 2D and 3D shapes can move and bend. This is a significant advance on existing techniques which…
MIT researchers have utilized deep learning, a form of artificial intelligence, to discover a series of compounds capable of killing a drug-resistant bacterium responsible for over 10,000 deaths in the United States annually. The research, published in Nature, demonstrates these compounds can kill methicillin-resistant Staphylococcus aureus (MRSA) in lab dishes and two mouse models. Apart…
MIT had a remarkable year in 2023, achieving progress on several fronts from scientific discoveries to spearheading community initiatives. Among the notable events were the inauguration of MIT President Sally Kornbluth, the Commencement address by Mark Rober, and Professor Moungi Bawendi receiving the Nobel Prize in Chemistry for his research on quantum dots.
The institution made…
Due to the need for long-sequence support in large language models (LLMs), a solution to the problematic key-value (KV) cache bottleneck needs addressing. LLMs like GPT-4, Gemini, and LWM are becoming increasingly prominent in apps such as chatbots and financial analysis, but the substantial memory footprint of the KV cache and their auto-regressive nature make…
MLCommons, a joint venture of industry and academia, has built a collaborative platform to improve AI safety, efficiency, and accountability. The MLCommons AI Safety Working Group established in late 2023 focuses on creating benchmarks for evaluating AI safety, tracking its progress, and encouraging safety enhancements. Its members, with diverse expertise in technical AI, policy, and…
Artificial Intelligence (AI) has conventionally been spearheaded by statistical learning methods that are excellent at uncovering patterns from sizeable datasets. However, these tend to uncover correlations rather than causations, a differentiator that is of immense importance given correlation does not infer causation. Causal AI is an emerging, transformative approach that strives to comprehend the 'why'…