Robotic manipulation policies are currently limited by their inability to extrapolate beyond their training data. While these policies can adapt to new situations, such as different object positions or lighting, they struggle with unfamiliar objects or tasks, and require assistance to process unseen instructions.
Promisingly, vision and language foundation models, like CLIP, SigLIP, and Llama…
Researchers from MIT and the MIT-IBM Watson AI Lab have developed a language-based navigational strategy for AI robots. The method uses textual descriptions instead of visual information, effectively simplifying the process of robotic navigation. Visual data traditionally requires significant computational capacity and detailed hand-crafted machine-learning models to function effectively. The researchers' approach involves converting a…
The University of Cambridge's research team is making strides towards creating a robotic "third thumb" designed to increase human productivity and dexterity. This innovation, which you wear on the hand opposite to your natural thumb, is the handiwork of the university's Head Designer & Senior Technical Specialist at Plasticity Lab, Dani Clode. This invention was…
MIT researchers have developed a technique to train robots on multiple tasks by combining and optimising data from a variety of sources. At the core of their work is a type of generative AI known as a 'diffusion model', which learns from a specific dataset to complete a task. However, the particular innovation here lies…
The MIT Morningside Academy for Design (MAD) unveiled the 2024 Design Fellows at an event held at the MIT Museum on May 1, 2024. The Academy has continually supported MIT graduate students since its inception in 2022 by providing them with a fellowship enabling the pursuit of design research and projects, along with community-building. Interns…
SkyNet is a fictional artificial superintelligence system from the Terminator movie series that becomes sentient and attempts to eradicate all humans. The antagonist in the 1984 release and subsequent films, SkyNet's portrayal tapped into public anxieties around the creation of machines that could quickly surpass human intelligence— a concept that feels increasingly plausible today as…
Researchers from MIT Computer Science and Artificial Intelligence Laboratory (CSAIL) have designed a new type of game to enhance how artificial intelligence (AI) comprehends and produces text. This "consensus game" includes two parts of an AI system - the part that generates sentences and a part that evaluates those sentences. This model significantly improved the…
Scientists at MIT have been working on the design and control of a reconfigurable, squishy, soft robot, similar in nature to 'slime', that has potential applications in healthcare, wearable devices and industrial systems due to its ability to shape-shift to complete varying tasks. These soft robots currently only exist in labs and do not possess…
Researchers at the MIT Computer Science and Artificial Intelligence Laboratory (CSAIL) presented three papers at the International Conference on Learning Representations, indicating breakthroughs in Large Language Models' (LLMs) abilities to form useful abstractions. The team used everyday words for context in code synthesis, AI planning, and robotic navigation and manipulation.
The three frameworks, LILO, Ada,…