MIT PhD students interning at the MIT-IBM Watson AI Lab are researching ways to improve the efficiency and accuracy of AI systems in understanding and communicating through natural language. The team, including Athul Paul Jacob, Maohao Shen, Victor Butoi, and Andi Peng, aims to enhance each stage of the process involving natural language models, from…
Researchers from MIT and other institutions have developed a method to prevent AI chatbots from failing during extensive conversations. The team's solution centres on the key-value cache (KV Cache), or the chatbot's memory, within language models. Existing models often fail when the cache is overloaded with information, as incoming data pushes out the initial data.…
