In response to a call from MIT President Sally Kornbluth and Provost Cynthia Barnhart, researchers have submitted 75 proposals addressing the use of generative AI. Due to the overwhelming response, a second call was issued, with 53 submissions. A selected 27 from the initial call, and 16 from the second have been granted seed funding.…
Multimodal large language models (MLLMs) are crucial tools for combining the capabilities of natural language processing (NLP) and computer vision, which are needed to analyze visual and textual data. Particularly useful for interpreting complex charts in scientific, financial, and other documents, the prime challenge lies in improving these models to understand and interpret charts accurately.…
In the rapidly advancing field of Artificial Intelligence (AI), evaluating the outputs of models accurately becomes a complex task. State-of-the-art AI systems such as GPT-4 are using Reinforcement Learning with Human Feedback (RLHF) which implies human judgement is used to guide the training process. However, as AI models become intricate, even experts find it challenging…
Last summer, MIT President Sally Kornbluth and Provost Cynthia Barnhart invited researchers to submit papers that lay out effective strategies, policy recommendations, and urgent actions within the field of generative artificial intelligence (AI). Among the 75 received proposals, 27 were selected for seed funding.
Impressed by the level of interest and the quality of ideas,…
Scientists at Sierra presented τ-bench, an innovative benchmark intended to test the performance of language agents in dynamic, realistic scenarios. Current evaluation methods are insufficient and unable to effectively assess if these agents are capable of interacting with human users or comply with complex, domain-specific rules, all of which are crucial for practical implementation. Most…
The field of software engineering has made significant strides with the development of Large Language Models (LLMs). These models are trained on comprehensive datasets, allowing them to efficiently perform a myriad of tasks which comprise of code generation, translation, and optimization. LLMs are increasingly being employed for compiler optimization. However, traditional code optimization methods require…
MIT President, Sally Kornbluth, and Provost, Cynthia Barnhart, issued a call for papers last summer regarding “effective roadmaps, policy recommendations, and calls for action” in the field of generative AI. From the 75 proposals they received, 27 were chosen for seed funding. Following the enormous response, a second call for proposals was launched which resulted…
The Imbue Team announced significant progress in their recent project in which they trained a 70-billion-parameter language model from the ground up. This ambitious endeavor is aimed at outperforming GPT-4 in zero-shot scenarios on several reasoning and coding benchmarks. Notably, they achieved this feat with a training base of just 2 trillion tokens, a reduction…
MIT President Sally Kornbluth and Provost Cynthia Barnhart launched a call for papers last summer to create policy recommendations and effective strategies in the realm of generative AI. The duo received 75 proposals, out of which 27 were picked for seed financing. Encouraged by the response, a second call was held in fall, resulting in…
Large Language Models (LLMs) have played a notable role in enhancing the understanding and generation of natural language. They have, however, faced challenges in processing long contexts due to restrictions in context window size and memory usage. This has spawned research to address these limitations and come up with ways of making the LLMs work…
Large language models (LLMs) have made significant progress in the understanding and generation of natural language, but their application over long contexts is still limited due to constraints in context window sizes and memory usage. It's a pressing concern as the demand for LLMs' ability to handle complex and lengthy tasks is on the rise.
Various…
Scientists led by Themistoklis Sapsis at MIT's Department of Mechanical Engineering have developed a strategy to "correct" the predictions of coarse global climate models, enhancing the accuracy of risk analysis for extreme weather events. Global climate models, used by policymakers to assess a community's risk of severe weather, can predict weather patterns decades or even…