Google AI researchers have developed a new Transformer network dubbed TransformerFAM, aimed to enhance performance in handling extremely long context tasks. Despite Transformers proving revolutionary in the domain of deep learning, they have limitations due to their quadratic attention complexity— an aspect that curtails their ability to process infinitely long inputs. Existing Transformers often forget…
A new MIT study has found that computational models derived from machine learning that mimic the structure and function of the human auditory system could help improve the design of hearing aids, cochlear implants, and brain-machine interfaces. Its research explored deep neural networks trained to perform auditory tasks and showed that these models generate internal…
The process of identifying the fleeting chemical transition states that occur during reactions could be significantly sped up thanks to a machine learning system developed by researchers from MIT. At present, these states can be calculated using quantum chemistry, but this process is time and computing power intensive, often taking days to calculate a single…
Photolithography, the technique used to create computer chips and optical devices, often results in minuscule deviations from design intentions. With the goal of closing the gap between design and manufacturing, a team of researchers from MIT and the Chinese University of Hong Kong, led by mechanical engineering graduate student Cheng Zheng, used machine learning to…
Scientists from the Massachusetts Institute of Technology have used machine learning to expedite calculations of transition states in chemical reactions, a process that could support the invention of new reactions and catalysts with applications in fuels, pharmaceuticals and understanding the origins of life. Using a method known as density functional theory to compute transition states…
Scientists at MIT have developed a machine learning-based technique for rapidly calculating the transition state of a chemical reaction, a step that was previously extremely time-consuming using traditional quantum chemistry methods. The transition state is a crucial yet fleeting phase in any reaction, marking the point where molecules have gained enough energy for a reaction…
Using artificial intelligence in the form of deep learning, researchers from MIT have discovered compounds capable of killing methicillin-resistant Staphylococcus aureus (MRSA), a drug-resistant bacteria that reportedly causes over 10,000 deaths in the U.S. each year. This breakthrough was achieved by training a deep learning model using predictive information based on antibiotic potency of a…
The transition of Reinforcement Learning (RL) from theory to real-world application has been hampered by sample inefficiency, especially in risky exploration environments. The challenges include a distribution shift between the target policy and the collected data, resulting in overestimation bias and an overly optimistic target policy. A new method proposed by researchers from Oxford University,…