Large Language Models (LLMs) have successfully replicated human-like conversational abilities and demonstrated proficiency in coding. However, they continue to grapple with the challenges of maintaining high reliability and stringent abidance to ethical and safety measures. Reinforcement Learning from Human Feedback (RLHF) or Preference-based Reinforcement Learning (PbRL) has emerged as a promising solution to help fine-tune…
Significant advancements have been made in the field of robotics research with the integration of large language models (LLMs) into robotic systems. This development has enabled robots to better tackle complex tasks that demand detailed planning and sophisticated manipulation, bridging the gap between high-level planning and robotic control. However, challenges persist in transforming the remarkable…
Neural Architecture Search (NAS) is a method used by researchers to automate the development of optimal neural network architectures. These architectures are created for a specific task and are then evaluated against a performance metric on a validation dataset. However, earlier NAS methods encountered several issues due to the need to extensively train each candidate…
Deep learning is continuously evolving with attention mechanism playing an integral role in improving sequence modeling tasks. However, this method significantly bogs down computation with its quadratic complexity, especially in hefty long-context tasks such as genomics and natural language processing. Despite efforts to enhance its computational efficiency, existing techniques like Reformer, Routing Transformer, and Linformer…
The shift towards renewable energy sources and increased consumer demand due to electric vehicles and heat pumps has significantly influenced the electricity generation landscape. This shift has also resulted in a grid that is subject to fluctuating inputs, thus necessitating an adaptive power infrastructure. Research suggests that bus switching at the substation can help stabilize…
Traditional fully-connected feedforward neural networks or Multi-layer Perceptrons (MLPs), while effective, suffer from limitations such as high parameter usage and lacking interpretability in complex models such as transformers. These issues have led to the exploration of more efficient and effective alternatives. One such refined approach that has been attracting attention is the Kolmogorov-Arnold Networks (KANs),…