Emerging research from the New York University's Center for Data Science asserts that language models based on transformers play a key role in driving AI forward. Traditionally, these models have been used to interpret and generate human-like sequences of tokens, a fundamental mechanism used in their operational framework. Given their wide range of applications, from…
Text-to-image (T2I) models, which transform written descriptions into visual images, are pushing boundaries in the field of computer vision. The principal challenge lies in the model's capability to accurately represent the fine-detail specified in the corresponding text, and despite generally high visual quality, there often exists a significant disparity between the intended description and the…
Contrastive learning has emerged as a powerful tool for training models in recent times. It is used to learn efficient visual representations by aligning image and text embeddings. However, a tricky aspect of contrastive learning is the extensive computation required for pairwise similarity between image and text pairs, particularly when working with large-scale datasets.
This issue…
In-context learning (ICL) in large language models (LLMs) is a cutting-edge subset of machine learning that uses input-output examples to adapt to new tasks without changing the base model architecture. This methodology has revolutionized how these models manage various tasks by learning from example data during the inference process. However, the current setup, referred to…
In-context learning (ICL) in large language models utilizes input and output examples to adapt to new tasks. While it has revolutionized how models manage various tasks, few-shot ICL struggles with more complex tasks that require a deep understanding, largely due to its limited input data. This presents an issue for applications that require detailed analysis…
Large Language Models (LLMs) are a critical component of several computational platforms, driving technological innovation across a wide range of applications. While they are key for processing and analyzing a vast amount of data, they often face challenges related to high operational costs and inefficiencies in system tool usage.
Traditionally, LLMs operate under systems that activate…
Reinforcement Learning (RL) is a method of learning that engages an agent with its environment to gather experiences and maximize received rewards. Given the policy rollouts necessary in the experience collection and improvement process, this is known as online RL. However, these online interactions required by both on-policy and off-policy RL can be impractical due…
Training vision-language models (VLMs) traditionally requires centralized aggregation of large datasets, a process that raises issues of privacy and scalability. A recent solution to this issue is federated learning, a methodology allowing models to train across a range of devices while maintaining local data. However, adapting VLMs to this framework presents its challenges. Intel Corporation…
Time series forecasting is a crucial tool leveraged by numerous industries, including meteorology, finance, and energy management. As organizations today strive towards precision in forecasting future trends and patterns, time series forecasting has emerged as a game-changer. It not only refines decision-making processes but also helps optimize resource allocation over extended periods. However, making accurate…
Neural language models (LMs), particularly those based on transformer architecture, have gained prominence due to their theoretical basis and their impact on various Natural Language Processing (NLP) tasks. These models are often evaluated within the context of binary language recognition, but this approach may create a disconnect between a language model as a distribution over…
The practice of biomedical research extensively depends on the accurate identification and classification of specialized terms from a vast array of textual data. This process, termed Named Entity Recognition (NER), is crucial for organizing and utilizing information found within medical literature. The proficient extraction of these entities from texts assists researchers and healthcare professionals in…