Researchers from Alibaba Group and the Renmin University of China have developed an advanced version of MultiModal Large Language Models (MLLMs) to better understand and interpret images rich in text content. Named DocOwl 1.5, this innovative model uses Unified Structure Learning to enhance the efficiency of MLLMs across five distinct domains: document, webpage, table, chart,…
"Text mining" refers to the discovery of new patterns and insights within large amounts of textual data. Two essential activities in text mining are the creation of a taxonomy - a collection of structured, canonical labels that characterize features of a corpus - and text classification, which assigns labels to instances within the corpus according…
HuggingFace researchers have developed a new tool called Quanto to streamline the deployment of deep learning models on devices with limited resources, such as mobile phones and embedded systems. The tool addresses the challenge of optimizing these models by reducing their computational and memory footprints. It achieves this by using low-precision data types, such as…
The capabilities of computer vision studies have been vastly expanded due to deep features, which can unlock image semantics and facilitate diverse tasks, even using minimal data. Techniques to extract features from a range of data types – for example, images, text, and audio – have been developed and underpin a number of applications in…
Large language models like GPT-4, while powerful, often struggle with basic visual perception tasks such as counting objects in an image. This can be due to the way these models process high-resolution images. Current AI systems can mainly perceive images at a fixed low resolution, leading to distortion, blurriness, and loss of detail when the…
Research in materials science is increasingly focusing on the rapid discovery and characterization of materials with specific attributes. A key aspect of this research is the comprehension of crystal structures, which are naturally complex due to their periodic and infinite nature. This complexity presents significant challenges when attempting to model and predict material properties, difficulties…
The production of realistic human facial images has been a long-standing challenge for researchers in machine learning and computer vision. Earlier techniques like Eigenfaces utilised Principal Component Analysis (PCA) to learn statistical priors from data, yet they notably struggled to capture the complexities of real-world factors such as lighting, viewpoints, and expressions beyond frontal poses.…
In the world of machine learning, large language models (LLMs) are a significant area of study. Recently, model merging or the combination of multiple LLMs into a single framework has fascinated the researcher's community because it doesn't require any additional training. This reduces the cost of creating new models considerably, sparking an interest in model…
Researchers and developers often need to execute large language models (LLMs), such as Generative Pre-trained Transformers (GPT), with efficiency and speed. The choice of hardware greatly influences performance during these processing tasks, with the two main contenders being Central Processing Units (CPUs) and Graphics Processing Units (GPUs).
CPUs are standard in virtually all computing devices and…
The debate over the necessity of copyrighted materials to train top Artificial Intelligence (AI) models continues to be a hot topic within the AI industry. This discussion was fueled further when OpenAI proclaimed to the UK Parliament in 2023 that it's 'impossible' to train these models without using copyrighted content, resulting in legal disputes and…
Artificial intelligence (AI) is an industry that is developing at a rapid pace. However, there are several challenges that exist in transitioning research innovations into practical applications. It can be a difficult task to improve the quality of AI models to match the standards required for production. Even though researchers can create robust models, adapting…