A recent study by Innodata assessed various large language models (LLMs), including Llama2, Mistral, Gemma, and GPT for their factuality, toxicity, bias, and hallucination tendencies. The research used fourteen original datasets to evaluate the safety of these models based on their ability to generate factual, unbiased, and appropriate content. Ultimately, the study sought to help…
An in-depth study by Innodata evaluated the performance of various large language models (LLMs) including Llama2, Mistral, Gemma, and GPT. The study assessed the models based on factuality, toxicity, bias, and propensity for hallucinations and used fourteen unique datasets designed to evaluate each model's safety.
One of the main criteria was factuality, the ability of the…
Complex Human Activity Recognition (CHAR) identifies the actions and behaviors of individuals in smart environments, but the process of labeling datasets with precise temporal information of atomic activities (basic human behaviors) is difficult and can lead to errors. Moreover, in real-world scenarios, accurate and detailed labeling is hard to obtain. Addressing this challenge is important…
Recent research by scientists at Ohio State University and Carnegie Mellon University has analyzed the limitations of large language models (LLMs), such as GPT-4, and their limitations in implicit reasoning. This refers to their ability to make accurate comparisons of internalized facts and properties, even when aware of the entities in question.
The study focused…
Accurate magnetic hysteresis modeling remains a challenging task that is crucial for optimizing the performance of magnetic devices. Traditional methods, such as recurrent neural networks (RNNs), long short-term memory (LSTM) networks, and gated recurrent units (GRUs), have limitations when it comes to generalizing novel magnetic fields. This generalization is vital for real-world applications.
A team of…
Vision-Language Models (VLMs) offer immense potential for transforming various applications, including visual assistance for visually impaired individuals. However, their efficacy is often marred by complexities such as multi-object scenarios and diverse cultural contexts. Recent research highlights these issues in two separate studies focused on multi-object hallucination and cultural inclusivity.
Hallucination in vision-language models occurs when objects…
Legal firms and patent attorneys are often tasked with assessing the validity of a patent or patent claims for intellectual property litigation or patent applications. They typically hire a third-party search provider to find the necessary evidential materials or conduct keyword research. The process of building a claim chart to assess the claims often takes…
In the rapidly advancing field of quantum computing, managing tasks efficiently and effectively is a complex challenge. Traditional models often struggle due to their heuristic approach, which fails to adapt to the intricacies of quantum computing and can lead to inefficient system performance. Task scheduling, therefore, is critical to minimizing time wastage and optimizing resource…
Protein sequence design is a significant part of protein engineering for drug discovery, involving the exploration of vast amino acid sequence combinations. To overcome the limitations of traditional methods like evolutionary strategies, researchers have proposed utilizing reinforcement learning (RL) techniques to facilitate the creation of new protein sequences. This progress comes as advancements in protein…
The use of Large Language Models (LLMs) for automating and assisting in coding holds promise for improving the efficiency of software development. However, the challenge is ensuring these models produce code that is not only helpful but also secure, as the code generated could potentially be used maliciously. This concern is not theoretical, as real-world…
