AI Shorts

Aligning artificial intelligence (AI) models with human preferences is a complex process, especially in high-dimensional and sequential decision-making tasks. This alignment is critical for advancing AI technologies like fine-tuning large language models and enhancing robotic policies but is hindered by challenges such as computational complexity, high variance in policy gradients and instability in dynamic programming.…

Autonomous web navigation deals with the development of AI agents used in automating complex online tasks from data mining to booking delivery services. This helps in enhancing productivity by automating certain tasks in both consumer and enterprise domains. Traditional web agents working on such complex web tasks are usually inefficient and prone to errors due…

Autonomous web navigation, which involves using AI agents to perform complex online tasks, is growing in significance. Presently, these AI agents are typically used for tasks such as data retrieval, form submissions, and more sophisticated activities like finding cheap flights or booking accommodations. Utilizing large language models (LLMs) and other AI methodologies, the aim of…

Evaluating the performance of Artificial Intelligence (AI) and Machine Learning (ML) models is crucial, especially with the advent of Large Language Models (LLMs). These evaluations help to assess the abilities of these models and establish reliable systems based on their capabilities. However, certain practices, termed as Questionable Research Practices (QRPs), frequently compromise the authenticity and…

Artificial Intelligence and Machine Learning are rapidly advancing fields, and a crucial aspect of their progress is the evaluation of model performance, particularly with the advent of Large Language Models (LLMs). However, the integrity of these evaluations is often compromised by what are known as Questionable Research Practices (QRPs), which can severely inflate published results…

Large Language Models (LLMs) face several deployment challenges including latency issues triggered by memory bandwidth constraints. To mitigate such problems, researchers have resorted to applying weight-only quantization, a technique that compresses the parameters of LLMs to lower precision. Nevertheless, to effectively implement weight-only quantization, it is necessary to employ mixed-type matrix-multiply kernels that can manage,…