The technology industry has been heavily focused on the development and enhancement of machine decision-making capabilities, especially with large language models (LLMs). Traditionally, decision-making in machines was improved through reinforcement learning (RL), a process of learning from trial and error to make optimal decisions in different environments. However, the conventional RL methodologies tend to concentrate…
The implementation of APIs into Large Language Models (LLMs) is a major step towards complex, functional AI systems like hotel reservations or job applications through conversational interfaces. However, the development of these systems relies heavily on the LLM's ability to accurately identify APIs, fill the necessary parameters, and sequence API calls based on the user's…
The constant progression of natural language processing (NLP) has brought about an era of advanced, large language models (LLMs) that can accomplish complex tasks with a considerably high level of accuracy. However, these models are costly in terms of computational requirements and memory, limiting their application in environments with finite resources. Model quantization is a…
The development of Large Language Models (LLMs) such as GPT and LLaMA has significantly revolutionized natural language processing (NLP). They have found use in a broad range of functions, causing a growing demand for custom LLMs amongst individuals and corporations. However, the development of these LLMs is resource-intensive, posing a significant challenge for potential users.
To…
The BigCode project has successfully developed StarCoder2, the second iteration of an advanced large language model designed to revolutionise the field of software development. A collaboration between over 30 top universities and institutions, StarCoder2 uses machine learning to optimise code generation, making it easier to fix bugs and automate routine coding tasks.
Training StarCoder2 on…
Language models' performance pertains to their efficiency and ability to recall information, with demand for these capabilities high as artificial intelligence continues to tackle the intricacies of human language. Researchers from Stanford University, Purdue University, and the University at Buffalo have developed an architecture, called Based, differing significantly from traditional methodologies. Its aim is to…
IBM Research has unveiled "SimPlan", an innovative method designed to enhance the planning capabilities of large language models (LLMs), which traditionally struggle with mapping out action sequences toward achieving an optimal outcome. The SimPlan method, developed by researchers from IBM, combines the linguistic skills of LLMs with the structured approach of classical planning algorithms, addressing…
In a world filled with complexity and unpredictability, making informed decisions often proves difficult. The conventional strategies and human expertise often fall short, especially in sectors such as business, finance, and agriculture that involve high stakes and uncertainty. Enter DeLLMa – a Decision-making Large Language Model Assistant developed by researchers from the University of Southern…
Researchers from the School of Computer Science and Engineering at Beihang University in Beijing, China, and Microsoft have developed an improved framework for Low-rank Adaptation (LoRA), known as ResLoRA. Improving LoRA is necessary to address the challenge of high costs which are incurred when fine-tuning Large Language Models (LLMs) on specific datasets, due to their…
The development of artificial intelligence models that can handle both human language and code has been a significant focus for researchers. The goal is to create models that break down linguistic barriers and facilitate more intuitive interactions between humans and machines. This challenge encompasses understanding multiple languages and the intricate syntax and semantics of programming…
The urban and spatial planning sector is a rapidly evolving field that increasingly requires the integration of advanced technology. This not only expedites planning processes, but also improves the precision and efficacy of urban development strategies. Amid this technological revolution, the advent of specialised large language models (LLMs), designed for specific industries, has occurred. This…