AI Shorts

Large language models (LLMs) are renowned for their ability to perform specific tasks due to the principle of fine-tuning their parameters. Full Fine-Tuning (FFT) involves updating all parameters, while Parameter-Efficient Fine-Tuning (PEFT) techniques such as Low-Rank Adaptation (LoRA) update only a small subset, thus reducing memory requirements. LoRA operates by utilizing low-rank matrices, enhancing performance…

The field of Natural Language Processing (NLP) has seen a significant advancement thanks to Large Language Models (LLMs) that are capable of understanding and generating human-like text. This technological progression has revolutionized applications such as machine translation and complex reasoning tasks, and sparked new research and development opportunities. However, a notable challenge has been the…

Language models are integral to the study of natural language processing (NLP), a field that aims to generate and understand human language. Applications such as machine translation, text summarization, and conversational agents rely heavily on these models. However, effectively assessing these approaches remains a challenge in the NLP community due to their sensitivity to differing…

Machine translation (MT) has advanced significantly due to developments in deep learning and neural networks. However, translating literary texts remains a significant challenge due to their complexity, figurative language, and cultural variations. Often referred to as the "last frontier of machine translation," literary translation represents a considerable task for MT systems. Large language models (LLMs) have…

Foundation models are critical to AI's impact on the economy and society, and their transparency is imperative for accountability, understanding, and competition. Governments worldwide are launching regulations such as the US AI Foundation Model Transparency Act and the EU AI Act to promote this transparency. The Foundation Model Transparency Index (FMTI), rolled out in 2023,…