The use of pretrained language models and their creative applications have contributed to significant improvements in the quality of information retrieval (IR). However, there are questions about the necessity and efficiency of training these models on large datasets, especially for languages with scant labeled IR data or niche domains.
Researchers from the University of Waterloo,…
