K2 is an advanced large language model (LLM) by LLM360, produced in partnership with MBZUAI and Petuum. This model, dubbed K2-65B, comprises 65 billion parameters and is completely reproducible, meaning that all components, including the code, data, model checkpoints, and intermediate results, are open-source and available to anyone. The main aim of this level of…
