K-EXAONE 2.0 Technical Report
- URL: http://arxiv.org/abs/2608.04505v1
- Date: Wed, 05 Aug 2026 06:41:48 GMT
- Title: K-EXAONE 2.0 Technical Report
- Abstract summary: K-EXAONE 2.0 is an open-weight multilingual foundation model developed by LG AI Research.<n>Released under the Apache 2.0 license, K-EXAONE 2.0 enables the wider AI ecosystem to evaluate, deploy, adapt, and build upon it.
- Score: 59.84003637088418
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: This technical report presents K-EXAONE 2.0, an open-weight multilingual foundation model developed by LG AI Research as a step in our effort toward global frontier-scale foundation models. Rather than training from scratch, we upcycle K-EXAONE and expand its architecture, yielding a Mixture-of-Experts (MoE) model with 750B total parameters and approximately 37B activated per token---more than three times the capacity of its predecessor. K-EXAONE 2.0 supports context lengths of up to 256K tokens and expands multilingual coverage from six to ten languages. Its training pipeline combines continual pre-training, difficulty-focused mid-training, and post-training to strengthen reasoning, agentic coding, multilingual capability, and safety grounded in Korean sociocultural contexts. Across nine evaluation categories selected to reflect the conditions of practical use, K-EXAONE 2.0 improves over K-EXAONE and remains competitive with open-weight models, showing its largest gains in agentic coding and long-context understanding and its clearest strengths in long-context retrieval and safety. Released under the Apache 2.0 license, K-EXAONE 2.0 enables the wider AI ecosystem to evaluate, deploy, adapt, and build upon it, while marking the beginning---rather than the endpoint---of our challenge toward the global frontier.
Related papers
- ZGCM-1: A Fully Open and Extremely Efficient Foundation Model for Math and Agentic Search [54.43696074323815]
ZGCM-1 is a fully open 7B foundation model trained from scratch with extreme data, system, and algorithmic efficiency.<n>We establish an AI-native R&D workflow where agent swarms autonomously manage cluster operations.<n>ZGCM-1-7B is competitive across 7B model family on general benchmarks.
arXiv Detail & Related papers (2026-09-11T17:18:04Z) - Kimi K3: Open Frontier Intelligence [244.27422883681837]
We introduce Kimi K3, a 2.8T parameter Mixture-of-Experts model with 104 billion activated parameters, native vision capabilities, and a 1-million-token context window.<n>Kimi K3 is built on Kimi Delta Attention and Attention Residuals, which improve information flow across sequence length and model depth.<n>We show that Kimi K3 achieves frontier-level performance across long-horizon coding, agentic, knowledge, reasoning, and vision tasks.
arXiv Detail & Related papers (2026-07-27T16:49:54Z) - K-EXAONE Technical Report [76.23621600385238]
K-EXAONE is a large-scale multilingual language model developed by LG AI Research.<n>It supports a 256K-token context window and covers six languages: Korean, English, Spanish, German, Japanese, and Vietnamese.<n>We evaluate K-EXAONE on a comprehensive benchmark suite spanning reasoning, agentic, general, Korean, and multilingual abilities.
arXiv Detail & Related papers (2026-01-05T02:30:59Z) - Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Data [55.65426108082807]
We build Uni-MoE-2.0- Omni from scratch through three core contributions.<n>It is capable of omnimodal understanding, as well as generating images, text, and speech.
arXiv Detail & Related papers (2025-11-16T14:10:55Z) - Kimi K2: Open Agentic Intelligence [118.78600121345099]
Kimi K2 is a large language model with 32 billion activated parameters and 1 trillion total parameters.<n>Based on MuonClip, K2 was pre-trained on 15.5 trillion tokens with zero loss spike.<n>Kimi K2 achieves state-of-the-art performance among open-source non-thinking models.
arXiv Detail & Related papers (2025-07-28T05:35:43Z) - HyperCLOVA X THINK Technical Report [0.0]
We introduce HyperCLOVA X THINK, the first reasoning-focused large language model in the HyperCLOVA X family.<n>It pre-trained on roughly $6$ trillion high-quality Korean, and English tokens, augmented with targeted synthetic Korean data.<n>It delivers competitive performance against similarly sized models on Korea-focused benchmarks.
arXiv Detail & Related papers (2025-06-27T17:23:12Z) - EXAONE 3.0 7.8B Instruction Tuned Language Model [41.95996640625627]
EXAONE 3.0 instruction-tuned language model is the first open model in the family of Large Language Models (LLMs)
EXAONE 3.0 demonstrates highly competitive real-world performance with instruction-following capability against other state-of-the-art open models of similar size.
Our comparative analysis shows that EXAONE 3.0 excels particularly in Korean, while achieving compelling performance across general tasks and complex reasoning.
arXiv Detail & Related papers (2024-08-07T04:38:38Z) - Efficient and Effective Vocabulary Expansion Towards Multilingual Large
Language Models [9.359647125218359]
This report introduces textttEEVE-Korean-v1.0, a Korean adaptation of large language models.
Our method can significantly boost non-English proficiency within just 2 billion tokens.
arXiv Detail & Related papers (2024-02-22T17:12:39Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.