EXAONE 3.5: Series of Large Language Models for Real-world Use Cases

• URL: http://arxiv.org/abs/2412.04862v2
• Date: Mon, 09 Dec 2024 09:31:10 GMT
• Title: EXAONE 3.5: Series of Large Language Models for Real-world Use Cases
• Abstract summary: The EXAONE 3.5 language models are offered in three configurations: 32B, 7.8B, and 2.4B.<n>For commercial use, please reach out to the official contact point of LG AI Research.
• Score: 35.04562823885241
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: This technical report introduces the EXAONE 3.5 instruction-tuned language models, developed and released by LG AI Research. The EXAONE 3.5 language models are offered in three configurations: 32B, 7.8B, and 2.4B. These models feature several standout capabilities: 1) exceptional instruction following capabilities in real-world scenarios, achieving the highest scores across seven benchmarks, 2) outstanding long-context comprehension, attaining the top performance in four benchmarks, and 3) competitive results compared to state-of-the-art open models of similar sizes across nine general benchmarks. The EXAONE 3.5 language models are open to anyone for research purposes and can be downloaded from https://huggingface.co/LGAI-EXAONE. For commercial use, please reach out to the official contact point of LG AI Research: contact_us@lgresearch.ai.

Related papers

• EXAONE 4.5 Technical Report [74.37330398684594]
  This report introduces EXAONE 4.5, the first open-weight vision language model released by LG AI Research.<n> EXAONE 4.5 is architected by integrating a dedicated visual encoder into the existing EXAONE 4.0 framework.<n>The model is trained on large-scale data with careful curation, particularly emphasizing document-centric corpora.
  arXiv  Detail & Related papers  (2026-04-09T17:51:11Z)
• EXAONE 4.0: Unified Large Language Models Integrating Non-reasoning and Reasoning Modes [42.31740630042654]
  EXAONE 4.0 integrates a Non-reasoning mode and a Reasoning mode to achieve both the excellent usability of EXAONE 3.5 and the advanced reasoning abilities of EXAONE Deep.<n>The EXAONE 4.0 model series consists of two sizes: a mid-size 32B model optimized for high performance, and a small-size 1.2B model designed for on-device applications.
  arXiv  Detail & Related papers  (2025-07-15T15:24:51Z)
• EXAONE Deep: Reasoning Enhanced Language Models [35.326172288018505]
  We present EXAONE Deep series, which exhibits superior capabilities in various reasoning tasks. We train our models mainly on the reasoning-specialized dataset that incorporates long streams of thought processes.
  arXiv  Detail & Related papers  (2025-03-16T14:39:33Z)
• Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontier [72.5652085347547]
  We introduce the Aya Expanse model family, a new generation of 8B and 32B parameter multilingual language models.<n>By leveraging several years of research at Cohere For AI and Cohere, Aya Expanse sets a new state-of-the-art in multilingual performance.<n>Our evaluations on the Arena-Hard-Auto dataset, translated into 23 languages, demonstrate that Aya Expanse 8B and 32B outperform leading open-weight models.
  arXiv  Detail & Related papers  (2024-12-05T15:41:06Z)
• EXAONE 3.0 7.8B Instruction Tuned Language Model [41.95996640625627]
  EXAONE 3.0 instruction-tuned language model is the first open model in the family of Large Language Models (LLMs) EXAONE 3.0 demonstrates highly competitive real-world performance with instruction-following capability against other state-of-the-art open models of similar size. Our comparative analysis shows that EXAONE 3.0 excels particularly in Korean, while achieving compelling performance across general tasks and complex reasoning.
  arXiv  Detail & Related papers  (2024-08-07T04:38:38Z)
• Qwen2 Technical Report [141.0766756297144]
  This report introduces the Qwen2 series, the latest addition to our large language models and large multimodal models. Qwen2 surpasses most prior open-weight models, including its predecessor Qwen1.5, and exhibits competitive performance relative to proprietary models. Qwen2 demonstrates robust multilingual capabilities, proficient in approximately 30 languages, spanning English, Chinese, Spanish, French, German, Arabic, Russian, Korean, Japanese, Thai, Vietnamese, and more.
  arXiv  Detail & Related papers  (2024-07-15T12:35:42Z)
• Multi-Task Domain Adaptation for Language Grounding with 3D Objects [25.975947369817487]
  We propose a novel method called Domain Adaptation for Language Grounding (DA4LG) with 3D objects. Specifically, the proposed DA4LG consists of a visual adapter module with multi-task learning to realize vision-language alignment. Experimental results demonstrate that DA4LG competitively performs across visual and non-visual language descriptions.
  arXiv  Detail & Related papers  (2024-07-03T06:47:58Z)
• Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone [289.9290405258526]
  We introduce phi-3-mini, a 3.8 billion parameter language model trained on 3.3 trillion tokens. It achieves 69% on MMLU and 8.38 on MT-bench, despite being small enough to be deployed on a phone. We introduce three models in the phi-3.5 series: phi-3.5-mini, phi-3.5-MoE, and phi-3.5-Vision.
  arXiv  Detail & Related papers  (2024-04-22T14:32:33Z)
• Battle of the Large Language Models: Dolly vs LLaMA vs Vicuna vs Guanaco vs Bard vs ChatGPT -- A Text-to-SQL Parsing Comparison [18.092211166785397]
  In recent times, a number of models have emerged, claiming performance near that of GPT-3.5 or GPT-4. We pit six popular large language models against each other, systematically evaluating their Text-to- parsing capability on nine benchmark datasets. Regrettably, the open-sourced models fell significantly short of the performance achieved by closed-source models like GPT-3.5, highlighting the need for further work to bridge the performance gap between these models.
  arXiv  Detail & Related papers  (2023-10-16T08:52:41Z)
• How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources [117.6496550359768]
  This work explores recent advances in instruction-tuning language models on a range of open instruction-following datasets. We provide a large set of instruction-tuned models from 6.7B to 65B parameters in size, trained on 12 instruction datasets. We evaluate them on their factual knowledge, reasoning, multilinguality, coding, and open-ended instruction following abilities.
  arXiv  Detail & Related papers  (2023-06-07T19:59:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.