Granite Embedding R2 Models
- URL: http://arxiv.org/abs/2508.21085v1
- Date: Tue, 26 Aug 2025 19:06:29 GMT
- Title: Granite Embedding R2 Models
- Abstract summary: The Granite Embedding R2 models are a family of high-performance English encoder-based embedding models engineered for enterprise-scale dense retrieval applications.<n>The models demonstrate exceptional versatility across standard benchmarks, IBM-developed evaluation suites, and real-world enterprise use cases.<n>All models are publicly available under the Apache 2.0 license, enabling unrestricted research and commercial use.
- Score: 19.202549503734428
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We introduce the Granite Embedding R2 models, a comprehensive family of high-performance English encoder-based embedding models engineered for enterprise-scale dense retrieval applications. Building upon our first-generation release, these models deliver substantial improvements, including 16x expanded context length (8,192 tokens), state-of-the-art performance across diverse retrieval domains - text, code, long-document search, multi-turn conversational, and tabular data - and measurable speed advantages of 19-44\% over leading competitors while maintaining superior accuracy. Our release encompasses both bi-encoder and cross-encoder architectures, featuring a highly effective 22-layer retriever model and its efficient 12-layer counterpart, alongside a high-quality reranker model, all trained exclusively on enterprise-appropriate data with comprehensive governance oversight. The models demonstrate exceptional versatility across standard benchmarks, IBM-developed evaluation suites, and real-world enterprise use cases, establishing new performance standards for open-source embedding models. In an era where retrieval speed and accuracy are paramount for competitive advantage, the Granite R2 models deliver a compelling combination of cutting-edge performance, enterprise-ready licensing, and transparent data provenance that organizations require for mission-critical deployments. All models are publicly available under the Apache 2.0 license at https://huggingface.co/collections/ibm-granite, enabling unrestricted research and commercial use.
Related papers
- MADE: Belief-Driven Dual-Agent Coordination for Autonomous Model Deployment [19.126846876843356]
LLM-based agents struggle with domain-specific tasks, motivating the integration of external tools.<n>Open-source community offers vast array of AI models typically released as heterogeneous research artifacts.<n>Transforming these into ready-to-call APIs is costly and labor-intensive.<n>We introduce Model Automated Deployment Engine (MADE), a dual-agent coordination system.
arXiv Detail & Related papers (2026-08-02T12:14:43Z) - The Case Against Generation for Retrieval: Discriminative Language Models as Effective Retrievers [49.488975839992044]
Large Language Models (LLMs) have emerged as powerful assets for recommender systems.<n> deploying them as generative recommenders or zero-shot rankers at web-scale remains bottlenecked by prohibitive computational overhead and grounding challenges.<n>In this paper, we revitalize the classic, highly efficient two-tower retrieval architecture by adapting LLMs as semantic representation backbones rather than generative engines.
arXiv Detail & Related papers (2026-07-28T06:47:53Z) - M*: A Modular, Extensible, Serving System for Multimodal Models [62.77975969000349]
We present M*, a universal serving system for efficient serving of composite AI models.<n>We show how it can concisely capture composite models from a broad range of families.<n>M* also outperforms the V-JEPA 2-AC rollout baseline for robotic planning by up to 12.5x.
arXiv Detail & Related papers (2026-06-10T21:22:22Z) - Granite Embedding Multilingual R2 Models [15.357030277691614]
Granite Embedding R2 models support 52 languages and programming code.<n>State-of-the-art overall performance across multilingual and cross-lingual text search, code retrieval, long-document search, and reasoning retrieval datasets.
arXiv Detail & Related papers (2026-05-13T13:37:45Z) - Stacked from One: Multi-Scale Self-Injection for Context Window Extension [69.24689919827817]
modelname is a novel framework based on multi-grained context compression and query-aware information acquisition.<n>modelnameachieves performance superior or comparable to strong baselines.
arXiv Detail & Related papers (2026-03-05T03:16:16Z) - LimiX: Unleashing Structured-Data Modeling Capability for Generalist Intelligence [61.46575527504109]
LimiX-16M and LimiX-2M treat structured data as a joint distribution over variables and missingness.<n>We evaluate LimiX models across 11 large structured-data benchmarks with broad regimes of sample size, feature dimensionality, class number, categorical-to-numerical feature ratio, missingness, and sample-to-feature ratios.
arXiv Detail & Related papers (2025-09-03T17:39:08Z) - Leveraging Generative Models for Real-Time Query-Driven Text Summarization in Large-Scale Web Search [54.987957691350665]
Query-Driven Text Summarization (QDTS) aims to generate concise and informative summaries from textual documents based on a given query.<n>Traditional extractive summarization models, based primarily on ranking candidate summary segments, have been the dominant approach in industrial applications.<n>We propose a novel framework to pioneer the application of generative models to address real-time QDTS in industrial web search.
arXiv Detail & Related papers (2025-08-28T08:51:51Z) - gpt-oss-120b & gpt-oss-20b Model Card [128.07668730833967]
We present two open-weight reasoning models that push the frontier of accuracy and inference cost.<n>The models use an efficient mixture-of-expert transformer architecture and are trained using large-scale distillation and reinforcement learning.
arXiv Detail & Related papers (2025-08-08T19:24:38Z) - KaLM-Embedding-V2: Superior Training Techniques and Data Inspire A Versatile Embedding Model [46.95431131609286]
KaLM-Embedding-V2, a versatile and compact embedding model, achieves impressive performance in general-purpose text embedding tasks.<n>Key innovations include: (i) pre-training on large-scale weakly supervised open-source corpora; (ii) fine-tuning on high-quality retrieval and non-retrieval datasets; and (iii) model-soup parameter averaging for robust generalization.
arXiv Detail & Related papers (2025-06-26T01:09:44Z) - Towards A Generalist Code Embedding Model Based On Massive Data Synthesis [35.04242699869519]
We introduce textbfCodeR (underlineCode underlineRetrieval), a state-of-the-art embedding model for general-purpose code retrieval.<n>The superior performance of CodeR is built upon CodeR-Pile, a large-scale synthetic dataset constructed under the DRU principle.
arXiv Detail & Related papers (2025-05-19T04:37:53Z) - Granite Embedding Models [26.86244952892162]
We introduce the Granite Embedding models, a family of encoder-based embedding models designed for retrieval tasks.<n>This report provides the technical details of training these highly effective 12 layer embedding models, along with their efficient 6 layer distilled counterparts.<n>We publicly release all our Granite Embedding models under the Apache 2.0 license, allowing both research and commercial use at https://huggingface.co/collections/ibm-granite.
arXiv Detail & Related papers (2025-02-27T15:45:16Z) - Granite Vision: a lightweight, open-source multimodal model for enterprise Intelligence [88.74800617923083]
We introduce Granite Vision, a lightweight large language model with vision capabilities.<n>Our model is trained on a comprehensive instruction-following dataset.<n> Granite Vision achieves strong results in standard benchmarks related to visual document understanding.
arXiv Detail & Related papers (2025-02-14T05:36:32Z) - Data-Juicer Sandbox: A Feedback-Driven Suite for Multimodal Data-Model Co-development [67.55944651679864]
We present a new sandbox suite tailored for integrated data-model co-development.<n>This sandbox provides a feedback-driven experimental platform, enabling cost-effective and guided refinement of both data and models.
arXiv Detail & Related papers (2024-07-16T14:40:07Z) - VeriCompress: A Tool to Streamline the Synthesis of Verified Robust
Compressed Neural Networks from Scratch [10.061078548888567]
AI's widespread integration has led to neural networks (NNs) deployment on edge and similar limited-resource platforms for safety-critical scenarios.
This study introduces VeriCompress, a tool that automates the search and training of compressed models with robustness guarantees.
The method trains models 2-3 times faster than the state-of-the-art approaches, surpassing relevant baseline approaches by average accuracy and robustness gains of 15.1 and 9.8 percentage points, respectively.
arXiv Detail & Related papers (2022-11-17T23:42:10Z) - Large Dual Encoders Are Generalizable Retrievers [26.42937314291077]
We show that scaling up the model size brings significant improvement on a variety of retrieval tasks.
Our dual encoders, textbfGeneralizable textbfT5-based dense textbfRetrievers (GTR), outperform %ColBERTcitekhattab2020colbert and existing sparse and dense retrievers.
arXiv Detail & Related papers (2021-12-15T05:33:27Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.