MapReplay: Trace-Driven Benchmark Generation for Java HashMap
- URL: http://arxiv.org/abs/2603.14019v1
- Date: Sat, 14 Mar 2026 16:46:09 GMT
- Title: MapReplay: Trace-Driven Benchmark Generation for Java HashMap
- Abstract summary: We propose MapReplay, a benchmarking methodology that combines the realism of application benchmarks with the efficiency of microbenchmarks.<n>Applying MapReplay to DaCapo-Chopin and Renaissance, the resulting suite, MapReplayBench, reproduces application-level performance trends.
- Score: 1.198637189064676
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Hash-based maps, particularly java.util.HashMap, are pervasive in Java applications and the JVM, making their performance critical. Evaluating optimizations is challenging because performance depends on factors such as operation patterns, key distributions, and resizing behavior. Microbenchmarks are fast and repeatable but often oversimplify workloads, failing to capture the realistic usage patterns. Application benchmarks (e.g., DaCapo, Renaissance) provide realistic usages but are more expensive to run, prone to variability, and dominated by non-HashMap computations, making map-related performance changes difficult to observe. To address this challenge, we propose MapReplay, a benchmarking methodology that combines the realism of application benchmarks with the efficiency of microbenchmarks. MapReplay traces HashMap API usages generating a replay workload that reproduces the same operation sequence while faithfully reconstructing internal map states. This enables realistic and efficient evaluation of alternative implementations under realistic usage patterns. Applying MapReplay to DaCapo-Chopin and Renaissance, the resulting suite, MapReplayBench, reproduces application-level performance trends while reducing experimentation time and revealing insights difficult to obtain from full benchmarks.
Related papers
- Position Rebinding Cache Reuse: Replay-Free Visual Revisiting for Interleaved Multimodal Reasoning [51.563653495547335]
multimodal reasoning improves visual grounding by revisiting visual evidence during multi-step generation.<n>We propose Position Rebinding Cache Reuse (PRCR), a cache-level framework for replay-free visual revisiting.<n>PRCR achieves replay-level or better performance, improving average accuracy by 5 percent and reducing visual-revisiting by up to tens of thousands of times.
arXiv Detail & Related papers (2026-06-25T05:47:52Z) - Misleading Microbenchmarks on the Java Virtual Machines [1.4885603159356078]
On the Java Virtual Machine (JVM), developers often use microbenchmarks to choose the most performant implementation of a method or a class.<n>This paper shows how using microbenchmarks under conditions that induce unrealistic profiles yields misleading results despite following existing guidelines.
arXiv Detail & Related papers (2026-05-22T12:38:12Z) - JEDI: Java Evaluation of Declarative and Imperative Queries [1.6042394978941517]
There is a lack of benchmarks specifically targeting stream-based applications.<n>In this work we present JEDI, a benchmark suite that targets the Stream API.
arXiv Detail & Related papers (2026-05-22T12:07:55Z) - Diamond Maps: Efficient Reward Alignment via Stochastic Flow Maps [54.18537904256945]
Flow and diffusion models produce high-quality samples, but adapting them to user preferences or constraints post-training remains costly and brittle.<n>We argue that efficient reward alignment should be a property of the generative model itself, not an afterthought, and the model for adaptability.<n>We propose "Diamond Maps", flow map models that enable efficient and accurate alignment to arbitrary rewards at inference time.
arXiv Detail & Related papers (2026-02-05T18:42:00Z) - ImLoc: Revisiting Visual Localization with Image-based Representation [61.282162006394934]
We propose to augment each image with estimated depth maps to capture the geometric structure.<n>This representation is easy to build and maintain, but achieves highest accuracy in challenging conditions.<n>Our method achieves a new state-of-the-art accuracy on various standard benchmarks and outperforms existing memory-efficient methods at comparable map sizes.
arXiv Detail & Related papers (2026-01-07T18:51:51Z) - FastMap: Fast Queries Initialization Based Vectorized HD Map Reconstruction Framework [8.28438975701346]
FastMap is an innovative framework designed to reduce decoder redundancy in existing approaches.<n>Our framework eliminates the conventional practice of randomly initializing queries and instead incorporates a heatmap-guided query generation module.<n>FastMap achieves state-of-the-art performance in both nuScenes and Argoverse2 datasets, with its decoder operating 3.2 faster than the baseline.
arXiv Detail & Related papers (2025-03-07T15:01:55Z) - DUFOMap: Efficient Dynamic Awareness Mapping [3.3580006471376205]
The dynamic nature of the real world is one of the main challenges in robotics.
Current solutions are often applied in post-processing, where parameter tuning allows the user to adjust the setting for a specific dataset.
We propose DUFOMap, a novel dynamic awareness mapping framework designed for efficient online processing.
arXiv Detail & Related papers (2024-03-03T09:07:16Z) - Random Representations Outperform Online Continually Learned Representations [68.42776779425978]
We show that existing online continually trained deep networks produce inferior representations compared to a simple pre-defined random transforms.
Our method, called RanDumb, significantly outperforms state-of-the-art continually learned representations across all online continual learning benchmarks.
Our study reveals the significant limitations of representation learning, particularly in low-exemplar and online continual learning scenarios.
arXiv Detail & Related papers (2024-02-13T22:07:29Z) - StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map
Construction [36.1596833523566]
We present StreamMapNet, a novel online mapping pipeline adept at long-sequence temporal modeling of videos.
StreamMapNet employs multi-point attention and temporal information which empowers the construction of large-range local HD maps with high stability.
arXiv Detail & Related papers (2023-08-24T05:22:43Z) - Re-Evaluating LiDAR Scene Flow for Autonomous Driving [80.37947791534985]
Popular benchmarks for self-supervised LiDAR scene flow have unrealistic rates of dynamic motion, unrealistic correspondences, and unrealistic sampling patterns.
We evaluate a suite of top methods on a suite of real-world datasets.
We show that despite the emphasis placed on learning, most performance gains are caused by pre- and post-processing steps.
arXiv Detail & Related papers (2023-04-04T22:45:50Z) - ASH: A Modern Framework for Parallel Spatial Hashing in 3D Perception [91.24236600199542]
ASH is a modern and high-performance framework for parallel spatial hashing on GPU.
ASH achieves higher performance, supports richer functionality, and requires fewer lines of code.
ASH and its example applications are open sourced in Open3D.
arXiv Detail & Related papers (2021-10-01T16:25:40Z) - Verifying a Realistic Mutable Hash Table [0.0]
We verify the mutable LongMap from the standard Scala library, a hash table using open addressing within a single array.
We introduce a new reference swapping construct in Stainless that allows us to apply the decorator pattern without introducing aliasing.
Our performance analysis shows the verified version to be within a 1.5 factor of the original data structure.
arXiv Detail & Related papers (2021-07-16T11:56:07Z) - MAOMaps: A Photo-Realistic Benchmark For vSLAM and Map Merging Quality
Assessment [0.0]
We introduce a novel benchmark that is aimed at quantitatively evaluating the quality of vision-based simultaneous localization and mapping (vSLAM) and map merging algorithms.
The dataset is photo-realistic and provides both the localization and the map ground truth data.
To compare the vSLAM-built maps and the ground-truth ones we introduce a novel way to find correspondences between them that takes the SLAM context into account.
arXiv Detail & Related papers (2021-05-31T14:30:36Z) - Rethinking Localization Map: Towards Accurate Object Perception with
Self-Enhancement Maps [78.2581910688094]
This work introduces a novel self-enhancement method to harvest accurate object localization maps and object boundaries with only category labels as supervision.
In particular, the proposed Self-Enhancement Maps achieve the state-of-the-art localization accuracy of 54.88% on ILSVRC.
arXiv Detail & Related papers (2020-06-09T12:35:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.