Charting the Growth of Social-Physical HRI (spHRI): A Systematic Review Pipeline Augmented by Small Language Models
- URL: http://arxiv.org/abs/2606.26382v1
- Date: Wed, 24 Jun 2026 21:09:20 GMT
- Title: Charting the Growth of Social-Physical HRI (spHRI): A Systematic Review Pipeline Augmented by Small Language Models
- Abstract summary: Social-physical human-robot interaction (spHRI) has grown rapidly across robotics, human-computer interaction, human-robot interaction, and haptics.<n>We evaluated the extent to which small language models (SLMs) can assist with title and abstract screening for a large spHRI systematic review.
- Score: 0.45880283710344055
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Social-physical human-robot interaction (spHRI) has grown rapidly across robotics, human-computer interaction, human-robot interaction, and haptics. Yet, fragmented terminology and inconsistent methodologies make systematic synthesis difficult. To support scalable review practices, we evaluated the extent to which small language models (SLMs; < 1.5B parameters) can assist with title and abstract screening for a large spHRI systematic review. While no SLMs matched human reviewers' performance, the models operated locally and screened papers orders of magnitude faster. The combined SLM ensemble identified 39 papers reviewers missed, representing 10.29% of the final relevant dataset. These results demonstrate that SLMs can augment, rather than replace, expert reviewers and make large-scale literature reviews accessible and sustainable.
Related papers
- AgentSLR: Automating Systematic Literature Reviews in Epidemiology with Agentic AI [10.216500161437777]
We study whether large language models can automate the complete systematic review workflow.<n>Applying to epidemiological reviews of nine WHO-designated priority pathogens, our pipeline achieves performance comparable to human researchers.
arXiv Detail & Related papers (2026-03-20T17:11:58Z) - Pitfalls in Evaluating Interpretability Agents [91.49742416116635]
We build an agentic system in which a research agent iteratively designs experiments and refines hypotheses.<n>Our work demonstrates fundamental challenges in evaluating complex automated interpretability systems.
arXiv Detail & Related papers (2026-03-20T16:27:17Z) - Evaluating Zero-Shot and One-Shot Adaptation of Small Language Models in Leader-Follower Interaction [1.3511057160494195]
Leader-follower interaction is an important paradigm in human-robot interaction (HRI)<n>Small language models (SLMs) offer a potential alternative, but their effectiveness for role classification in HRI has not been systematically evaluated.
arXiv Detail & Related papers (2026-02-26T18:20:26Z) - Ontological grounding for sound and natural robot explanations via large language models [6.358448988089591]
This paper presents a hybrid framework that blends ontology-based reasoning with large language models (LLMs) to produce semantically grounded and natural robot explanations.<n>Ontologies ensure logical consistency and domain grounding, while LLMs provide fluent, context-aware and adaptive language generation.<n>We integrate a state-of-the-art algorithm for retrieving and constructing static contrastive-based narratives with an LLM agent that uses them to produce concise, clear, interactive explanations.
arXiv Detail & Related papers (2026-02-14T14:23:11Z) - How Do We Research Human-Robot Interaction in the Age of Large Language Models? A Systematic Review [25.744333061791284]
Large language models (LLMs) are profoundly reshaping the field of human-robot interaction (HRI)<n>We conducted a systematic literature search following the PRISMA guideline, identifying 86 articles that met our inclusion criteria.<n>Our findings reveal that: (1) LLMs are transforming the fundamentals of HRI by reshaping how robots sense context, generate socially grounded interactions, and maintain continuous alignment with human needs in embodied settings; and (2) current research is largely exploratory, with different studies focusing on different facets of LLM-driven HRI.
arXiv Detail & Related papers (2026-02-13T13:55:43Z) - Leveraging LLMs for Semi-Automatic Corpus Filtration in Systematic Literature Reviews [5.911820207772152]
We propose a pipeline leveraging multiple large language models (LLMs), classifying papers based on descriptive prompts and deciding jointly.<n>The entire process is human-supervised and interactively controlled via our open-source visual analytics web interface, LLMSurver.<n>Results demonstrate that our pipeline significantly reduces manual effort while achieving lower error rates than single human annotators.
arXiv Detail & Related papers (2025-10-13T13:48:29Z) - Advancing AI Research Assistants with Expert-Involved Learning [84.30323604785646]
Large language models (LLMs) and large multimodal models (LMMs) promise to accelerate biomedical discovery, yet their reliability remains unclear.<n>We introduce ARIEL (AI Research Assistant for Expert-in-the-Loop Learning), an open-source evaluation and optimization framework.<n>We find that state-of-the-art models generate fluent but incomplete summaries, whereas LMMs struggle with detailed visual reasoning.
arXiv Detail & Related papers (2025-05-03T14:21:48Z) - Bias and Fairness in Large Language Models: A Survey [73.87651986156006]
We present a comprehensive survey of bias evaluation and mitigation techniques for large language models (LLMs)
We first consolidate, formalize, and expand notions of social bias and fairness in natural language processing.
We then unify the literature by proposing three intuitive, two for bias evaluation, and one for mitigation.
arXiv Detail & Related papers (2023-09-02T00:32:55Z) - Sentiment Analysis in the Era of Large Language Models: A Reality Check [69.97942065617664]
This paper investigates the capabilities of large language models (LLMs) in performing various sentiment analysis tasks.
We evaluate performance across 13 tasks on 26 datasets and compare the results against small language models (SLMs) trained on domain-specific datasets.
arXiv Detail & Related papers (2023-05-24T10:45:25Z) - Large Language Models are Not Yet Human-Level Evaluators for Abstractive
Summarization [66.08074487429477]
We investigate the stability and reliability of large language models (LLMs) as automatic evaluators for abstractive summarization.
We find that while ChatGPT and GPT-4 outperform the commonly used automatic metrics, they are not ready as human replacements.
arXiv Detail & Related papers (2023-05-22T14:58:13Z) - TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion
Synthesis [59.465092047829835]
We present TMR, a simple yet effective approach for text to 3D human motion retrieval.
Our method extends the state-of-the-art text-to-motion synthesis model TEMOS.
We show that maintaining the motion generation loss, along with the contrastive training, is crucial to obtain good performance.
arXiv Detail & Related papers (2023-05-02T17:52:41Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.