Better Together: Quantifying the Benefits of AI-Assisted Recruitment

• URL: http://arxiv.org/abs/2507.08029v1
• Date: Tue, 08 Jul 2025 22:51:46 GMT
• Title: Better Together: Quantifying the Benefits of AI-Assisted Recruitment
• Authors: Ada Aka, Emil Palikot, Ali Ansari, Nima Yazdani,
• Abstract summary: We randomly assign 37,000 applicants for a junior-developer position to either a traditional recruitment process or an AI-assisted pipeline.<n>In the AI-assisted pipeline, 54% of candidates passed the final interview compared with 34% from the traditional pipeline.<n>We analyze AI-generated interview transcripts to examine the selection criteria and conversational dynamics.
• Score: 0.6749750044497731
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Artificial intelligence (AI) is increasingly used in recruitment, yet empirical evidence quantifying its impact on hiring efficiency and candidate selection remains limited. We randomly assign 37,000 applicants for a junior-developer position to either a traditional recruitment process (resume screening followed by human selection) or an AI-assisted recruitment pipeline incorporating an initial AI-driven structured video interview before human evaluation. Candidates advancing from either track faced the same final-stage human interview, with interviewers blind to the earlier selection method. In the AI-assisted pipeline, 54% of candidates passed the final interview compared with 34% from the traditional pipeline, yielding an average treatment effect of 20 percentage points (SE 12 pp.). Five months later, we collected LinkedIn profiles of top applicants from both groups and found that 18% (SE 1.1%) of applicants from the traditional track found new jobs compared with 23% (SE 2.3%) from the AI group, resulting in a 5.9 pp. (SE 2.6 pp.) difference in the probability of finding new employment between groups. The AI system tended to select younger applicants with less experience and fewer advanced credentials. We analyze AI-generated interview transcripts to examine the selection criteria and conversational dynamics. Our findings contribute to understanding how AI technologies affect decision making in recruitment and talent acquisition while highlighting some of their potential implications.

Related papers

• MLAR: Multi-layer Large Language Model-based Robotic Process Automation Applicant Tracking [0.0]
  This paper introduces an innovative Applicant Tracking System (ATS) enhanced by a novel Robotic process automation (RPA) framework or as further referred to as MLAR.<n>MLAR addresses these challenges employing Large Language Models (LLMs) in three distinct layers: extracting key characteristics from job postings in the first layer, parsing applicant resume to identify education, experience, skills in the second layer, and similarity matching in the third layer.<n>Our approach integrates seamlessly into existing RPA pipelines, automating resume parsing, job matching, and candidate notifications.
  arXiv  Detail & Related papers  (2025-07-14T16:53:19Z)
• LLMREI: Automating Requirements Elicitation Interviews with LLMs [47.032121951473435]
  This study introduces LLMREI, a chat bot designed to conduct requirements elicitation interviews with minimal human intervention.<n>We evaluated its performance in 33 simulated stakeholder interviews.<n>Our findings indicate that LLMREI makes a similar number of errors compared to human interviewers, is capable of extracting a large portion of requirements, and demonstrates a notable ability to generate highly context-dependent questions.
  arXiv  Detail & Related papers  (2025-07-03T12:18:05Z)
• Enhancing Selection of Climate Tech Startups with AI -- A Case Study on Integrating Human and AI Evaluations in the ClimaTech Great Global Innovation Challenge [41.94295877935867]
  ClimaTech competition aimed to identify top climate tech startups.<n>The methodology included three phases: initial AI review, semi-finals judged by humans, and finals using a hybrid weighting.<n>In the finals, with five human judges, weighting shifted to 83.3 percent human and 16.7 percent AI.
  arXiv  Detail & Related papers  (2025-05-27T02:23:03Z)
• Exploring the Implementation of AI in Early Onset Interviews to Help Mitigate Bias [0.0]
  This paper investigates the application of artificial intelligence (AI) in early-stage recruitment interviews.<n>Results indicate that AI effectively minimizes sentiment-driven biases by 41.2%.
  arXiv  Detail & Related papers  (2025-01-17T00:40:35Z)
• How Performance Pressure Influences AI-Assisted Decision Making [57.53469908423318]
  We show how pressure and explainable AI (XAI) techniques interact with AI advice-taking behavior.<n>Our results show complex interaction effects, with different combinations of pressure and XAI techniques either improving or worsening AI advice taking behavior.
  arXiv  Detail & Related papers  (2024-10-21T22:39:52Z)
• Tree Search for Language Model Agents [69.43007235771383]
  We propose an inference-time search algorithm for LM agents to perform exploration and multi-step planning in interactive web environments. Our approach is a form of best-first tree search that operates within the actual environment space. It is the first tree search algorithm for LM agents that shows effectiveness on realistic web tasks.
  arXiv  Detail & Related papers  (2024-07-01T17:07:55Z)
• Fairness in AI-Driven Recruitment: Challenges, Metrics, Methods, and Future Directions [0.0]
  Recruitment process significantly impacts an organization's performance, productivity, and culture.<n>This paper systematically reviews biases identified in AI-driven recruitment systems, categorizes fairness metrics and bias mitigation techniques, and highlights auditing approaches used in practice.
  arXiv  Detail & Related papers  (2024-05-30T05:25:14Z)
• Skills or Degree? The Rise of Skill-Based Hiring for AI and Green Jobs [0.0]
  This study aims to understand whether employers have begun focusing more on individual skills rather than formal qualifications in their recruitment processes. Our findings provide evidence that employers have initiated "skill-based hiring" for AI roles. In occupations with high demand for AI skills, the premium for skills is high, and the reward for degrees is relatively low.
  arXiv  Detail & Related papers  (2023-12-19T08:40:45Z)
• Improving Selective Visual Question Answering by Learning from Your Peers [74.20167944693424]
  Visual Question Answering (VQA) models can have difficulties abstaining from answering when they are wrong. We propose Learning from Your Peers (LYP) approach for training multimodal selection functions for making abstention decisions. Our approach uses predictions from models trained on distinct subsets of the training data as targets for optimizing a Selective VQA model.
  arXiv  Detail & Related papers  (2023-06-14T21:22:01Z)
• Human-Centric Multimodal Machine Learning: Recent Advances and Testbed on AI-based Recruitment [66.91538273487379]
  There is a certain consensus about the need to develop AI applications with a Human-Centric approach. Human-Centric Machine Learning needs to be developed based on four main requirements: (i) utility and social good; (ii) privacy and data ownership; (iii) transparency and accountability; and (iv) fairness in AI-driven decision-making processes. We study how current multimodal algorithms based on heterogeneous sources of information are affected by sensitive elements and inner biases in the data.
  arXiv  Detail & Related papers  (2023-02-13T16:44:44Z)
• AI-enabled exploration of Instagram profiles predicts soft skills and personality traits to empower hiring decisions [0.0]
  We show that a wide range of behavioral competencies consisting of 16 in-demand soft skills can be automatically predicted from Instagram profiles. Models were built based on a sample of 400 Iranian volunteer users who answered an online questionnaire and provided their Instagram usernames. Deep learning models mostly outperformed by demonstrating 70% and 69% average Accuracy in two-level and three-level classifications respectively.
  arXiv  Detail & Related papers  (2022-12-14T07:35:11Z)
• Partner Matters! An Empirical Study on Fusing Personas for Personalized Response Selection in Retrieval-Based Chatbots [51.091235903442715]
  This paper makes an attempt to explore the impact of utilizing personas that describe either self or partner speakers on the task of response selection. Four persona fusion strategies are designed, which assume personas interact with contexts or responses in different ways. Empirical studies on the Persona-Chat dataset show that the partner personas can improve the accuracy of response selection.
  arXiv  Detail & Related papers  (2021-05-19T10:32:30Z)
• Bias in Multimodal AI: Testbed for Fair Automatic Recruitment [73.85525896663371]
  We study how current multimodal algorithms based on heterogeneous sources of information are affected by sensitive elements and inner biases in the data. We train automatic recruitment algorithms using a set of multimodal synthetic profiles consciously scored with gender and racial biases. Our methodology and results show how to generate fairer AI-based tools in general, and in particular fairer automated recruitment systems.
  arXiv  Detail & Related papers  (2020-04-15T15:58:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.