LLMAID: Identifying AI Capabilities in Android Apps with LLMs

• URL: http://arxiv.org/abs/2511.19059v2
• Date: Fri, 28 Nov 2025 16:36:03 GMT
• Title: LLMAID: Identifying AI Capabilities in Android Apps with LLMs
• Authors: Pei Liu, Terry Zhuo, Jiawei Deng, Thong James, Shidong Pan, Sherry Xu, Zhenchang Xing, Qinghua Lu, Xiaoning Du, Hongyu Zhang,
• Abstract summary: Existing approaches to identify AI capabilities in mobile software mainly rely on manual inspection and rule-based approaches.<n>We propose LLMAID, which includes four main tasks: candidate extraction, knowledge base interaction, AI capability analysis and detection, and AI service summarization.<n>We apply LLMAID to a dataset of 4,201 Android applications to identify 242% more real-world AI apps than state-of-the-art rule-based approaches.
• Score: 20.902333603753572
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent advancements in artificial intelligence (AI) and its widespread integration into mobile software applications have received significant attention, highlighting the growing prominence of AI capabilities in modern software systems. However, the inherent hallucination and reliability issues of AI continue to raise persistent concerns. Consequently, application users and regulators increasingly ask critical questions such as: Does the application incorporate AI capabilities? and What specific types of AI functionalities are embedded? Preliminary efforts have been made to identify AI capabilities in mobile software; however, existing approaches mainly rely on manual inspection and rule-based heuristics. These methods are not only costly and time-consuming but also struggle to adapt advanced AI techniques. To address the limitations of existing methods, we propose LLMAID (Large Language Model for AI Discovery). LLMAID includes four main tasks: (1) candidate extraction, (2) knowledge base interaction, (3) AI capability analysis and detection, and (4) AI service summarization. We apply LLMAID to a dataset of 4,201 Android applications and demonstrate that it identifies 242% more real-world AI apps than state-of-the-art rule-based approaches. Our experiments show that LLM4AID achieves high precision and recall, both exceeding 90%, in detecting AI-related components. Additionally, a user study indicates that developers find the AI service summaries generated by LLMAID to be more informative and preferable to the original app descriptions. Finally, we leverage LLMAID to perform an empirical analysis of AI capabilities across Android apps. The results reveal a strong concentration of AI functionality in computer vision (54.80%), with object detection emerging as the most common task (25.19%).

Related papers

• Embodied AI: From LLMs to World Models [65.68972714346909]
  Embodied Artificial Intelligence (AI) is an intelligent system paradigm for achieving Artificial General Intelligence (AGI)<n>Recent breakthroughs in Large Language Models (LLMs) and World Models (WMs) have drawn significant attention for embodied AI.
  arXiv  Detail & Related papers  (2025-09-24T11:37:48Z)
• MIRA: Empowering One-Touch AI Services on Smartphones with MLLM-based Instruction Recommendation [61.19099947706954]
  This paper introduces MIRA, a pioneering framework for task instruction recommendation.<n>With MIRA, users can long-press on images or text objects to receive contextually relevant instruction recommendations for executing AI tasks.<n> MIRA has demonstrated substantial improvements in the accuracy of instruction recommendation.
  arXiv  Detail & Related papers  (2025-09-17T07:43:14Z)
• Breaking Android with AI: A Deep Dive into LLM-Powered Exploitation [6.269769365534235]
  The rapid evolution of Artificial Intelligence (AI) and Large Language Models (LLMs) has opened up new opportunities in the area of cybersecurity.<n>This study explores Android penetration testing automation using LLM-based tools, especially PentestGPT, to identify and execute rooting techniques.
  arXiv  Detail & Related papers  (2025-09-09T17:17:06Z)
• AI4Research: A Survey of Artificial Intelligence for Scientific Research [55.5452803680643]
  We present a comprehensive survey on AI for Research (AI4Research)<n>We first introduce a systematic taxonomy to classify five mainstream tasks in AI4Research.<n>We identify key research gaps and highlight promising future directions.
  arXiv  Detail & Related papers  (2025-07-02T17:19:20Z)
• ML-Master: Towards AI-for-AI via Integration of Exploration and Reasoning [49.25518866694287]
  We propose ML-Master, a novel AI4AI agent that seamlessly integrates exploration and reasoning by employing a selectively scoped memory mechanism.<n>We evaluate ML-Master on the MLE-Bench, where it achieves a 29.3% average medal rate, significantly surpassing existing methods.
  arXiv  Detail & Related papers  (2025-06-19T17:53:28Z)
• General Scales Unlock AI Evaluation with Explanatory and Predictive Power [57.7995945974989]
  benchmarking has guided progress in AI, but it has offered limited explanatory and predictive power for general-purpose AI systems.<n>We introduce general scales for AI evaluation that can explain what common AI benchmarks really measure.<n>Our fully-automated methodology builds on 18 newly-crafted rubrics that place instance demands on general scales that do not saturate.
  arXiv  Detail & Related papers  (2025-03-09T01:13:56Z)
• Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI [116.8199519880327]
  Embodied Artificial Intelligence (Embodied AI) is crucial for achieving Artificial General Intelligence (AGI)<n>In this survey, we give a comprehensive exploration of the latest advancements in Embodied AI.
  arXiv  Detail & Related papers  (2024-07-09T14:14:47Z)
• Towards Real Smart Apps: Investigating Human-AI Interactions in Smartphone On-Device AI Apps [17.630597106970466]
  A good interaction design is important to make an AI feature usable and understandable. Existing guidelines and tools either do not cover AI features or consider mobile apps. We conducted the first empirical study to explore user-AI-interaction in mobile apps.
  arXiv  Detail & Related papers  (2023-07-03T05:04:34Z)
• An Empirical Study of AI Techniques in Mobile Applications [10.43634556488264]
  We conducted the most extensive empirical study on AI applications, exploring on-device ML apps, on-device DL apps, and AI service-supported (cloud-based) apps. Our study has strong implications for AI app developers, users, and AI R&D.
  arXiv  Detail & Related papers  (2022-12-03T15:31:34Z)
• AI-Assisted Authentication: State of the Art, Taxonomy and Future Roadmap [0.0]
  This paper focuses on the applications of artificial intelligence in authentication. With the emerging AI-assisted authentication schemes, our survey provides an overall understanding on a high level. In contrast to other relevant surveys, our research is the first of its kind to focus on the roles of AI in authentication.
  arXiv  Detail & Related papers  (2022-04-25T21:16:55Z)
• The application of artificial intelligence in software engineering: a review challenging conventional wisdom [0.9651131604396904]
  This survey chapter is a review of the most commonplace methods of AI applied to software engineering. The review covers methods between years 1975-2017, for the requirements phase, 46 major AI-driven methods are found. The purpose of this chapter is to answer the following questions: is there sufficient intelligence in the SE lifecycle?
  arXiv  Detail & Related papers  (2021-08-03T15:59:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.