AI in the Enterprise: How People Use M365 Copilot Chat
- URL: http://arxiv.org/abs/2605.23958v1
- Date: Mon, 11 May 2026 23:13:26 GMT
- Title: AI in the Enterprise: How People Use M365 Copilot Chat
- Abstract summary: M365 Copilot is used by millions of people across more than a million companies around the world.<n>This paper characterizes that usage through direct classification of user interactions with M365 Copilot Chat.
- Score: 15.721786457496977
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: M365 Copilot is used every week by millions of people across more than a million companies around the world as part of their workflows. Uniquely positioned in the AI landscape given its near-exclusive use for work purposes, M365 Copilot can offer a clear picture of how people use AI for work and where that usage may expand next. This paper characterizes that usage through direct classification of user interactions with M365 Copilot Chat. Based on an anonymized and privacy-preserving analysis of a sample of approximately 5.5 million sessions, we combine a learned classification of user intent with a classification of O*NET work activities done with M365 Copilot Chat. We find that M365 Copilot is emerging as an everyday assistant for knowledge work: writing dominates, but users also rely on it for information retrieval, analysis, decision making and strategizing, and evaluating and diagnosing programs and systems, among others. Information seeking tasks remain common, but time trends suggest a relative shift away from ``chat as search'' and toward content and communication-related work. Comparisons across occupational groupings and to work done in the labor market further show that usage is broad but uneven, where the relative share of work done with M365 Copilot Chat cuts across jobs in some cases and is occupation-specific in others. Areas of relative underrepresentation in the labor market suggest the next frontier for enterprise AI adoption.
Related papers
- ACME: A Multi-Cultural, Multi-Embodiment Social-Navigation Dataset [51.60529216343344]
ACME: A Cross-cultural, Multi-Embodiment dataset for social navigation.<n>ACME is a large-scale data collection effort across 8 sites in 5 countries, using 7 robot embodiments.<n>Unlike prior datasets, it focuses on capturing goal-driven social navigation behavior in complex social scenarios with explicit robot-crowd interaction through robot speech.
arXiv Detail & Related papers (2026-07-24T04:23:21Z) - Google's AI & Economy ATLAS v1.0: Mapping Gemini Usage in the Economy [0.6108840581138503]
ATLAS is built on 15 million de-identified interactions across the Gemini App, Google AI Mode, and Gemini API.<n>We map AI usage to over 800 occupations, 4000 tasks, 300 household activities, 150 countries, and 140 languages.<n>In the workplace, we show that while AI adoption spans occupations covering just above 88% of US employment, penetration remains shallow and overwhelmingly collaborative in nature.<n>Outside of work, AI spans activities making up about 98% of Americans' non-sleep time, with disproportionately high use in high-friction tasks such as engaging with government and professional service providers.
arXiv Detail & Related papers (2026-07-22T22:20:37Z) - "Can You Tell Me?": Designing Copilots to Support Human Judgement in Online Information Seeking [2.901725877154321]
This paper introduces an LLM-based conversational copilot designed to scaffold information evaluation.<n>Our mixed-methods analysis reveals that users engaged deeply with the copilot, demonstrating metacognitive reflection.<n>The copilot did not significantly improve answer correctness or search engagement, largely due to a "time-on-chat vs. exploration" trade-off.
arXiv Detail & Related papers (2026-01-16T13:33:54Z) - It's About Time: The Temporal and Modal Dynamics of Copilot Usage [1.073011790082595]
We analyze 37.5 million conversations with Microsoft's Copilot between January and September 2025.<n>We find that how people use AI depends on context and device type.
arXiv Detail & Related papers (2025-12-07T21:45:20Z) - Code with Me or for Me? How Increasing AI Automation Transforms Developer Workflows [60.04362496037186]
We present the first controlled study of developer interactions with coding agents.<n>We evaluate two leading copilot and agentic coding assistants.<n>Our results show agents can assist developers in ways that surpass copilots.
arXiv Detail & Related papers (2025-07-10T20:12:54Z) - Working with AI: Measuring the Applicability of Generative AI to Occupations [6.459048123863439]
We analyze a dataset of 200k anonymized conversations between users and Microsoft Bing Copilot.<n>We find the most common work activities people seek AI assistance for involve gathering information and writing.<n>The most common activities that AI itself is performing are providing information and assistance, writing, teaching, and advising.
arXiv Detail & Related papers (2025-07-10T17:16:33Z) - A Qualitative Study of User Perception of M365 AI Copilot [11.684396657620981]
We present results from a six month trial of M365 Copilot conducted at our organisation in 2024.<n>The study explored user perceptions of M365 Copilot's effectiveness, productivity impact, evolving expectations, ethical concerns, and overall satisfaction.<n>While M365 Copilot demonstrated value in specific operational areas, its broader impact remained constrained by usability limitations and the need for human oversight.
arXiv Detail & Related papers (2025-03-22T06:11:10Z) - CowPilot: A Framework for Autonomous and Human-Agent Collaborative Web Navigation [70.3224918173672]
CowPilot is a framework supporting autonomous as well as human-agent collaborative web navigation.<n>It reduces the number of steps humans need to perform by allowing agents to propose next steps, while users are able to pause, reject, or take alternative actions.<n>CowPilot can serve as a useful tool for data collection and agent evaluation across websites.
arXiv Detail & Related papers (2025-01-28T00:56:53Z) - TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks [55.03911355902567]
We introduce TheAgentCompany, a benchmark for evaluating AI agents that interact with the world in similar ways to those of a digital worker.<n>We find that the most competitive agent can complete 30% of tasks autonomously.<n>This paints a nuanced picture on task automation with simulating LM agents in a setting a real workplace.
arXiv Detail & Related papers (2024-12-18T18:55:40Z) - WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Tasks [85.95607119635102]
Large language models (LLMs) can mimic human-like intelligence.<n>WorkArena++ is designed to evaluate the planning, problem-solving, logical/arithmetic reasoning, retrieval, and contextual understanding abilities of web agents.
arXiv Detail & Related papers (2024-07-07T07:15:49Z) - WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks? [83.19032025950986]
We study the use of large language model-based agents for interacting with software via web browsers.
WorkArena is a benchmark of 33 tasks based on the widely-used ServiceNow platform.
BrowserGym is an environment for the design and evaluation of such agents.
arXiv Detail & Related papers (2024-03-12T14:58:45Z) - Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflow [49.28944613907541]
Industries such as finance, meteorology, and energy generate vast amounts of data daily.<n>We propose Data-Copilot, a data analysis agent that autonomously performs querying, processing, and visualization of massive data tailored to diverse human requests.
arXiv Detail & Related papers (2023-06-12T16:12:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.