Governing AI-Assisted Security Operations: A Design Science Framework for Operational Decision Support
- URL: http://arxiv.org/abs/2605.09534v1
- Date: Sun, 10 May 2026 13:35:17 GMT
- Title: Governing AI-Assisted Security Operations: A Design Science Framework for Operational Decision Support
- Abstract summary: This study uses Kusto Query Language (KQL) and Microsoft Azure security capabilities as a bounded technical instantiation of an engineering management problem.<n>The study develops a governed AI query-broker artifact that separates AI planning from operational execution.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Engineering managers increasingly must decide how to introduce generative artificial intelligence (AI), retrieval-augmented generation, and coding agents into high-risk operational functions without weakening accountability, privacy, cost discipline, or auditability. The central message of this study is that AI-assisted operational decision support should be managed as a governed engineering capability before it is scaled as automation. Security operations centers (SOCs) provide a suitable setting because they combine privileged telemetry, specialist expertise, software repositories, cloud services, and evidence-sensitive decisions. This study uses Kusto Query Language (KQL) and Microsoft Azure security capabilities as a bounded technical instantiation of that broader engineering management problem. KQL is read-only in ordinary query use, but read-only does not mean risk-free: AI-assisted queries can still create privacy, cost, performance, schema-validity, and decision-quality risks through broad scans, sensitive-field exposure, stale intelligence, and misleading interpretations. Using design science research, the study develops a governed AI query-broker artifact that separates AI planning from operational execution through schema-grounded retrieval, approved templates, policy validation, read-only adapters, normalized outputs, auditable agent traces, and engineering review board gates. The contribution is not a new KQL technique, security product, or detection algorithm. Rather, the study contributes a management framework for governing AI-assisted operational decision support in high-risk digital infrastructure by specifying design propositions, role accountability, maturity stages, quality gates, evaluation criteria, and evidence boundaries.
Related papers
- AI Deployment Accountability Engineering: A Vision for Accountable AI in Safety-Critical Socio-Technical Systems [14.280538199149634]
This vision paper introduces AI Deployment Accountability Engineering (ADAE)<n>ADAE is a proposed AI engineering subdiscipline concerned with establishing measurable, continuous, and actionable accountability for deployed AI systems.<n>We articulate a research agenda built around four interconnected pillars: structured discovery of context-dependent failure modes, privacy-preserving accountability measurement, system-level risk analysis for agentic AI, and translation of technical failures into operational, and institutional risks.
arXiv Detail & Related papers (2026-09-13T15:18:41Z) - RAIL: An Automatic Classifier of the Artificial Intelligence Readiness Level [0.0]
Assessing the maturity of artificial intelligence technologies is essential for investment decisions, project management, and policy monitoring.<n>The available readiness frameworks are heterogeneous and difficult to apply automatically.<n>This paper makes two contributions: first, we unify these three frameworks into the Unified AI Readiness Level (AIRL), a nine-level scale built on an environmental evidence ladder.<n>Second, we propose RAIL, a panel-of-experts classifier that operationalizes the scale.
arXiv Detail & Related papers (2026-08-13T16:17:41Z) - Engineering Trustworthy Agentic AI for Critical Systems [1.8015174793525714]
The study adopts a trustworthiness model organized around five cross-cutting dimensions: safety and constraint satisfaction; robustness and reliability; transparency and interpretability; accountability and auditability; and privacy and security.<n>Building on this foundation, agentic systems architectures, threats, concrete trust mechanisms, and quantitative metrics are surveyed for direct application in agentic systems development and evaluation.<n>These principles are then examined across four constraint-bound engineering domains: power systems, autonomous vehicles/robotics/UAVs, high-performance computing, and communication networks.
arXiv Detail & Related papers (2026-07-20T22:28:16Z) - Toward Third-Party Assurance of AI Systems: Design Requirements, Prototype, and Early Testing [16.53658640529767]
We introduce a third-party AI assurance framework that addresses gaps in AI evaluation.<n>We focus on third-party assurance to prevent conflict of interest and ensure credibility and accountability of the process.<n>Our findings show early evidence that our AI assurance framework is sound and comprehensive, usable across different organizational contexts.
arXiv Detail & Related papers (2026-01-30T00:37:12Z) - Towards Verifiably Safe Tool Use for LLM Agents [53.55621104327779]
Large language model (LLM)-based AI agents extend capabilities by enabling access to tools such as data sources, APIs, search engines, code sandboxes, and even other agents.<n>LLMs may invoke unintended tool interactions and introduce risks, such as leaking sensitive data or overwriting critical records.<n>Current approaches to mitigate these risks, such as model-based safeguards, enhance agents' reliability but cannot guarantee system safety.
arXiv Detail & Related papers (2026-01-12T21:31:38Z) - Reliable LLM-Based Edge-Cloud-Expert Cascades for Telecom Knowledge Systems [54.916243942641444]
Large language models (LLMs) are emerging as key enablers of automation in domains such as telecommunications.<n>We study an edge-cloud-expert cascaded LLM-based knowledge system that supports decision-making through a question-and-answer pipeline.
arXiv Detail & Related papers (2025-12-23T03:10:09Z) - Barbarians at the Gate: How AI is Upending Systems Research [58.95406995634148]
We argue that systems research, long focused on designing and evaluating new performance-oriented algorithms, is particularly well-suited for AI-driven solution discovery.<n>We term this approach as AI-Driven Research for Systems ( ADRS), which iteratively generates, evaluates, and refines solutions.<n>Our results highlight both the disruptive potential and the urgent need to adapt systems research practices in the age of AI.
arXiv Detail & Related papers (2025-10-07T17:49:24Z) - Private, Verifiable, and Auditable AI Systems [3.745111265115901]
This thesis addresses the interplay between privacy, verifiability, and auditability in modern AI.<n>It argues that technical solutions that integrate these elements are critical for responsible AI innovation.
arXiv Detail & Related papers (2025-08-27T07:08:44Z) - Cognitive Kernel-Pro: A Framework for Deep Research Agents and Agent Foundation Models Training [67.895981259683]
General AI Agents are increasingly recognized as foundational frameworks for the next generation of artificial intelligence.<n>Current agent systems are either closed-source or heavily reliant on a variety of paid APIs and proprietary tools.<n>We present Cognitive Kernel-Pro, a fully open-source and (to the maximum extent) free multi-module agent framework.
arXiv Detail & Related papers (2025-08-01T08:11:31Z) - Open Problems in Technical AI Governance [102.19067750759471]
Technical AI governance refers to technical analysis and tools for supporting the effective governance of AI.<n>This paper is intended as a resource for technical researchers or research funders looking to contribute to AI governance.
arXiv Detail & Related papers (2024-07-20T21:13:56Z) - The Foundations of Computational Management: A Systematic Approach to
Task Automation for the Integration of Artificial Intelligence into Existing
Workflows [55.2480439325792]
This article introduces Computational Management, a systematic approach to task automation.
The article offers three easy step-by-step procedures to begin the process of implementing AI within a workflow.
arXiv Detail & Related papers (2024-02-07T01:45:14Z) - Artificial Intelligence in Governance, Risk and Compliance: Results of a study on potentials for the application of artificial intelligence (AI) in governance, risk and compliance (GRC) [0.0]
GRC (Governance, Risk and Compliance) means an integrated governance-approach.
Governance functions are interlinked and not separated from each other.
Artificial intelligence is being used in GRC for processing and analysis of unstructured data sets.
arXiv Detail & Related papers (2022-12-07T12:36:10Z) - Towards Fairness Certification in Artificial Intelligence [31.920661197618195]
We propose a first joint effort to define the operational steps needed for AI fairness certification.
We will overview the criteria that should be met by an AI system before coming into official service and the conformity assessment procedures useful to monitor its functioning for fair decisions.
arXiv Detail & Related papers (2021-06-04T14:12:12Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.