MITRE ATLAStechnique
AML.T0053 AI Agent Tool Invocation
- Tactics
- Execution, Privilege Escalation
- Created
- 2023-10-25
Description
Adversaries may use their access to an AI agent to invoke tools the agent has access to. LLMs are often connected to other services or resources via tools to increase their capabilities. Tools may include integrations with other applications, access to public or private data sources, and the ability to execute code.
This may allow adversaries to execute API calls to integrated applications or services, providing the adversary with increased privileges on the system. Adversaries may take advantage of connected data sources to retrieve sensitive information. They may also use an LLM integrated with a command or script interpreter to execute arbitrary instructions.
AI agents may be configured to have access to tools that are not directly accessible by users. Adversaries may abuse this to gain access to tools they otherwise wouldn't be able to use.
Related
Tactic · MITRE ATLAS (2)
- AML.TA0012 Privilege Escalation tactic
- AML.TA0005 Execution tactic
Referenced by MITRE ATLAS · mitigates (11)
- AML.M0032 Segmentation of AI Agent Components mitigation
- AML.M0033 Input and Output Validation for AI Agent Components mitigation
- AML.M0026 Privileged AI Agent Permissions Configuration mitigation
- AML.M0027 Single-User AI Agent Permissions Configuration mitigation
- AML.M0028 AI Agent Tools Permissions Configuration mitigation
- AML.M0029 Human In-the-Loop for AI Agent Actions mitigation
- AML.M0030 Restrict AI Agent Tool Invocation on Untrusted Data mitigation
- AML.M0020 Generative AI Guardrails mitigation
- AML.M0021 Generative AI Guidelines mitigation
- AML.M0022 Generative AI Model Alignment mitigation
- AML.M0024 AI Telemetry Logging mitigation