MITRE ATLASsub-technique
AML.T0018.001 Modify AI Model Architecture
- Tactics
- Persistence, Ai Attack Staging
- Created
- 2021-05-13
Description
Adversaries may directly modify an AI model's architecture to re-define it's behavior. This can include adding or removing layers as well as adding pre or post-processing operations.
The effects could include removing the ability to predict certain classes, adding erroneous operations to increase computation costs, or degrading performance. Additionally, a separate adversary-defined network could be injected into the computation graph, which can change the behavior based on the inputs, effectively creating a backdoor.
Related
Subtechnique of · MITRE ATLAS (1)
- AML.T0018 Manipulate AI Model technique
Tactic · MITRE ATLAS (2)
- AML.TA0006 Persistence tactic
- AML.TA0001 AI Attack Staging tactic