AI standards and terminology of attacks
In the following section, we will go through some AI standards and terminology of attacks.
NIST
NIST Trustworthy and Responsible AI released a paper on taxonomy and terminologies used in AI with respect to attacks and mitigations. It covers both predictive AI (traditional ML) and GenAI.
Figure 10.4 – Taxonomy of attacks on Generative AI systems
Image source: “Adversarial Machine Learning: A Taxonomy and Terminology of Attacks and Mitigations ” paper from NIST. https://doi.org/10.6028/NIST.AI.100-2e2023
OWASP Top 10 for LLM applications
The OWASP Top 10 for Large Language Model Applications project aims to educate developers, designers, architects, managers, and organizations about the potential security risks when deploying and managing LLMs. The OWASP Top 10 for LLM applications are as follows.
- LLM01: Prompt Injection
- LLM02: Insecure Output Handling
- LLM03: Training...