awesome-ml-security (Trail of Bits)

Awesome-ML-Security

A curated list of awesome machine learning security references, guidance, tools, and more.

**Table of Contents**

• Awesome-ML-Security
  • Relevant work, standards, literature
    • CIA of the model
      • Confidentiality
      • Integrity
      • Availability
    • Degraded model performance
    • ML-Ops
    • AI’s effect on attacks/security elsewhere
      • Self-driving cars
      • LLM Alignment
  • Regulatory actions
    • US
    • EU
    • Other
  • Safety standards
  • Taxonomies and frameworks
  • Security tools and techniques
    • API probing
    • Model backdoors
    • Other
  • Background information
  • DeepFakes, disinformation, and abuse
  • Notable incidents
  • Notable harms

Relevant work, standards, literature

CIA of the model

Membership attacks, model inversion attacks, model extraction, adversarial perturbation, prompt injections, etc.

• Towards the Science of Security and Privacy in Machine Learning
• SoK: Machine Learning Governance
• Not with a Bug, But with a Sticker: Attacks on Machine Learning Systems and What To Do About Them
• On the Impossible Safety of Large AI Models

Confidentiality

...