Advertisements

Agentic AI Red Teaming: Hands-On Security Testing

Advertisements
Test goal hijacking, tool misuse, memory poisoning, multi-agent attacks, and cascading failures in safe AI sandboxes
1
1/5
(27) Ratings
0 students
Created by School of AI
Advertisements

What you'll learn

  • Identify and assess security vulnerabilities in autonomous AI agents, including planning loops, tool execution, memory, and multi-agent communication.
  • Perform hands-on Agentic AI Red Teaming using controlled adversarial simulations and isolated testing environments.
  • Test AI agents against goal hijacking, prompt injection, instruction override, and multi-turn manipulation attacks.
  • Identify unsafe tool calls, excessive permissions, tool-chain exploitation, and authorization weaknesses.
  • Evaluate memory poisoning, persistent state manipulation, and context contamination across agent sessions.
  • Simulate cross-agent manipulation, compromised-agent behavior, and multi-agent coordination failures.
  • Measure cascading failures, attack propagation, blast radius, and agent security performance using repeatable tests.
  • Build automated AI security evaluation workflows using Python, Ollama, LangGraph, and pytest.
  • Apply defensive controls, including least privilege, tool validation, approval gates, and agent behavior monitoring.
  • Conduct enterprise AI security assessments using OWASP Agentic AI security guidance, MITRE ATLAS, and structured red-team reporting.
This course includes:
9.5 total hours on-demand video
18 articles
0 downloadable resources
108 lessons
Full lifetime access
Access on mobile and TV
Certificate of completion
Advertisements

Course content

Requirements

  • Basic understanding of Generative AI, Large Language Models (LLMs), and AI agents is recommended.
  • Basic Python programming knowledge is helpful for completing hands-on exercises.
  • Familiarity with APIs, JSON, and common software development concepts will be beneficial.
  • A Windows, macOS, or Linux computer capable of running Python and lightweight AI development tools.
  • Basic familiarity with cybersecurity concepts is useful, but previous red-teaming experience is not required.
  • The course uses free and open-source tools such as Python, Ollama, LangGraph, FastAPI, and pytest.
  • No paid AI subscriptions, cloud accounts, or commercial API keys are required for the core hands-on labs.
  • All adversarial exercises are conducted in authorized, isolated sandbox environments with synthetic data.

Description

This course contains the use of artificial intelligence.

AI agents do more than answer questions. They plan, call tools, store memories, coordinate with other agents, and take action. Every capability creates a new security boundary. This hands-on course, Agentic AI Red Teaming: Hands-On Security Testing, teaches you to evaluate those boundaries and uncover failures before they reach production.

You’ll learn agentic AI security, AI red teaming, LLM security testing, and adversarial AI evaluation through a realistic enterprise case study: BrightDesk, a fictional multi-agent customer support platform. Instead of relying on slides alone, you’ll work with an isolated AI agent testing sandbox, synthetic records, mock APIs, local tools, and repeatable tests. See how an apparently harmless instruction can redirect a plan, trigger an inappropriate tool call, or contaminate later decisions.

What You’ll Learn

  • Map AI agent attack surfaces across planning loops, prompts, tool execution, external data, long-term memory, and multi-agent orchestration.

  • Test prompt injection, goal hijacking, instruction override, multi-turn attacks, and gradual goal drift without touching real customer systems.

  • Evaluate tool-call exploitation, unsafe tool chaining, excessive permissions, weak authorization, and untrusted tool responses.

  • Investigate memory poisoning, persistent state attacks, context manipulation, and retrieval-based threats in RAG workflows.

  • Examine agent-to-agent communication, cross-agent manipulation, false consensus, compromised workers, and multi-agent coordination failures.

  • Assess Model Context Protocol (MCP) security, tool metadata integrity, and unsafe integration boundaries.

  • Design adversarial test cases, automated security regression testing, execution traces, and AI security scorecards.

  • Measure cascading failures, propagation depth, blast radius, unsafe action rates, and the difference between single-turn failure and system-wide compromise.

  • Apply least privilege, policy enforcement, approval gates, memory validation, monitoring, and defense-in-depth, then retest to verify improvements.

Build Practical Red-Team Skills

Using Python, Ollama, LangGraph, FastAPI, and pytest, you’ll develop an agent testing environment and run controlled scenarios against BrightDesk. Explore AI threat modeling, risk prioritization, evidence collection, trace analysis, and security reporting. You’ll also encounter concepts from the OWASP Top 10 for Agentic Applications, MITRE ATLAS, and AI governance, connecting technical findings to real enterprise risk decisions.

You’ll practice distinguishing a model’s incorrect answer from an agent’s unauthorized action, and you’ll learn why execution logs, reproducible scenarios, and clear pass/fail criteria matter when testing complex, stateful AI workflows in enterprise environments.

Your capstone is an end-to-end agentic AI penetration testing exercise in an authorized simulation. Create a threat model, execute structured adversarial evaluations, document vulnerabilities, introduce safeguards, and compare security results before and after remediation. You’ll leave with reusable test templates, a security evaluation framework, and a portfolio-ready assessment report.

Who Should Enroll?

This course is designed for AI engineers, LLM developers, application security engineers, red teamers, penetration testers, AI architects, security researchers, and teams building autonomous AI agents or enterprise generative AI solutions. Basic Python skills and familiarity with LLMs or APIs will help; prior professional red-team experience isn’t required.

If you’re moving from traditional cybersecurity to agentic AI risk management, or building production agents that must be trustworthy, this course gives you a structured, hands-on way to test what happens when an AI system does more than talk.

Who this course is for:

  • AI Engineers and Developers who want to identify and prevent security vulnerabilities in autonomous AI agents and agentic applications.
  • Cybersecurity Professionals interested in expanding their expertise into Agentic AI security, LLM security, and adversarial AI testing.
  • Penetration Testers and Red-Team Specialists looking to develop practical skills in AI agent security assessments and multi-step adversarial testing.
  • Generative AI and LLM Developers building applications with LangGraph, MCP, RAG, tool calling, and multi-agent architectures.
  • AI Architects and Solution Architects responsible for designing secure, reliable, and enterprise-ready agentic AI systems.
  • Application Security and DevSecOps Engineers seeking to integrate automated AI red teaming, security validation, and regression testing into development workflows.
  • AI Security Researchers exploring prompt injection, goal hijacking, memory poisoning, agent manipulation, and cascading system failures.
  • AI Governance, Risk, and Compliance Professionals who need to understand agentic AI security risks, evaluation methods, and mitigation strategies.
  • Technical Leaders and Enterprise AI Teams responsible for evaluating the security and operational risks of deploying autonomous AI agents.
  • – Intermediate and Advanced Learners who already understand basic AI concepts and want practical, hands-on experience testing and securing agentic systems.
Advertisements
NOVFREE01
Advertisements
Advertisements
Free Online Courses with Certificates
Logo
Register New Account