Breaking Down 8 Open Source AI Security Tools at Black Hat Europe 2025 Arsenal

The convergence of AI and security is becoming more apparent, as demonstrated by eight open-source tools showcased at Black Hat Europe Arsenal. AI-Infra-Guard (AIG) assesses AI security risks by scanning infrastructure and LLM vulnerabilities, including jailbreak evaluations. Harbinger is an AI-driven red team platform that automates operations, aids decision-making, and generates reports. MIPSEval specifically evaluates the conversational security of LLMs, detecting issues in multi-turn interactions. Patch Wednesday uses a private LLM to automatically create vulnerability patches from CVE descriptions and code. Red AI Range (RAR) offers a virtual environment for practicing AI security attack and defense strategies. OpenSource Security LLM focuses on fine-tuning smaller LLMs for security tasks like threat modeling and code review. SPIKEE is a toolkit designed to evaluate and exploit prompt injection vulnerabilities in LLMs. Lastly, SQL Data Guard secures LLM-database interactions to prevent data leaks, operating inline or via MCP.