Skip to content

Add 2 tools: UltraProbe (Red Teaming) + prompt-defense-audit (Guardrails)#45

Open
ppcvote wants to merge 1 commit into
ProjectRecon:mainfrom
ppcvote:add-ppcvote-tools
Open

Add 2 tools: UltraProbe (Red Teaming) + prompt-defense-audit (Guardrails)#45
ppcvote wants to merge 1 commit into
ProjectRecon:mainfrom
ppcvote:add-ppcvote-tools

Conversation

@ppcvote

@ppcvote ppcvote commented May 29, 2026

Copy link
Copy Markdown

Adds 2 tools to existing sections.

⚔️ Red Teaming & Vulnerability Scanners

  • UltraProbe — Free hosted AI prompt audit. Scans a system prompt against 17 OWASP-LLM-Top-10-aligned attack vectors (incl. 5 agent-specific ones: encoding-aware injection, function semantic immutability, memory provenance, cross-agent auth, transaction guardrails) and returns an A–F grade with per-vector evidence. Hosted at ultralab.tw/probe; CLI also published as ultraprobe on npm. MIT.

🚧 Guardrails & Compliance

  • prompt-defense-audit — Deterministic system-prompt scanner (npm). Same 17 vectors as the UltraProbe UI, plus 12 Unicode smuggling categories (Tag chars / Math alphanumeric / BiDi / Variation Selectors) and an output scanner with rules for JSON schema injection, OCR / Whisper / PDF modality marker hijack, tool-call argument injection, and SVG foreignObject HTML. Pure regex, <5ms, zero AI cost. MIT.

Both are MIT-licensed and actively maintained. Both align well with the agent-security focus of this list — the 5 agent-specific vectors above were derived from a structured analysis of six documented crypto AI agent incidents (Freysa, Lobstar Wilde, Grok×Bankrbot Morse, ElizaOS memory injection, etc.). Happy to adjust descriptions if shorter / different placement is preferred.

@secxena

secxena commented Jun 12, 2026

Copy link
Copy Markdown
Contributor

Thanks for the submission. The first link (ppcvote/ultraprobe) returns a 404, so we cannot review UltraProbe — could you update the PR with a working public repo? prompt-defense-audit does exist but is still very early in terms of adoption. We are passing for now; happy to revisit once the links work and the projects have built more traction.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants