QAtration fires real prompt-injection attacks at your AI bot and gives you a plain-English report of what it leaked or did, before someone else finds it. You run it. On your machine or in your CI, against your own deployment. No account, no endpoint handed over, nothing sent to us.
Do not point this at a system you do not own. It sends real attacks at whatever URL you give it: prompt injection, data exfiltration, tool abuse. Your own deployment, or one whose owner gave you written permission in advance. Not a public chatbot you find interesting. Not a vendor’s demo. Read AUTHORISED-USE.md first.
Measured on our own test targets, not projected.
qatration init writes the config from your endpoint's URL, with a secret only you know to paste into your system prompt. qatration onboard checks both with a few ordinary questions before a single attack goes out.
OpenAI-compatible APIs, Anthropic, Bedrock and Vertex, and apps built on the Vercel AI SDK, Dify, Flowise, Langflow, n8n, Gradio, Rasa, Chainlit, Botpress or Copilot Studio.
$ pip install qatration $ qatration init --url https://your-bot.example.com/chat \ --model your-model-id $ qatration onboard --target-config mybot.yaml $ qatration benign --target-config mybot.yaml $ qatration run --target-config mybot.yaml
Real attacks, the kind a user can type or a document can carry, and every reply scored by a deterministic check: the canary in the reply, a value in a tool call. No model grades another model, so the same reply always gets the same verdict.
This exchange is copied from a real run, word for word.
What leaked, exactly how, and the fix to try first, written for a team without a security expert. --fail-on exploited fails a build. qatration sarif writes the findings to a file your code-scanning tab reads.
A chat endpoint is enough: these are testable as-is, including across turns.
Attacker text overrides your bot's rules: “ignore your instructions and…”.
Your bot reveals API keys, internal codes, or another customer's data.
Your hidden instructions leak verbatim: the map for every later attack.
A rule planted in one turn quietly changes every later answer, long after the conversation looks normal again.
The knowledge base, the tool definitions, or the tool calls in the response. Measured on the evidence shipped with this tool: 113 of 229 findings on targets that report tool calls do not appear at all when only the reply is read.
Your agent is talked into an irreversible action: delete, refund, send email.
SQL or a shell command smuggled into a tool call. An old bug class, a new front door.
One malicious document in your RAG hijacks answers to innocent questions.
A hidden line in a tool's description makes your agent leak on an ordinary question, with no attacker message required.
Every check belongs to one of its ten classes, and the fix report names the class beside each finding. The number is how many checks look for it.
Every target gets a benign run first: ordinary questions, nobody attacking. On one of
the bots here canary_in_tool_call fires on 88% of that ordinary traffic,
so every finding resting on it alone is marked unattributable instead of counted.
When an attack fails and the reply shows why, the report names what stopped it: the identity check, the content filter, a backend permission, or a tool call that was only printed and never actually ran. That last one reads like a breach in a transcript and is worth nothing.
One bot, two models, 242 attacks each, 3 tries apiece. The smaller broke on 39, the larger on 34, and 28 of those are the same attacks, 25 of them breaking on every single try of both. On this bot the larger model reshuffled which attacks land at the edges. It does not close the hole.
It has 68 checks, and 65 of them have fired on the 7,977 probes stored here. The 3 that never have are reported as declared, not counted as coverage. On traffic nobody attacked they fired 779 times: 622 were real problems with the bot and 157 were false alarms, and both numbers are published.
Every run is kept, so each finding carries the date it first appeared. Critical is an opinion. Critical and open since the third of the month is a fact about how a team responds to such findings, and it is the line that gets a fix scheduled.
A finding that comes back after you closed it is flagged as returned, not quietly counted alongside the new ones. A fix that did not hold is the worse of the two conversations, and merging them hides it.
If a run does not send an attack, that attack is reported as untested, never as fixed. Absence is not a clean result, and a report that blurs the two tells you your vulnerabilities are gone when nobody looked.
Some calls hand a tool a value that never appears in any text we can read. We list those separately and tell you which log opens them, because the difference between "we checked and it was clean" and "we could not see" is the difference between a measurement and a promise.
“We told it not to reveal secrets” is a claim, not a defence. On the targets here it fell within the first few attacks. QAtration also clears bots that are genuinely locked down, so a clean result actually means something. It measures your bot instead of always crying wolf.
Apache 2.0. Install it, point it at your own deployment, keep the evidence.