Atlas / MCP servers / dataeval / Dingo

DingoBLOCK

Name: Dingo
Author: dataeval

mcp/dataeval/dingo

MCP server by dataeval · agent as a judge · common crawl · data agent · Audited 2026-10-07

⚑ Report / re-scan Source ↗

Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool

Verdict

BLOCK

Grade

Trust score

49 /100

Exposed tools

6 4r · 2w · 0d

Transport

sse · stdio

License

Apache-2.0

Stars

757

Overview

From the repository's own README, as read at the audited commit. Badges and raw HTML are left out.

Read from source at commit b9fc3edadab0OBSERVED · 2026-10-07

Exposed tools (6)

4 read · 2 write · 0 destructive.

Tool	Risk	Description
`get_llm_details`	read	Get detailed information about a specific Dingo LLM.
`get_prompt_details`	read	Get detailed information about an LLM
`get_rule_details`	read	Get detailed information about a specific Dingo rule.
`list_dingo_components`	read	Lists available Dingo rule groups, registered LLM model identifiers, and prompt definitions.
`run_dingo_evaluation`	write	Runs a Dingo evaluation (rule-based or LLM-based) on a file.
`run_quick_evaluation`	write	Run a simplified Dingo evaluation based on a high-level goal.

Trust audit

BLOCKgrade F · trust 49/100 Do not install this without reading the findings. The audit found something that could harm you or your machine.

Layer	What it checks	Result
L0	Provenance & inventory	WARN
L1	Static analysis of the code	FAIL
L2	Instruction surface (what it tells the agent)	FAIL
L3	Class-specific surface	PASS
L4	Behavioural (sandbox)	SKIPPED

What the source does

Filesystem: declared (6 observation(s))
Network: declared (6 observation(s))
Shell: declared (6 observation(s))
Dependencies: pinned
Secrets in source: none-found

Findings (25)

HIGHCode injection · code.eval_exec · CWE-78, CWE-94, CWE-95

dingo/model/llm/vlm_layout_quality.py:126

bboxs = eval(input_data.content)

Why it matters. evaluates text as code

Fix. remove; use a parser or a dispatch table

HIGHCode injection · code.eval_exec · CWE-78, CWE-94, CWE-95

dingo/run/cli.py:216

help="Path to JSONL query file for standalone open eval (no MTEB corpus needed)",

Why it matters. evaluates text as code

Fix. remove; use a parser or a dispatch table

HIGHPrompt injection · prompt.zero_width · CWE-94, CWE-1427

docs/search_result_effectiveness_executor.md:1

# Search Result Effectiveness Executor Usage

Why it matters. invisible characters in instruction text

Fix. strip non-printing characters

HIGHPrompt injection · prompt.zero_width · CWE-94, CWE-1427

docs/search_result_quality_metrics.md:1

# Search Result Quality 三指标评测说明

Why it matters. invisible characters in instruction text

Fix. strip non-printing characters

MEDIUMInventory / provenance · inv.symlink · CWE-1104

SKILL.md

SKILL.md

Why it matters. link not followed

MEDIUMCode injection · code.dynamic_import · CWE-78, CWE-94, CWE-95

dingo/model/model.py:142

importlib.import_module(module_name)

MEDIUMCode injection · code.dynamic_import · CWE-78, CWE-94, CWE-95

dingo/model/model.py:168

importlib.import_module(module_name)

MEDIUMCode injection · code.dynamic_import · CWE-78, CWE-94, CWE-95

dingo/model/rule/guobiao/rule_tc609_quality_base.py:207

module = importlib.import_module(module_name)

MEDIUMCode injection · code.dynamic_import · CWE-78, CWE-94, CWE-95

dingo/retrieval/search_client.py:103

importlib.import_module(mod_name)

MEDIUMNetwork egress · net.raw_ip · CWE-200, CWE-319

dingo/retrieval/backends/agentic.py:94

api_url: str = "http://127.0.0.1:8080",

LOWInventory / provenance · inv.binary · CWE-1104

docs/assets/dingo_gui.png.old

dingo_gui.png.old

Why it matters. a compiled or binary member cannot be reviewed from source

Fix. ship source, or explain the binary in the README

LOWInventory / provenance · inv.binary · CWE-1104

test/data/audio/test.wav

test.wav

Why it matters. a compiled or binary member cannot be reviewed from source

Fix. ship source, or explain the binary in the README

LOWInventory / provenance · inv.binary · CWE-1104

test/data/test_local_excel.xlsx

test_local_excel.xlsx

Why it matters. a compiled or binary member cannot be reviewed from source

Fix. ship source, or explain the binary in the README

LOWInventory / provenance · inv.binary · CWE-1104

test/data/test_local_parquet.parquet

test_local_parquet.parquet

Why it matters. a compiled or binary member cannot be reviewed from source

Fix. ship source, or explain the binary in the README

LOWInventory / provenance · inv.hidden_file · CWE-1104

.owners.yml

.owners.yml

Why it matters. hidden member outside the usual dotfiles

Fix. review its purpose

LOWInventory / provenance · inv.hidden_file · CWE-1104

.pre-commit-config.yaml

.pre-commit-config.yaml

Why it matters. hidden member outside the usual dotfiles

Fix. review its purpose

LOWInsecure crypto · crypto.weak_hash · CWE-327, CWE-338

dingo/model/rule/utils/detect_lang.py:16

md5 = hashlib.md5()

LOWFilesystem / path · fs.traversal · CWE-22, CWE-59

dingo/model/rule/rule_image.py:346

refer_path=['../../test/data/overlap_visual_image'],  # 用户保存图片路径

LOWFilesystem / path · fs.traversal · CWE-22, CWE-59

dingo/model/rule/rule_image.py:551

refer_path=['../../test/data/label_visual_image'],  # 用户保存图片路径

LOWFilesystem / path · fs.traversal · CWE-22, CWE-59

test/scripts/dataset/test_mineru_converter.py:12

TEST_DATA_DIR = os.path.join(os.path.dirname(__file__), "../../data")

LOWNetwork egress · net.raw_ip · CWE-200, CWE-319

docs/search_result_effectiveness_executor.md:66

$env:OPENAI_BASE_URL="http://35.220.164.252:3888/v1/"

LOWObfuscation / stealth · obf.decode_call · CWE-506, CWE-94

dingo/utils/image_loader.py:80

image_bytes = base64.b64decode(data)

INFOInventory / provenance · inv.oversize · CWE-1104

dingo/model/rule/scibase/assets/journal_name_mapping_execute_20260512.csv

dingo/model/rule/scibase/assets/journal_name_mapping_execute_20260512.csv

Why it matters. 9974398 bytes not read

INFOInventory / provenance · inv.oversize · CWE-1104

docs/assets/bad_case.png

docs/assets/bad_case.png

Why it matters. 3307950 bytes not read

INFOInventory / provenance · inv.oversize · CWE-1104

docs/assets/mcp_demo.mp4

docs/assets/mcp_demo.mp4

Why it matters. 7086284 bytes not read

Gates applied: no_behavioural_pass.

Audited 2026-10-07 · audit v0.4.1 · source sha b9fc3edadab0full audit observations/trust-audit/mcp-server/dataeval__dingo.json · Report an issue / request a re-scan

Audit history

Every audit this server has had. A grade with a past is a grade somebody is still checking.

Date	Source	Verdict	Grade	Score	Change
2026-10-07	`b9fc3edadab0`	BLOCK	F	49	first audit

Questions

What is the Dingo MCP server?

Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool

What tools does Dingo expose?

6 in total: 4 read-only, 2 that write, and 0 that can delete or overwrite. Every one is listed on this page with its risk.

Is Dingo safe to connect to an agent?

No — not without reading the findings first. The audit graded it F (49/100) and found 4 critical or high issues in the source. Each one is listed on this page with the file and line it is on.

What credentials does Dingo need?

It reads ANTHROPIC_API_KEY, GOOGLE_API_KEY, GOOGLE_SCHOLAR_API_KEY, OPENAI_API_KEY, OPENAI_KEY, OPENALEX_API_KEY, PERSPECTIVE_API_KEY, S2_API_KEY, S3_ACCESS_KEY, S3_SECRET_KEY, SCIVERSE_API_TOKEN and SERPAPI_API_KEY from the environment. Give it a token scoped to the least it needs — an agent that can be talked into calling a tool can be talked into calling it with your credentials.

How does Dingo run?

It speaks sse and stdio, so it runs as a local process your client starts.

How current is this page?

The grade is for one exact copy of the source (b9fc3edadab0), read on 2026-10-07. The repository is watched and re-audited when it changes.

Source	dataeval/dingo
Transports	sse · stdio
Credentials it reads	`ANTHROPIC_API_KEYGOOGLE_API_KEYGOOGLE_SCHOLAR_API_KEYOPENAI_API_KEYOPENAI_KEYOPENALEX_API_KEYPERSPECTIVE_API_KEYS2_API_KEYS3_ACCESS_KEYS3_SECRET_KEYSCIVERSE_API_TOKENSERPAPI_API_KEY`
License	Apache-2.0
Activity	pushed 8d ago