Live survey304 models · 14 providers · 22,792 auditsAudited grill-with-docs · SAFE →What changedHow we verifyllms.txt

Agent skill · Audited from source

Arxiv Summarizer Orchestrator

skill · InternLM/WildClawBenchMIT licenceAudited 15 Oct 2026 · source a79d9cd3663a

★ 533pushed 27 days ago
✓SAFEGrade B · 89/100 · 15 Oct 2026 · a79d9cd
533repo stars · whole InternLM/WildClawBench

Is it safe? Yes — SAFE, grade B (89/100). We read this skill's source at commit a79d9cd3663a and found no filesystem, network or shell access and no hard-coded secrets. What it does: End-to-end orchestration skill for periodic arXiv collection and reporting using three sub-skills: arxiv-search-collector, arxiv-paper-processor, and arxiv-batch-reporter. Supports manual language control across all…

Ask an AI about this pageGChatGPTCClaudePPerplexityGeGeminiXGrok
More
Cite

Cite this page

ModelsAtlas. “Arxiv Summarizer Orchestrator (InternLM/WildClawBench)”. Retrieved 15 Oct 2026. https://modelsatlas.com/skills/internlm/arxiv-summarizer-orchestrator

Trust audit

Audit 0.4.1 · source read 15 Oct 2026

Trust score89/100✓SAFE B
0 critical0 high0 medium0 low0 info

SAFE means nothing in the source contradicts what the skill says it does. Grade B is shared by 16,667 of 17,602 audited skills.

What the source does

  • FilesystemNone observedNo reads or writes in the source
  • NetworkNone observedNo outbound calls in the source
  • ShellNone observedNo commands run in the source
  • DependenciesPinnedNothing floats
  • SecretsNone foundNo keys in source

Five audit layers

LayerWhat we checkResultFindings
L0 ProvenanceRepo owner, licence, archive status, activityPASS0
L1 Static sourceSecrets, path traversal, supply chain, hidden codeNA0
L2 InstructionsPrompt injection, authority framing, hidden directivesPASS0
L3 InventoryThe files and declarations match the sourcePASS0
L4 SandboxRun in isolation and watch behaviourSKIPPED why0

Gates applied: no behavioural pass.

Findings (0)

No findings at any severity. We re-audit when the source changes.

Audit 0.4.1 · source sha a79d9cd3663a · 15 Oct 2026Report an issue or request a re-scan

Provenance

Who published it, and what the verdict is pinned to

  • PublisherInternLM GitHub organizationOwner of the repository this skill is read from
  • Source folderInternLM/WildClawBench/skills/1/arxiv-summarizer-orchestratorThe exact folder we audited
  • LicenceMITAs the repository states it
  • Commit pinned for this verdicta79d9cd3663aA new audit runs when the source changes
  • Repository statusNot archivedLast push 27 days ago
  • Sandboxed runNot runSkills are read, not executed; layer L4 is skipped

What it tells the agent

Full source on GitHub ↗

Its description: End-to-end orchestration skill for periodic arXiv collection and reporting using three sub-skills: arxiv-search-collector, arxiv-paper-processor, and arxiv-batch-reporter. Supports manual language control across all…

---
name: arxiv-summarizer-orchestrator
description: "End-to-end orchestration skill for periodic arXiv collection and reporting using three sub-skills: arxiv-search-collector, arxiv-paper-processor, and arxiv-batch-reporter. Supports manual language control across all markdown outputs and Stage-B processing strategy (`subagent_parallel` default max 5, or serial)."
---

# ArXiv Summarizer Orchestrator

Run the full pipeline by composing three sub-skills.

## Sub-skill Order

1. `arxiv-search-collector`
2. `arxiv-paper-processor`
3. `arxiv-batch-reporter`

## Workflow Parameters

- `language`: manual language parameter used by all stages. Default is English when omitted.
- `paper_processing_mode`: `subagent_parallel` or `serial`.
- `max_parallel_papers`: default `5` when `paper_processing_mode=subagent_parallel`.

## Workflow

### Stage A: Collection Setup + Query Retrieval

1. Initialize one run with `arxiv-search-collector/scripts/init_collection_run.py`.
2. Model generates multiple focused queries from original topic and writes a minimal `query_plan.json` (`label` + `query` only).
3. Run `arxiv-search-collector/scripts/fetch_queries_batch.py` with the plan file (recommended).
4. (Optional fallback) call `arxiv-search-collector/scripts/fetch_query_metadata.py` manually for one-by-one fetch.
5. Model reads each indexed query list and decides keep indexes.
6. Merge selected items with `arxiv-search-collector/scripts/merge_selected_papers.py`.
7. If relevance/coverage is still not good, iterate Stage A:
   - generate another query plan with new labels,
   - fetch again,
   - re-merge with `--incremental` and updated `selection-json`.
   - set weak labels to empty keep list (`[]`) to explicitly drop them.

Pass `--language <LANG>` to collector scripts so all generated markdown files in Stage A follow the selected language.
Use serial query fetch in Stage A with conservative controls (for example `--min-interval-sec 5`, `--retry-max 4`).
Default collector settings already include retries/backoff and run-local throttle state (`<run_dir>/.runtime/arxiv_api_state.json`), so manual tuning is usually unnecessary.
Prefer cache reuse (no `--force`) unless query parameters changed or data refresh is required.

Output: one run directory with per-paper metadata subdirectories.

### Stage B: Per-paper Artifact Download + Manual Summary

For each paper directory, invoke sub-skill `arxiv-paper-processor` once and let that skill produce `<paper_dir>/summary.md`.

Recommended pre-step for many papers:

1. Run one batch artifact download before per-paper reading:

```bash
python3 arxiv-paper-processor/scripts/download_papers_batch.py \
  --run-dir /path/to/run \
  --artifact source_then_pdf \
  --max-workers 3 \
  --min-interval-sec 5 \
  --language <LANG>
```

Per-paper execution steps (inside `arxiv-paper-processor`):

1. If `<paper_dir>/summary.md` already exists and is complete, skip this paper.
2. If usable source (`source/source_extract/*.tex`) or PDF (`source/paper.pdf`) already exists, skip download.
3. If artifacts are missing, download source with `arxiv-paper-processor/scripts/download_arxiv_source.py`.
4. If source is unusable, download PDF with `arxiv-paper-processor/scripts/download_arxiv_pdf.py`.
5. Model reads content and manually writes `<paper_dir>/summary.md` by reference format, in `language`.

Parallel strategy for many papers:

- Default: `paper_processing_mode=subagent_parallel` with `max_parallel_papers=5`.
- Optional: `paper_processing_mode=serial` to process one paper at a time.
- In parallel mode, run multiple `arxiv-paper-processor` instances in batches; concurrent papers must not exceed `max_parallel_papers`.
- Wait for one batch to finish before starting the next batch.
- In serial mode, run exactly one `arxiv-paper-processor` instance at a time.
- Subagent workers should only own one paper directory each to avoid file conflicts.
- Do not use scripts to auto-compose summary text; scripts are download-only tools.

Output: all paper directories contain `summary.md`.

### Stage C: Bundle + Final Hierarchical Report

1. Run `arxiv-batch-reporter/scripts/collect_summaries_bundle.py --language <LANG>`.
2. Model reads `summaries_bundle.md` and writes `collection_report_template.md` in base dir.
3. In template, each paper leaf entry must include one standalone placeholder line: `{{ARXIV_BRIEF:<arxiv_id>}}`.
4. Run `arxiv-batch-reporter/scripts/render_collection_report.py` to generate final `collection_report.md`.
5. Do not manually paraphrase per-paper conclusion lines in final report; they must come from per-paper `summary.md` section 10 via script injection.

If `language` is non-English (for example Chinese), all intermediate markdown files and final reports should follow that language.

## Periodic Scheduling

This orchestrator is suitable for cron/scheduled execution in OpenClaw:

- Frequency examples: daily, weekly, monthly.
- For rolling windows, use lookback (`1d`, `7d`, `30d`) when initializing runs.

## Output Layout

`<output-root>/<topic>-<timestamp>-<range>/`

- `task_meta.json`, `task_meta.md`
- `query_results/`, `query_selection/`
- `<arxiv_id>/metadata.md` + downloaded source/pdf + `summary.md`
- `summaries_bundle.md`
- `collection_report_template.md`
- final rendered collection report (e.g. `collection_report.md`)

Use `references/workflow-checklist.md` as execution checklist.

## Related Skills

This is the top-level orchestration skill.

Before using it, install and enable these three sub-skills:

- `arxiv-search-collector`
- `arxiv-paper-processor`
- `arxiv-batch-reporter`

Execution order inside this orchestrator:

1. `arxiv-search-collector` (Stage A)
2. `arxiv-paper-processor` (Stage B)
3. `arxiv-batch-reporter` (Stage C)

Excerpt, first 5,754 characters of SKILL.md, verbatim from the audited commit. It is text from someone else’s repository, quoted so you can judge it before your agent reads it.

Install

Pinned to the audited commit a79d9cd

Download folder ↗
git clone https://github.com/InternLM/WildClawBench
git -C WildClawBench checkout a79d9cd3663a

The author documents no install command, so this uses the repository directly. Our verdict covers commit a79d9cd3663a only.

Works in which agents?

What its own text says, not a test

AgentStatusMore
OpenClawMentioned in its text, not testedSkills for OpenClaw · About OpenClaw
“Mentioned” means the skill’s text names the agent. We have not run it there.

Audit history

Every audit, every source change

  1. ✓SAFE B 89 / 100

    first audit · source a79d9cd3663a

README badge

For maintainers · shows the latest audit

ModelsAtlas: SAFE BMODELSATLASSAFE · B
[![ModelsAtlas: SAFE B](https://modelsatlas.com/skills/internlm/arxiv-summarizer-orchestrator/badge.svg)](https://modelsatlas.com/skills/internlm/arxiv-summarizer-orchestrator/)

The badge shows our verdict and grade for this skill, and links back to this page. It changes when the audit does.

Similar skills

03 Task1✓SAFE

InternLM/WildClawBench

Coordinates meeting scheduling via Gmail and Calendar APIs. Use when: scheduling a meeting, checking participant availability, sending coordination emails, creating calendar events, or notifying organizers of confirmed…

★ 533Grade B
03 Task2✓SAFE

InternLM/WildClawBench

Extracts action items and pending tasks from Slack messages. Use when: reviewing unread messages for todos, finding deadlines or requests directed at the user, or producing a task summary from recent Slack activity.

★ 533Grade B
03 Task3✓SAFE

InternLM/WildClawBench

Analyzes Slack messages to assess deal or project feasibility. Use when: synthesizing fragmented stakeholder input on a deal, identifying conflicting requirements or risks, or producing a feasibility report for…

★ 533Grade B
03 Task4✓SAFE

InternLM/WildClawBench

Reads recent Slack messages to compile an accurate project status report and saves it as a draft for review before sending to a client. Use when: preparing a client-facing update, reconciling conflicting or revised…

★ 533Grade B
03 Task5✓SAFE

InternLM/WildClawBench

Triages a support inbox, prioritizes urgent issues, routes each to the right internal team member, and drafts any customer-facing replies for review. Use when: catching up on a backlog of support messages, producing an…

★ 533Grade B
03 Task6✓SAFE

InternLM/WildClawBench

整合多部门 Slack 消息,交叉核对数据,识别依赖关系与风险,为高管起草董事会级别的执行摘要草稿。适用场景:跨部门项目状态汇总、董事会会议准备、需要数据对账和风险识别的高管报告。

★ 533Grade B

Add this badge to your README

[![ModelsAtlas: SAFE B](https://modelsatlas.com/skills/internlm/arxiv-summarizer-orchestrator/badge.svg)](https://modelsatlas.com/skills/internlm/arxiv-summarizer-orchestrator/)

Questions about Arxiv Summarizer Orchestrator

What does the Arxiv Summarizer Orchestrator skill do?
An in-the-wild benchmark for AI agents in the production harness.
Is Arxiv Summarizer Orchestrator safe to install?
The audit found nothing in the source that contradicts what it says it does, and graded it B (89/100). Grade A is held back for packages that have also passed a sandboxed behavioural run, which is why a clean skill reads B.
What can Arxiv Summarizer Orchestrator access on my machine?
The audit observed no filesystem, network or shell use at all in its source.
Which assistants does Arxiv Summarizer Orchestrator work with?
Its documentation mentions openclaw. That is what the text claims, not a compatibility test we ran.
How current is this page?
The grade is for one exact copy of the source (a79d9cd3663a), read on 2026-10-15. The repository is watched, and a new audit runs when it changes — this is the first audit.

Sources

Spotted something wrong? Report a correction · Methodology

Keep going in your AI

Opens with this page as the source. We add nothing else to the prompt.