Live survey304 models · 14 providers · 22,792 auditsAudited grill-with-docs · SAFE →What changedHow we verifyllms.txt

Agent skill · Audited from source

Paper Notes

skill · WILLOSCAR/research-units-pipeline-skillsLicence not declaredAudited 19 Oct 2026 · source 81994516a430

★ 513pushed 14 days ago
!CAUTIONGrade B · 89/100 · 4 findings · 8199451
513repo stars · whole WILLOSCAR/research-units-pipeline-skills

Is it safe? With care — CAUTION, grade B (89/100). We read this skill's source at commit 81994516a430 and observed network access and no hard-coded secrets. The audit raised 4 findings, 0 critical or high. What it does: Write structured notes for each paper in the core set into `papers/paper_notes.jsonl` (summary/method/results/limitations).

Ask an AI about this pageGChatGPTCClaudePPerplexityGeGeminiXGrok
More
Cite

Cite this page

ModelsAtlas. “Paper Notes (WILLOSCAR/research-units-pipeline-skills)”. Retrieved 19 Oct 2026. https://modelsatlas.com/skills/willoscar/paper-notes

Trust audit

Audit 0.4.1 · source read 19 Oct 2026

Trust score89/100!CAUTION B
0 critical0 high2 medium2 low0 info

CAUTION means the audit found things worth knowing before you trust this skill. Grade B is shared by 16,667 of 17,602 audited skills.

What the source does

  • FilesystemNone observedNo reads or writes in the source
  • NetworkDeclared1 observation
  • ShellNone observedNo commands run in the source
  • DependenciesPinnedNothing floats
  • SecretsNone foundNo keys in source

Five audit layers

LayerWhat we checkResultFindings
L0 ProvenanceRepo owner, licence, archive status, activityWARN2
L1 Static sourceSecrets, path traversal, supply chain, hidden codeWARN2
L2 InstructionsPrompt injection, authority framing, hidden directivesPASS0
L3 InventoryThe files and declarations match the sourcePASS0
L4 SandboxRun in isolation and watch behaviourSKIPPED why0

Gates applied: no behavioural pass, no license.

Findings (4)

MEDIUMNetwork egressnet.beacon_words · scripts/run.py:880
F-04 Network egressCWE-200 · CWE-319Layer L1
if any(w in low for w in ['attack', 'vulnerab', 'prompt injection', 'exfiltration', 'jailbreak', 'guardrail', 'sandbox']):
Why
No further detail recorded for this rule.
Fix
—
LOWInventory / provenanceinv.no_license
F-13 Inventory / provenanceCWE-1104Layer L0
Why
no LICENSE file and no repo licence
Fix
add a licence
LOWInsecure cryptocrypto.weak_hash · scripts/run.py:860
F-09 Insecure cryptoCWE-327 · CWE-338Layer L1
h = hashlib.sha1(f"{kind}|{snippet}".encode('utf-8', errors='ignore')).hexdigest()[:10]
Why
No further detail recorded for this rule.
Fix
—

Audit 0.4.1 · source sha 81994516a430 · 19 Oct 2026Report an issue or request a re-scan

Provenance

Who published it, and what the verdict is pinned to

  • PublisherWILLOSCAR GitHub userOwner of the repository this skill is read from
  • Source folderWILLOSCAR/research-units-pipeline-skills/.codex/skills/paper-notesThe exact folder we audited
  • LicenceNot declaredAs the repository states it
  • Commit pinned for this verdict81994516a430A new audit runs when the source changes
  • Repository statusNot archivedLast push 14 days ago
  • Sandboxed runNot runSkills are read, not executed; layer L4 is skipped

What it tells the agent

Full source on GitHub ↗

Its description: Write structured notes for each paper in the core set into `papers/paper_notes.jsonl` (summary/method/results/limitations).

---
name: paper-notes
description: "Write structured notes for each paper in the core set into `papers/paper_notes.jsonl` (summary/method/results/limitations)."
---

# Paper Notes

## Triggers & routing

- **Trigger**: paper notes, structured notes, reading notes, 论文笔记, paper_notes.jsonl.
- **Use when**: survey 的 evidence 阶段(C3),已有 `papers/core_set.csv`(以及可选 fulltext),需要为后续 claims/citations/writing 准备可引用证据。


Produce consistent, searchable paper notes that later steps (claims, visuals, writing) can reliably synthesize.

This is still **NO PROSE**: keep notes as bullets / short fields, not narrative paragraphs.

## Load Order

Always read:
- `references/overview.md`
- `references/note_schema.md`

Read by task:
- `references/limitation_taxonomy.md` when writing or reviewing limitations (avoid boilerplate)
- `references/result_extraction_examples.md` when extracting key_results (good vs bad examples)
- `references/source_text_hygiene.md` when result/limitation fields still preserve paper self-narration or author-result wrappers

Machine-readable assets:
- `assets/note_schema.json` — JSONL record schema for validation
- `assets/evidence_tags.json` — evidence bank tagging categories (extensible without code changes)
- `assets/source_text_hygiene.json` — note-field source sentence cleanup policy
- repo-wide `assets/limitation-signals.json` — shared polarity rules for
  distinguishing unresolved constraints from resolved failures or improvements

## Script Boundary

Use `scripts/run.py` only for:
- deterministic scaffold generation from core_set + metadata
- priority selection based on mapping coverage
- evidence bank construction from structured note fields

Do not treat `run.py` as the place for:
- paper-specific limitation prose (use `references/limitation_taxonomy.md` for guidance)
- domain-specific evaluation heuristics hidden in code
- reader-facing narrative text

## Role cards (prompt-level guidance)

- **Close Reader**
  - Mission: extract what is *specific* and *checkable* (setup, method, metrics, limits).
  - Do: name concrete tasks/benchmarks and what the paper actually measures.
  - Avoid: generic summary boilerplate that could fit any paper.

- **Results Recorder**
  - Mission: capture evaluation anchors that later writing needs.
  - Do: record task + metric + constraints (budget/tool access) whenever available.
  - Avoid: copying numbers without the evaluation setting that makes them meaningful.
  - Avoid: promoting artifact introductions (`X enables ...`, `our framework features ...`) into `key_results`.
  - Avoid: promoting benchmark-positioning, field-motivation, or author-navigation lines (`we apply ... and show ...`, `we then discuss how ...`) into `key_results`.

- **Limitation Logger**
  - Mission: capture the caveats that change interpretation.
  - Do: write paper-specific limitations (protocol mismatch, missing ablations, threat model gaps).
  - Avoid: repeated generic limitations like “may not generalize” without specifics.


## When to use

- After you have a core set (and ideally a mapping) and need evidence-ready notes.
- Before writing a survey draft.

## Inputs

- `papers/core_set.csv`
- Optional: `outline/mapping.tsv` (to prioritize)
- Optional: `papers/fulltext_index.jsonl` + `papers/fulltext/*.txt` (if running in fulltext mode)

## Outputs

- `papers/paper_notes.jsonl` (JSONL; one record per paper)
- `papers/evidence_bank.jsonl` (JSONL; addressable evidence snippets derived from notes; profile target: course paper >=4, A150++ >=7 items/paper on average)

## Decision: evidence depth

- If you have extracted text (`papers/fulltext/*.txt`) → enrich key papers using fulltext snippets and set `evidence_level: "fulltext"`.
- If you only have abstracts (default) → keep long-tail notes abstract-level, but still fully enrich **high-priority** papers (see below).

## Workflow (heuristic)
Uses: `outline/mapping.tsv`, `papers/fulltext_index.jsonl`.


1. Ensure **coverage**: every `paper_id` in `papers/core_set.csv` must have one JSONL record.
2. Use mapping to choose **high-priority papers**:
   - heavily reused across subsections
   - pinned classics (ReAct/Toolformer/Reflexion... if in scope)
3. For high-priority papers, capture:
   - 3–6 summary bullets (what’s new, what problem setting, what’s the loop)
   - `method` (mechanism and architecture; what differs from baselines)
   - `key_results` (benchmarks/metrics; include numbers if available)
   - `limitations` (specific assumptions/failure modes; avoid generic boilerplate)
4. For long-tail papers:
   - keep summary bullets short (abstract-derived is OK)
   - still include at least one limitation, but make it specific when possible
5. Assign a stable `bibkey` for each paper for citation generation.

## Quality checklist

- [ ] Coverage: every `paper_id` in `papers/core_set.csv` appears in `papers/paper_notes.jsonl`.
- [ ] High-priority papers have non-`TODO` method/results/limitations.
- [ ] Limitations are not copy-pasted across many papers.
- [ ] `evidence_level` is set correctly (`abstract` vs `fulltext`).

- [ ] Evidence bank: `papers/evidence_bank.jsonl` exists and meets the selected profile (course paper >=4; A150++ >=7 items/paper on average).
## Helper script (optional)

### Quick Start

- `uv run python .codex/skills/paper-notes/scripts/run.py --help`
- `uv run python .codex/skills/paper-notes/scripts/run.py --workspace <workspace>`

### All Options

- See `--help` (this helper is intentionally minimal)

### Examples

- Generate notes, then optionally enrich `priority=high` papers:
  - Run the helper once, then refine `papers/paper_notes.jsonl` (e.g., add full-text details for key papers and diversify limitations).

### Notes

- The helper writes deterministic metadata/abstract-level notes and marks key papers with `priority=high`.
- In `pipeline.py --strict` it will be blocked if high-priority notes are incomplete (missing method/key_results/limitations) or contain placeholders.

## Troubleshooting

### Common

Excerpt, first 6,000 characters of SKILL.md, verbatim from the audited commit. It is text from someone else’s repository, quoted so you can judge it before your agent reads it.

Install

Pinned to the audited commit 8199451

Download folder ↗
git clone https://github.com/WILLOSCAR/research-units-pipeline-skills
git -C research-units-pipeline-skills checkout 81994516a430

The author documents no install command, so this uses the repository directly. Our verdict covers commit 81994516a430 only.

Works in which agents?

What its own text says, not a test

AgentStatusMore
CodexMentioned in its text, not testedSkills for Codex · About Codex
“Mentioned” means the skill’s text names the agent. We have not run it there.

Audit history

Every audit, every source change

  1. !CAUTION B 89 / 100

    first audit · source 81994516a430

README badge

For maintainers · shows the latest audit

ModelsAtlas: CAUTION BMODELSATLASCAUTION · B
[![ModelsAtlas: CAUTION B](https://modelsatlas.com/skills/willoscar/paper-notes/badge.svg)](https://modelsatlas.com/skills/willoscar/paper-notes/)

The badge shows our verdict and grade for this skill, and links back to this page. It changes when the audit does.

Add this badge to your README

[![ModelsAtlas: CAUTION B](https://modelsatlas.com/skills/willoscar/paper-notes/badge.svg)](https://modelsatlas.com/skills/willoscar/paper-notes/)

Questions about Paper Notes

What does the Paper Notes skill do?
Research pipelines as semantic execution units: each skill declares inputs/outputs, acceptance criteria, and guardrails. Evidence-first methodology prevents hollow writing through structured intermediate artifacts.
Is Paper Notes safe to install?
With care. The audit graded it B (89/100) and found 4 things worth knowing before you trust this skill, listed below with the exact line each was found on.
What can Paper Notes access on my machine?
The audit observed that it reaches the network. Each of those is consistent with what it says it does. Secrets in the source: none found.
Which assistants does Paper Notes work with?
Its documentation mentions codex. That is what the text claims, not a compatibility test we ran.
How current is this page?
The grade is for one exact copy of the source (81994516a430), read on 2026-10-19. The repository is watched, and a new audit runs when it changes — this is the first audit.

Sources

Spotted something wrong? Report a correction · Methodology

Keep going in your AI

Opens with this page as the source. We add nothing else to the prompt.