Evernote ObservabilitySAFE
Model-agnostic agent-skills platform with a harness-free canonical layer, verified adapters, and the ccpi package manager. Explore at tonsofskills.com.
Overview
Model-agnostic agent-skills platform with a harness-free canonical layer, verified adapters, and the ccpi package manager. Explore at tonsofskills.com.
4f83675ca38aOBSERVED · 2026-10-08Host compatibility
What the documentation claims. We have not run a compatibility test.
| Host | Status | Notes |
|---|---|---|
| claude-code | mentioned |
What it tells the agent
The instruction file, verbatim from the audited commit — this is the text the model reads, and the surface the audit's instruction layer examines. Quoted here so you can judge it without cloning anything.
--- name: evernote-observability description: 'Implement observability for Evernote integrations. Use when setting up monitoring, logging, tracing, or alerting for Evernote applications. Trigger with phrases like "evernote monitoring", "evernote logging", "evernote metrics", "evernote observability". ' allowed-tools: Read, Write, Edit, Bash(npm:*), Grep version: 1.13.0 license: MIT author: Jeremy Longshore <[email protected]> tags: - saas - evernote - monitoring - observability - logging compatibility: Designed for Claude Code --- # Evernote Observability ## Overview Comprehensive observability setup for Evernote integrations: Prometheus metrics for API call tracking, structured JSON logging, OpenTelemetry tracing, health check endpoints, and alerting rules. ## Prerequisites - Monitoring infrastructure (Prometheus, Datadog, or CloudWatch) - Log aggregation (ELK, Loki, or CloudWatch Logs) - Alerting system (PagerDuty, Opsgenie, or Slack webhooks) ## Instructions ### Step 1: Metrics Collection Track key metrics with Prometheus counters and histograms: `evernote_api_calls_total` (by method and status), `evernote_api_duration_seconds` (latency histogram), `evernote_rate_limits_total` (rate limit hits), `evernote_quota_usage_bytes` (upload quota consumption). ```javascript const { Counter, Histogram } = require('prom-client'); const apiCalls = new Counter({ name: 'evernote_api_calls_total', help: 'Total Evernote API calls', labelNames: ['method', 'status'] }); const apiDuration = new Histogram({ name: 'evernote_api_duration_seconds', help: 'Evernote API call duration', labelNames: ['method'], buckets: [0.1, 0.5, 1, 2, 5, 10] }); ``` ### Step 2: Instrumented Client Wrap the NoteStore with a Proxy that automatically records metrics for every API call. Increment counters on success/failure, observe latency in histograms, and count rate limit events. ### Step 3: Structured Logging Use JSON-formatted logs with consistent fields: `timestamp`, `level`, `method`, `duration`, `userId` (hashed), `noteGuid`. Redact access tokens from all log output. ```javascript function logApiCall(method, duration, error) { const entry = { timestamp: new Date().toISOString(), service: 'evernote-integration', method, duration_ms: duration, status: error ? 'error' : 'success', error_code: error?.errorCode }; console.log(JSON.stringify(entry)); } ``` ### Step 4: Health and Readiness Endpoints Implement `/health` (liveness: is the process running?) and `/ready` (readiness: can we reach Evernote API?). Include cache connectivity check. ### Step 5: Alert Rules Configure Prometheus alerts: rate limit hits > 5 in 10 minutes, API error rate > 10%, p95 latency > 5 seconds, quota usage > 90%. ```yaml # prometheus-alerts.yml groups: - name: evernote rules: - alert: EvernoteRateLimited expr: rate(evernote_rate_limits_total[10m]) > 0.5 for: 5m labels: { severity: warning } annotations: summary: "Evernote rate limits detected" ``` For the complete metrics setup, Grafana dashboard JSON, tracing configuration, and alert rules, see [Implementation Guide](references/implementation-guide.md). ## Output - Prometheus metrics: API calls, latency histogram, rate limits, quota usage - Instrumented NoteStore client with automatic metric recording - Structured JSON logging with token redaction - Health and readiness endpoints - Prometheus alert rules for rate limits, errors, and latency ## Error Handling | Error | Cause | Solution | |-------|-------|----------| | Metrics endpoint not scraped | Prometheus target missing | Add service to Prometheus scrape config | | Missing trace context | OpenTelemetry not initialized | Initialize tracer before creating Evernote client | | Log volume too high | Logging every API call | Sample debug logs, always log errors and rate limits | | Alert fatigue | Thresholds too low | Tune alert thresholds based on baseline metrics | ## Resources - [Prometheus](https://prometheus.io/docs/) - [OpenTelemetry Node.js](https://opentelemetry.io/docs/languages/js/) - [Grafana](https://grafana.com/docs/) - [prom-client npm](https://www.npmjs.com/package/prom-client) ## Next Steps For incident handling, see `evernote-incident-runbook`. ## Examples **Grafana dashboard**: Display API call rate, p50/p95/p99 latency, error rate, rate limit frequency, and quota usage on a single dashboard. Set time range to last 24 hours. **Rate limit alerting**: Alert on-call when rate limit hits exceed 5 per 10-minute window. Include runbook link to `evernote-rate-limits` in the alert annotation.
Trust audit
SAFEgrade B · trust 89/100 Nothing in the source contradicts what it says it does. Grade A is reserved for packages that have also passed the behavioural sandbox.
| Layer | What it checks | Result |
|---|---|---|
| L0 | Provenance & inventory | PASS |
| L1 | Static analysis of the code | PASS |
| L2 | Instruction surface (what it tells the agent) | PASS |
| L3 | Class-specific surface | PASS |
| L4 | Behavioural (sandbox) | SKIPPED |
What the source does
- Filesystem
- none-observed
- Network
- none-observed
- Shell
- none-observed
- Dependencies
- pinned
- Secrets in source
- none-found
Findings (0)
No findings outside the package's declared scope.
Gates applied: no_behavioural_pass.
4f83675ca38afull audit observations/trust-audit/skill/jeremylongshore__evernote-observability.json · Report an issue / request a re-scanAudit history
Every audit this skill has had.
| Date | Source | Verdict | Grade | Score | Change |
|---|---|---|---|---|---|
| 2026-10-08 | 4f83675ca38a | SAFE | B | 89 | first audit |
Questions
What does the Evernote Observability skill do?
Model-agnostic agent-skills platform with a harness-free canonical layer, verified adapters, and the ccpi package manager. Explore at tonsofskills.com.
Is Evernote Observability safe to install?
The audit found nothing in the source that contradicts what it says it does, and graded it B (89/100). Grade A is held back for packages that have also passed a sandboxed behavioural run, which is why a clean skill reads B.
What can Evernote Observability access on my machine?
The audit observed no filesystem, network or shell use at all in its source.
Which assistants does Evernote Observability work with?
Its documentation mentions claude-code. That is what the text claims, not a compatibility test we ran.
How current is this page?
The grade is for one exact copy of the source (4f83675ca38a), read on 2026-10-08. The repository is watched, and a new audit runs when it changes — this is the first audit.