Repository navigation
Description
This was generated by AI during attend-queue.
Refs: #4047
Problem
The intent of #4047 is that every native surface the model cannot invoke, and that overlaps a component, gets surfaced to the person. That only happens for surfaces that have a store row: a suggest sentence is baked only from a row, and a row is written only when a person rules on it (records.json note).
A read on 2026-10-22 against Claude Code 2.1.308 found model-disabled surfaces with no row:
inventory.py --binary-onlylistsrun-skill-generatoras a bundled skill withmodel_invocable: false. No store row names it.overlap.py detecton that inventory exits 3 (degraded) and proposes these pairs with no row. Each is a model-disabled built-in command, exceptclaude-code-docs, which is a model-invocable bundled skill. Similarity is 0.6 or higher:
| Native surface | Class, markers | Candidate component | Score |
|---|---|---|---|
rename |
builtin-command, model-invocation-disabled | docs-hygiene:rename-references |
0.79 |
brief |
builtin-command, gated, model-invocation-disabled | review:brief-reviewer (agent) |
0.74 |
resume |
builtin-command, hidden, gated, model-invocation-disabled | session-flow:continue-in-background |
0.68 |
claude-code-docs |
bundled-skill, gated | discovery:read-docs |
0.68 |
stop |
builtin-command, gated, model-invocation-disabled | session-flow:clean-stop |
0.68 |
agents |
builtin-command, hidden, model-invocation-disabled | docs-hygiene:write-for-agents |
0.65 |
The scores measure name and description similarity, not shared jobs. Several pairs are probably name collisions to dismiss, for example brief against an agent.
The list is a floor, not a total. On 2.1.308 the inventory reports these limits:
- 21 bundled-skill registrations use a computed name that the extractor did not resolve.
- The
builtin_tools,builtin_pluginsandbundled_workflowslanes are broken. validated_againstis still 2.1.288 (inventory.py:67).
Because of these limits, other model-disabled bundled skills may exist on this build and not appear here. That extractor drift belongs to the changelog lane and #6888, not to this issue.
Desired outcome
The owner rules on each candidate. A real overlap becomes a store row with a verdict and an integration value. A model-disabled surface can take only suggest, or route when the verdict is defer (native-references README:251-261). A name collision gets a dismissal. Once that is done, detect no longer proposes these pairs.
Acceptance criteria
- Each of the seven surfaces above (
run-skill-generatorand the six detect candidates) has, indocs/native-surfaces/records.json, either a store row with a person-written verdict andintegration, or a dismissal with a reason. - Each new
suggestrow's skill carries its Boundary section and suggest sentence in the same change, as the convention requires. -
docs/native-surfaces.mdis regenerated, and the PR's CI runsscripts/validate-plugins.sh(native-overlap self-check andgenerate --check) and it passes. - Every touched plugin carries a changelog fragment made with
scripts/new-changelog-fragment.sh, andscripts/check-changelog-fragments.sh --checkpasses.
Out of scope
- Fixing the inventory extractor for 2.1.308 (the changelog lane, #6888).
- Candidates scoring below 0.6. Rerun
detectafter the extractor fix to see the full set.
Activity
kyle-sexton commentedon Oct 24, 2026
Carried from epic #4047 (closing): six follow-ups the 2026-10-22 criterion check listed with no issue. Each is in scope here.
detectreverifyhelperkyle-sexton commentedon Oct 25, 2026
Released for re-triage under the owner's 2026-10-24 rule: an issue stops for a person only for an intent or vision question, a security call, a host or attended run, or spend outside prepaid credit. The hold label came off and intake triage runs again now; it re-applies a hold, with a numbered question, when one of those applies.
To hold this issue again, add
needs-human(orstatus: needs-decision) and say why in a comment.kyle-sexton commentedon Oct 25, 2026
Hold restored: the 2026-10-25 release took
needs-humanoff, but this issue does need a person under the owner's stop rule. Reason (intent): "The owner rules on each candidate. A real overlap becomes a store row with a verdict" (person-written verdict required)kyle-sexton commentedon Oct 26, 2026
Decision recorded. The owner answered in the Refinement and Issue Triage sessions (2026-10-25), deciding the open items below on the facts:
Owner ledger: Q34 (
.work/issue-triage-owner-sweep-1/interview-checklist.md:59) names this issue. It is "deferred" with "issue not touched", so it decides nothing that this record contradicts. Read against origin/main at 68d3f2b.Decided: a session acting on the owner's standing direction rules, and the store note is amended to say so.
docs/native-surfaces/records.json:3). The owner's later standing rule (.work/gh-monitor/refinement/ledger-2026-10-26.md:16-21, 2026-10-26) keeps the owner out of the loop except for an intent change, a finding that alters the primary design, or a HIGH/CRITICAL security issue. A verdict on a name pair is none of these.records.json:4745,:4853,:4907).records.jsonrow and dismissal keys:native,component,reason,as_of,date,fingerprint). Nothing enforces the note but its own text. A row only changes skill text, which merges through a PR and its CI.plugins/harness-ops/skills/audit-native-overlap/evals/evals.json:56).Decided: re-dismiss each one with its existing reason, through
overlap.py dismiss, which refreshes both fingerprints (plugins/harness-ops/skills/audit-native-overlap/SKILL.md:280-284). Detect lists a dismissed pair again when either side's description changes (SKILL.md:286-288), which explains why these four came back. Each existing reason still separates the jobs:renameanddocs-hygiene:rename-references(records.json:4745);resumeandsession-flow:continue-in-background(:4853);stopandsession-flow:clean-stop(:4907);agentsanddocs-hygiene:write-for-agents(:3575).briefandreview:brief-reviewer(agent).Decided: dismiss, shared word only.
/brief"toggles brief-only output mode" (the ruled reason atrecords.json:3755).brief-revieweris a read-only reviewer that runs the review brief it is dispatched with.claude-code-docsanddiscovery:read-docs.Decided: a verdict row,
complementary, with integrationroute. A model-invocable bundled skill takesrouteorwrap(docs/conventions/native-references/README.md:254).claude-code-docs"Answers questions about Claude Code features" (records.json:3935).read-docsreads any upstream docs page through the shared cache, and it is model-invocable (plugins/discovery/skills/read-docs/SKILL.md:2-5). They share a job only on Claude Code's own pages, so the two are complementary, not duplicates. This follows the store'scomplementaryandrouteprecedent for the built-inExploreagent and theWebFetchandWebSearchtools (README.md:238).run-skill-generator.Decided: it gets a row or a dismissal only for a component that
detectpairs it with at a score of 0.6 or more. The store holds pairs, so a surface with no candidate component has nothing to rule on. That matches Epic: native-overlap tooling fix and route-to-compose sweep #4047's intent as the body states it: a surface "that overlaps a component, gets surfaced".The six follow-ups carried from #4047 (#9105 (comment)) are not decided by this record.
Ruling and re-dismissing need an inventory from a Claude Code install, since the fingerprints hash the live registration text (
SKILL.md:280-284). A session on a machine with Claude Code builds it.Amended criteria (body criterion 1 replaced; criteria 2-4 stand as written):
Acceptance criteria:
docs/native-surfaces/records.json:3,plugins/harness-ops/skills/audit-native-overlap/SKILL.md:8and:288,plugins/harness-ops/skills/audit-native-overlap/reference/canonical-pairs.json:3, anddocs/conventions/native-references/README.md:212. The skill's evals still require that a run never decides a verdict unattended.briefandreview:brief-reviewer, and acomplementary/routerow forclaude-code-docsanddiscovery:read-docs.run-skill-generatorhas an entry for each componentdetectpairs it with at 0.6 or more.plugins/discovery/skills/read-docs/SKILL.mdcarries the## Boundarysection and description phrase for itsrouterow, in the same change.Checks a person runs:
overlap.py detecton the current Claude Code release no longer proposes these pairs.github-actions commentedon Oct 26, 2026
Proposed work class: work-class: scoped
Basis: automated intake triage; the lanes App applied this class.
Size: Medium
Complexity: Medium
Uncertainty: Known
Flags: none
Blocked by: none
#9105 (comment)
That decision settles the open questions. It covers who may rule, four refreshed dismissals, a new
briefdismissal, acomplementary/routerow forclaude-code-docs, and therun-skill-generatorscope. The remaining work is the amended criteria: update the human-gated rule wording, write the store entries, and add theread-docsBoundary section. Writing the entries needs an inventory built on a machine with Claude Code installed.Automated triage, applied by the lanes App.
17 remaining items
github-actions commentedon Oct 31, 2026
melodic-automation-lanes commentedon Oct 31, 2026
The work-resolve-issue run that
agent-readystarted failed or was cancelled before it reported, or it stopped or the token broker refused it because its workflow files differ from main's. work-unblock removed and addedagent-readyback to start a fresh run on main's workflow files. If this run ends the same way, it re-fires the issue again, waiting longer each time.github-actions commentedon Oct 31, 2026
github-actions commentedon Oct 31, 2026
melodic-automation-lanes commentedon Oct 31, 2026
The lanes App's pull request #11512 merged with
Refs:, so this issue stays open and nothing starts the lane on it again. work-unblock removedstatus: readyandagent-ready, so the hourly triage sweep sends it back to intake triage. Admission then parks it atstatus: confirmedfor a check of what that pull request left, until a**Decision recorded.**comment says what is left or someone closes it.kyle-sexton commentedon Oct 31, 2026
Decision recorded.
This settles what #11433 and #11512 left: the
detectcheck, the six follow-ups carried from #4047 and what remains. Read at origin/mainf91a3910c3;2a8767f8cechanges no file cited here. Agents decided this on evidence under standing direction §1.Amended criteria: all three met on main.
docs/native-surfaces/records.json:3,plugins/harness-ops/skills/audit-native-overlap/SKILL.md:25-26,:293-294,reference/canonical-pairs.json:3, anddocs/contracts/native-references/README.md:212, where that convention now lives.evals/evals.json:59still refuses a self-assigned verdict.claude-code-docsrow atrecords.json:759, and no entry forrun-skill-generator, whichdetectpairs with nothing on 2.1.316.plugins/discovery/skills/read-docs/SKILL.md:2carries the description phrase and:41the Boundary section.The
detectcheck: passed. Run 2026-10-31 15:05Z by this session on a host with Claude Code 2.1.316:inventory.py --binary-only, thenoverlap.py detect, exit 3 becauseplugin_backedis broken.builtin_commandsis ok andbundled_skillsdegraded, so the lanes these pairs come from were read. The five dismissed pairs sit underdiscovery.suppressed,claude-code-docs/discovery:read-docssits underdiscovery.existingwith verdictcomplementary, and none of the six is a candidate.generate --checkis in sync at 74 rows and 121 dismissals.The six follow-ups (comment 6386726091): all dropped, none built.
rechecksubcommand. Drop: the part an extraction can observe is shipped./harness-ops:changelogPhase 5 runsnative_drift.py, evaluates the store's triggers and files a work item per fired row (plugins/harness-ops/skills/changelog/SKILL.md:177-186,scripts/native_drift.py:512). A trigger that names an upstream page stays a session act (audit-native-overlap/SKILL.md:263-264). The 2026-10-22 check records no stumble against that since 2026-09-11, and a title search finds one recheck item in the skill's history, #6885, so nothing has needed one.native.docs_markers, which the self-check validates (overlap.py:654-665) and the drift pass skips (changelog/context/native-drift.md:94). Theskill-doctor/context-budget:auditrow uses it (docs/native-surfaces/records.json:1472).detect. Drop: the seeded-versus-observed case is handled (overlap.py:1714-1723,test_overlap.py:1391) and the same-name registration case is evidenced per registration (overlap.py:505-511). The cross-lane case has one live name on 2.1.316,fork, inbuiltin_commandsandbuiltin_agents. The store holds one row for it anddetectemits one candidate, at 0.0555. Scored alone, the agent registration pairs with that same component and nothing else, at 0.0436, so keying would surface nothing new today.detect --outalready writes the candidates (audit-native-overlap/SKILL.md:77-78), Phase 5 keeps a summary baseline (native-drift.md:11), and inventory plusdetecttook 35 s here. The one reader of a saveddetectreport,native_drift.py --detect, takes the file Phase 5 writes in the same pass (native-drift.md:20-23), so nothing needs a report kept from a bare run.reverifyhelper. Drop: the store shows four rows stamped after 2026-10-02, and a title search for this skill's recheck items finds one, #6885, against the title form atnative-drift.md:94. Hand-editing a row through a PR at that rate costs less than a helper. A row's evidence line is judgment a stamp cannot write.resolved but degradedstate (docs/contracts/native-references/README.md:298-300). Bothwraprows carry it:plugins/code-tidying/skills/batch-simplify/SKILL.md:38,:45andplugins/testing/skills/run-e2e/context/own-driving.md:92,:107. The first case issimplifyrunning a weaker procedure, the example Epic: native-overlap tooling fix and route-to-compose sweep #4047 named.What remains: one host step.
plugins/playbooks/skills/skill-authoring/reference/skill-criteria.md:200reads "Re-run on any change: a description change re-measures triggering, a body change re-measures output". #11512 changed theread-docsdescription and body, touched no eval and lists no run. The new phrase opens the description, asdocs/contracts/native-references/README.md:65-66requires, so the main use case moved back. All four cases inplugins/discovery/skills/read-docs/evals/evals.jsonname a Claude Code docs page, the ground that phrase splits. The rule has no exemption for an addition, so this applies.Host-run step: measure
read-docswith the description and body at5889ce96ec^against main, run concurrently: triggering with/skill-quality:check measure-invocation, output with the skill'splugins/discovery/evalscase through/evals:plugin-evaland its fourevals/evals.jsoncases through/skill-creator:skill-creator. Judge byskill-criteria.md:190. On a pass, post the numbers and close this issue. On a loss, post the numbers and leave it open with a new record, since keeping the before text drops the phrase therouterow needs.Seen and not part of this issue: on 2.1.316, eight other pairs at 0.6 or above have no verdict. Five are dismissals resurfaced by a description change. Three are new:
cc-plugin-diff/code-tidying:tidy-diff,runner/testing:green-runner, anddesign/user-interface:design(0.629), which is model-disabled. Phase 5 files a work item per new candidate (changelog/SKILL.md:183); a title search finds none yet.kyle-sexton commentedon Oct 31, 2026
Host run. Ran the three model-graded
read-docsbefore-and-after measurements,5889ce96ec^against origin/main, that the earlier no-model record left waiting: triggering, therd-unread-page-not-recalledplugin case, and the fourevals.jsonskill cases. All three pass underskill-criteria.md, judging the description and the body separately.What ran (Claude Code 2.1.316, subscription login, model
claude-opus-5-5throughout):5889ce96ec^. The after tree matches origin/main: the only commits onplugins/discoverysince49f8bd0174touch other skills, and theplugins/discoverytree is unchanged.claude plugin eval, then stopped before the skill suite.partial: falsewith no run error, and every one passesrun-validity.pyas VALID.--ablation nonefor triggering, default ablation for the plugin case,--allow-tools Bashon the plugin case,-j 2,--keep-temp,HOMEset to an empty directory, capped scope.tool_usedor regex, so no judge model was involved./skill-creator:skill-creator: one executor subagent per run, followingread-docs/SKILL.mdfrom a neutral copy of each tree.--cache,--max-age 0(case 3),read --rawor slice (case 3),--profile anthropicand slice all appear where expected, and WebFetch appears in none.Does
claude-code-docsresolve in an eval session? No.read-docsdescription text.Results:
pos-train-01,-03,-06,pos-val-03) fire 3/3 on both treesrd-unread-page-not-recalled, with pluginfetch-docs.sh, report the page unread with the sandbox reason, and give no recalled figureevals.json), mean expectation pass rateThe skill suite per case, before → after:
Verdict:
claude-code-docsis untested here, because that skill does not resolve in a plugin eval session.rd-unreadholds at 1.00. The skill suite holds or rises on every case, so the## Boundarysection and its reference file cost nothing measured.Not covered:
No code change and no PR.
Target labels: add none; remove host-run.