Skip to content

fix(originality): include gis and security in check-agent-originality.sh AGENT_DIRS#649

Closed
Synvoya wants to merge 1 commit into
msitarzewski:mainfrom
Synvoya:fix-originality-agent-dirs
Closed

fix(originality): include gis and security in check-agent-originality.sh AGENT_DIRS#649
Synvoya wants to merge 1 commit into
msitarzewski:mainfrom
Synvoya:fix-originality-agent-dirs

Conversation

@Synvoya

@Synvoya Synvoya commented Jul 2, 2026

Copy link
Copy Markdown

What does this PR do?

scripts/check-agent-originality.sh builds its comparison corpus from a hardcoded AGENT_DIRS list that had drifted out of sync with the canonical division set in divisions.json. It was missing gis and security, and it listed the non-division strategy/ (which has no agent frontmatter). As a result, every agent in the gis and security divisions was silently never checked for near-duplicates.

This aligns AGENT_DIRS to the canonical 16 divisions (matching scripts/lint-agents.sh), and refreshes the now-stale calibration note in the same file.

Testing

  • Audit run (scripts/check-agent-originality.sh with no args) now covers 233 agents, including 23 gis/security agents that were previously excluded — exit 0, worst same-pair similarity ~1.9% (well under the WARN/FAIL thresholds). Updated the header/output baseline from the stale 184 agents / ~1.5% to 233 / ~1.9% accordingly.
  • bash -n scripts/check-agent-originality.sh clean.

Notes

This touches a CI/tooling script — happy to move it to an Issue/Discussion first if you'd prefer that per CONTRIBUTING. There is a small follow-up (guarding this list in check-divisions.sh so it can't drift again) which I've opened as a separate, stacked PR.

check-agent-originality.sh's AGENT_DIRS omitted the gis and security divisions
(and listed the non-division strategy/, which has no agent frontmatter), so
those divisions' agents were silently never checked for near-duplicates. Align
the list to the canonical 16 divisions (matches scripts/lint-agents.sh); refresh
the calibration note (corpus 184->233 agents, worst pair ~1.9%).
@msitarzewski

Copy link
Copy Markdown
Owner

Thanks for catching the drift here — you're right that gis and security were missing from the originality check's division list.

Closing this as superseded by #659, which fixes the root cause: instead of patching the hardcoded list, #659 has the script read divisions.json (the catalog's single source of truth) directly, so AGENT_DIRS can never drift out of sync with the divisions again. Really appreciate you flagging it. 🙏

msitarzewski added a commit that referenced this pull request Jul 5, 2026
check-agent-originality.sh hardcoded its own copy of the division list
(AGENT_DIRS) in the Python heredoc — a 5th copy that check-divisions.sh's
bash-array parser never saw, so it drifted: it was missing `gis` and
`security` and still carried the retired `strategy`. The practical effect
was that every gis/ and security/ agent — including newly added ones —
skipped the duplicate-detection scan entirely.

Read divisions.json directly instead of hardcoding, so this check can
never drift from the catalog again. Now scans all 16 divisions; verified
green in full-audit mode.

Supersedes #649/#650, which patch the hardcoded constants rather than
removing them.


Claude-Session: https://claude.ai/code/session_01WKnDRWM4izsB8WAXKszhsq

Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants