Skip to content

Add rag engineer - #686

Closed
ai-turn wants to merge 2 commits into
msitarzewski:mainfrom
ai-turn:add-rag-engineer
Closed

ai-turn wants to merge 2 commits into
msitarzewski:mainfrom
ai-turn:add-rag-engineer

Conversation

@ai-turn

@ai-turn ai-turn commented Jul 8, 2026

Copy link
Copy Markdown

What does this PR do?

Adds a new Engineering agent: RAG Engineer.

This agent specializes in production RAG design, debugging, and improvement. It focuses on diagnosing poor answers through the evidence chain first: corpus, chunking, embeddings, retrieval, reranking, prompt grounding, observability, and evals. The core idea is to avoid blaming the LLM model before verifying whether the right evidence was retrieved and presented to the generator.

Agent Information (if adding/modifying an agent)

  • Agent Name: RAG Engineer
  • Category: Engineering
  • Specialty: Production RAG systems, retrieval debugging, grounded generation, citation behavior, and evaluation loops

Checklist

  • Follows the agent template structure from CONTRIBUTING.md
  • Includes YAML frontmatter with name, description, color
  • Has concrete code/template examples (for new agents)
  • Tested in real scenarios
  • Proofread and formatted correctly

msitarzewski added a commit that referenced this pull request Jul 17, 2026
Production RAG pipeline specialist: chunking strategy, retrieval quality,
hybrid search, re-ranking, and eval-driven iteration. Retrieval-first
debugging mindset ("the retrieval is the crime scene, I have the evals").

Chosen over the concurrent #686 (RAG Engineer) as the keeper: same concept,
but #601 is more complete (2x content, 7 code blocks) and was submitted first.

Gate: lint 0/0, originality 0.0%, 1 H1 + 9 sections + 7 code blocks, valid
division. All guards green (divisions/tools/runbooks/hermes); Hermes roster
261 -> 262.



Claude-Session: https://claude.ai/code/session_01WKnDRWM4izsB8WAXKszhsq

Co-authored-by: MaedehJJ <MaedehJJ@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
@msitarzewski

Copy link
Copy Markdown
Owner

Thanks for this, @ai-turn — solid RAG agent. We had a concurrent submission (#601, RAG Pipeline Engineer) covering the same specialty, and after a detailed comparison we merged that one as the keeper (it was submitted first and is ~2× the content). So I'm closing this as a duplicate — no reflection on the quality.

One genuinely great thing yours has that #601 doesn't: the explicit Symptom → Evidence Chain → Root Cause → Smallest Fix debugging framework. That's sharper than anything in the merged agent. If you're up for it, we'd love a follow-up PR that grafts that framework into engineering/engineering-rag-pipeline-engineer.md — it'd genuinely improve it, and you'd get the credit. 🙏

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants