Skip to content

Conversation

@dimitri-yatsenko
Copy link
Member

Summary

Enhances the reference specifications index with clear reading order, prerequisites, and cross-references to related documentation.

Problem

From cohesion review (COHESION-REVIEW.md Issue #7, Medium Priority):

  • Users don't understand relationships between specs
  • No guidance on which spec to read first
  • Missing links to related how-to guides and explanations
  • Users reading semantic-matching.md don't know it connects to model-relationships.ipynb

Solution

Comprehensive enhancement of reference/specs/index.md:

1. How to Use These Specifications

Three user personas:

  • New users → Start with tutorials/how-tos
  • Implementers → Use specs as authoritative sources
  • Debuggers → Clarify ambiguous behavior

2. Reading Order Section

Foundation (Start Here):

  1. Table Declaration
  2. Primary Keys
  3. Type System

Then branch based on needs:

  • Working with data? → Data Operations
  • Building queries? → Query Algebra
  • Using large data? → Object Storage

Each path shows:

  • Prerequisites (what to read first)
  • Numbered sequence
  • Explicit progression

3. Enhanced Specification Tables

New columns:

  • Prerequisites: Shows dependencies (e.g., "Table Declaration, Primary Keys")
  • Related How-To: Links to practical guides
  • Related Explanation: Links to conceptual docs

Key concepts summary: Brief overview of main topics for each category

4. Complete Cross-References

15+ how-to guide links:

  • Define Tables, Query Data, Insert Data, Run Computations, etc.

10+ explanation links:

  • Relational Workflow Model, Query Algebra, Type System, etc.

All prerequisites documented:

  • Clear dependency chain prevents confusion

Example Enhancement

Before (Simple List)

| [Query Operators](query-algebra.md) | Operators: restrict, proj, join... |

After (Rich Context)

| Specification | Prerequisites | Related How-To | Related Explanation |
|---------------|---------------|----------------|---------------------|
| [Query Operators](query-algebra.md) | Table Declaration, Primary Keys | [Query Data](../../how-to/query-data.md) | [Query Algebra](../../explanation/query-algebra.md) |

Plus key concepts: Restriction (&, -), projection, join, aggregation, universal set

User Impact

Before (Confusion)

  • "Which spec should I read first?"
  • "What do I need to know before reading semantic-matching.md?"
  • "Where's the practical guide for this spec?"
  • Users jump directly to specs without context

After (Clarity)

  • Start with Foundation (3 specs)
  • Check prerequisites before reading
  • Find related how-to for practical usage
  • Find related explanation for conceptual understanding
  • Understand key concepts for each topic

Navigation Improvements

Reading progression:

Foundation
├─ Table Declaration
├─ Primary Keys
└─ Type System
    ↓
Choose based on needs:
├─ Query Algebra (if building queries)
├─ Data Operations (if working with data)
└─ Object Storage (if using large data)

Each spec now shows:

  1. What to read first (prerequisites)
  2. How to use it (related how-to)
  3. Why it works this way (related explanation)
  4. Key concepts to understand

Related

- Fixed llms.txt manual reference from migrate-from-0x to migrate-to-v20
- Regenerated llms-full.txt to pick up all corrected migration guide links from PR #107
- Verified no remaining broken internal links in LLM documentation files
Addresses gap identified in cohesion review (COHESION-REVIEW.md Issue #7):
- Users don't understand spec dependencies
- No guidance on reading order
- Missing links to related how-to/explanation pages

Enhancements:

1. How to Use These Specifications section:
   - Clear guidance for new users (start with tutorials)
   - For implementers (use specs as authoritative sources)
   - For debugging (clarify ambiguous behavior)

2. Reading Order section:
   - Foundation (3 specs - start here)
   - Branching paths: Query Algebra, Data Operations, Object Storage
   - Prerequisites listed for each path
   - Advanced topics (master-part, virtual schemas)

3. Enhanced specification tables:
   - Added Prerequisites column (shows dependencies)
   - Added Related How-To column (links to practical guides)
   - Added Related Explanation column (links to conceptual docs)
   - Key concepts summary for each topic

4. Clear progression paths:
   - Foundation → choose based on needs
   - Prerequisites prevent getting lost
   - Related docs provide context and practical application

Cross-references added:
- 15+ how-to guide links
- 10+ explanation links
- All prerequisites documented

Impact:
- Users understand which specs to read first
- Clear path from basics to advanced
- Easy navigation to related practical/conceptual docs
- Prevents reading specs in wrong order

Fixes: COHESION-REVIEW.md Issue #7 (Medium Priority)
@dimitri-yatsenko
Copy link
Member Author

Consolidated into #119 - Documentation Cohesion Review: Comprehensive Improvements for DataJoint 2.0

@dimitri-yatsenko dimitri-yatsenko deleted the docs/enhance-specs-index branch January 14, 2026 23:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants