Skip to content
@Agentic-System-Lab

Agentic System Lab

Tools that make agentic systems easier to see, build and measure.

Agentic System Lab

We build tools that make agentic systems easier to see, build and measure.

An agent is a model in a loop: step after step, the model proposes an action and the harness carries it out, until it stops. A chat box shows only the question and the answer. Our projects open up the loop in between, with models that run on your own machine, so you can watch each step instead of taking it on trust.

We're based in Taiwan. Our docs come in English and Traditional Chinese, and so does our homepage: agentic-system-lab.github.io (繁體中文).

Projects

Watch an agent loop run step by step, down to every token the model writes: the token's probability, the candidates it beat, the special tokens, and the tool calls the harness reads out of them. Gemma 4 E2B or Qwen3.5 0.8B runs on your machine with transformers, or on vLLM. You can also try MTP speculative decoding, attach images, audio or video, give the model a Python sandbox, or hand the loop to pi.

Agent Loop Visualizer: the chat on the left, the loop diagram and the tokens of one step on the right

  • How it works: the 18 stages of one turn, each linked to the lines of code that do it
  • Experiments to try: sampling, stop conditions, human approval, MTP, images as tokens, code in a sandbox
  • English | 繁體中文 · Apache-2.0

More tools are on the way: one for prototyping a new agentic system from an idea, and one for testing a change to an existing agentic system against your own tasks and hardware. They'll be listed here once they're public.

Learning together

Agent Atlas strings seven courses from CMU, Stanford and Harvard into one learning path for AI agents, in 12 units. It starts with building an agent and checking what it can do, and goes on to shipping software and improving it over time. The study group follows this path, meets online and keeps shared notes. Sessions are in Traditional Chinese. Agent Loop Visualizer is the hands-on companion to Unit 01.

Notes on conference and YouTube talks about AI engineering, sorted into 9 categories, from BI and the semantic layer to agent evaluation, context and memory, and model training. Each talk has a short summary of its key points, with its full notes a click away and a link to the video. Nine insights draw on all the talks together, and you can save a sentence from any talk's notes as your own note, kept in your browser.

A playbook for how a team of 3–4 engineers keeps turning what the team doesn't know yet into verified, shared knowledge. The questions come from real work, each lab answers one of them with a small experiment, and what the team learns becomes evals, tests and decisions. Six mechanisms keep it going: a channel for new questions, a question backlog, a 75-minute lab every two weeks, failures turned into evals, an owner and a shadow who rotate each quarter, and a quarterly learning review.

How we work

  • Show the mechanism. Each project draws what actually runs, and its docs link every step to the file and line of code that does it.
  • Run it on your own machine. Local models let you see every token's probability, and your data stays with you.
  • Try it, don't just read about it. Each project comes with experiments you can run to check an idea for yourself.

Pinned Loading

  1. agent-loop-visualizer agent-loop-visualizer Public

    This project is for learning: it shows how an agent loop works underneath, in a way more intuitive and visual than reading about it. Behind an agent's chat box runs a loop: step after step, the mod…

    Python 47 2

  2. ai-talk-notes ai-talk-notes Public

    A systematic read-through of conference and YouTube talk notes on AI engineering, sorted into 9 thematic categories and distilled into short, skimmable key-point summaries — plus 9 cross-cutting in…

    HTML 8 1

  3. agent-learning-organization agent-learning-organization Public

    A playbook for a small AI agent engineering team to become a learning organization: find unknowns in real work, answer them with small experiments, and turn the results into evals, tests and decisi…

    HTML

Repositories

Showing 4 of 4 repositories
  • .github Public

    Agentic System Lab's public org profile

    Agentic-System-Lab/.github's past year of commit activity
    0 0 0 0 Updated Oct 31, 2026
  • agent-learning-organization Public

    A playbook for a small AI agent engineering team to become a learning organization: find unknowns in real work, answer them with small experiments, and turn the results into evals, tests and decisions the team reuses.

    Agentic-System-Lab/agent-learning-organization's past year of commit activity
    HTML 0 MIT 0 0 0 Updated Oct 31, 2026
  • ai-talk-notes Public

    A systematic read-through of conference and YouTube talk notes on AI engineering, sorted into 9 thematic categories and distilled into short, skimmable key-point summaries — plus 9 cross-cutting insights drawn from the entire corpus.

    Agentic-System-Lab/ai-talk-notes's past year of commit activity
    HTML 8 MIT 1 1 0 Updated Oct 31, 2026
  • agent-loop-visualizer Public

    This project is for learning: it shows how an agent loop works underneath, in a way more intuitive and visual than reading about it. Behind an agent's chat box runs a loop: step after step, the model proposes an action and the harness carries it out, until it stops.

    Agentic-System-Lab/agent-loop-visualizer's past year of commit activity
    Python 47 Apache-2.0 2 0 0 Updated Oct 31, 2026

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

HTML Python

Most used topics

Loading…