Skip to content

๐Ÿค– Transformers is a tool that visualizes artificial neural networks, showing data flow from input to output layers. Users can adjust the network architecture and observe how signal propagation and structure change dynamically. ๐Ÿง 

License

Notifications You must be signed in to change notification settings

gerivanc/transformers

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

97 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

๐Ÿค– Cyber Neural Network Visualization & ๐Ÿง  Transformers Neural Network โ€” Interactive Visualizer

Dual-mode interactive tool for visualizing artificial neural networks and Transformer architectures, illustrating complex machine learning concepts through real-time visual representations

โฑ Project Status: active

This project is currently in active development, featuring two distinct but complementary visualization systems:

  • ๐Ÿค– Cyber Neural Network: Abstract network visualization with interactive node systems
  • ๐Ÿง  Transformers Neural Network: Real Transformer architecture with live training

Live Demo: Transformers Interactive Visualizer

๐ŸŒŸ Dual-System Overview

๐Ÿค– Cyber Neural Network Visualization

An abstract, artistic representation of neural network principles featuring:

  • Dual-mode rendering (Cyber/Tech vs Complex aesthetic modes)
  • Interactive physics engine with node repulsion and force calculations
  • Real-time performance optimization with spatial partitioning algorithms
  • Advanced visual effects including multi-layer glow and gradient connections

Explore: Cyber Neural Network
Methodology: Calculation Details

๐Ÿง  Transformers Neural Network โ€” Interactive Visualizer

A fully functional Transformer architecture implementation featuring:

  • Real-time training with TensorFlow.js in the browser
  • Dual architecture modes (GPT-style decoder-only vs T5-style encoder-decoder)
  • Multi-head attention visualization with color-coded attention heads
  • Animated forward/backward propagation with gradient flow visualization
  • Live embeddings projection in 2D space

Explore: Transformers Visualizer
Methodology: Calculation Details

๐ŸŽฏ Educational Value

Cyber Neural Network Teaches:

  • Graph theory and network topology principles
  • Force-directed layout algorithms
  • Visual hierarchy and information coding
  • Interactive physics simulations
  • Performance optimization techniques

Transformers Visualizer Demonstrates:

  • Real Transformer architecture mathematics
  • Attention mechanism implementations
  • Backpropagation and gradient descent
  • Multi-head attention patterns
  • Encoder-decoder vs decoder-only architectures

๐Ÿ› ๏ธ Technical Implementation

Cyber Neural Network Architecture

  • Poisson Disc Sampling for optimal node distribution
  • Distance-based probabilistic linking algorithms
  • Performance-optimized rendering with adaptive quality scaling
  • Multi-layer visual effects with radial gradients and glow simulations

Transformers Implementation

  • TensorFlow.js powered real neural networks
  • Scaled dot-product attention with multi-head processing
  • Positional encoding using trigonometric functions
  • Real-time training loops with gradient visualization
  • Secure, copy-protected execution environment

๐Ÿš€ Getting Started

Prerequisites

  • Modern web browser with WebGL 2.0+ support
  • JavaScript enabled
  • Recommended: 1920ร—1080 resolution or higher

No Installation Required

Both visualizers run directly in your web browser:

  • Cyber Neural Network: Interactive abstract network exploration
  • Transformers Visualizer: Real Transformer architecture with live training

Quick Usage Guide

For Cyber Neural Network:

  1. Toggle between Cyber (performance) and Complex (aesthetic) modes
  2. Click and drag to interact with nodes using physics-based repulsion
  3. Observe real-time connection patterns and network behavior
  4. Experience smooth 60 FPS rendering with advanced visual effects

For Transformers Visualizer:

  1. Click "Train" to watch real-time model training and loss reduction
  2. Use "Forward" to see data flow through Transformer layers
  3. Click "Backward" to observe gradient propagation during backpropagation
  4. Switch between GPT and T5 architecture modes
  5. Click any token to inspect attention weights and gradient influences

๐Ÿ”ฎ Development Roadmap

Phase 1: Core Visualization โœ…

  • Dual-system architecture implementation
  • Real-time rendering engines
  • Interactive user interfaces
  • Responsive design systems

Phase 2: Enhanced Features ๐Ÿšง

  • Advanced training visualization for Transformers
  • WebGL acceleration for Cyber Neural Network
  • Additional network architectures
  • Export and sharing capabilities

Phase 3: Advanced Capabilities ๐Ÿ“‹

  • Custom dataset support
  • Pre-trained model demonstrations
  • Collaborative visualization features
  • Extended educational content

๐ŸŽจ Visual Design Philosophy

Both systems employ distinct visual languages:

  • Cyber Neural Network: Cyberpunk aesthetic with neon colors and motion trails
  • Transformers Visualizer: Technical visualization with attention heatmaps and gradient flows

Each maintains performance-optimized rendering while providing engaging, educational experiences.

๐Ÿ“š Comprehensive Documentation

For detailed mathematical foundations and implementation methodologies:

๐Ÿšฅ References in the Project

๐Ÿค Contributing & Feedback

This educational project welcomes suggestions and feedback. Both systems are designed to make complex machine learning concepts accessible through interactive visualization.

๐Ÿ“„ License

This project is licensed under the terms included in the LICENSE file.

๐Ÿ“ž Support

For questions regarding either visualization system:

  • Visit the main project page: Transformers Interactive Visualizer
  • Explore the GitHub repository for detailed documentation
  • Review methodology documents for technical implementation details

Copyright ยฉ 2025 Gerivan Costa dos Santos
Transformers Interactive Neural Network Visualizer ยฉ 2025
Dual-system architecture: Cyber Neural Network & Transformers Visualizer

About

๐Ÿค– Transformers is a tool that visualizes artificial neural networks, showing data flow from input to output layers. Users can adjust the network architecture and observe how signal propagation and structure change dynamically. ๐Ÿง 

Topics

Resources

License

Stars

Watchers

Forks