Skip to content

OxygenCobalt/FromScratchTransformer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Note: Very InDev, Currently have done shallow nets/convnets on MNIST and currently working on shallow language models (bengio)

Compile with MALLOC_CONF="thp:always,metadata_thp:always" RUSTFLAGS="-C target-cpu=native" cargo build --release

Run with ./target/release/nn

About

Making a transformer from matrix primitives upwards (hopefully)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages