โ† examples ยท Shakespeare GPT

What light through
yonder window breaks?

A 2 million parameter transformer, trained from scratch in a hand-written C++ ML framework, no PyTorch, on the complete works of Shakespeare.

1.97M parameters
95 epochs trained
val 1.86 loss
WASM runs in browser
0.85
150

~3s in browser (~1s per 50 chars; longer runs slow down)

Output ready
Press generate to speak with the Bard.