Small models.
Built in public.

Lattice is a research project building language models trained in the open

From scratch

Lattice Quark

1.5B params

1.5B pretrained and instruction tuned from scratch.

Model weights
From scratch

Lattice Mini

42M params

A tiny language model built entirely from scratch. Custom tokenizer, pretraining, and instruction tuning. Wrong answers expected; that's the point at this scale.

Chat with Mini Model weights
Blog Benchmarks Training pipeline All models on Hugging Face