AI on your terms
Building language models from scratch on consumer hardware. Pre-training, research, and open-source AI tools.
Genesis: Pre-Training from Scratch
Building in the open on consumer hardware.
What We Do
From pre-training models from scratch to deploying them in production.
Pre-Training from Scratch
Training language models from scratch on consumer GPUs. Custom architecture, tokenizer, and 60B token multilingual dataset - no datacenter required.
Model Fine-Tuning
Custom fine-tuning of open-weight models for your specific use case, brand voice, and domain expertise.
Safety Evaluation
Comprehensive model evaluation aligned with frontier lab methodologies. Red team testing and benchmark analysis.
Application Development
Custom web and mobile applications with AI integration. React, TypeScript, Node.js, and native iOS.
AI Agents & Orchestration
Design and deployment of AI agent systems that work alongside your team. Multi-model orchestration, local deployment, and custom integrations.
Featured Projects
From pre-training language models to privacy-respecting AI tools.
Latest from the Blog
Technical deep-dives from the Genesis training run.
Genesis 1B: Run 2 Extended — 20k → 40k
Run 2 extended to 40,000 steps (~21B tokens, above Chinchilla-optimal). Step 38,081 / 40,000 — 95.2% complete, ETA April 7.
Genesis 1B, Run 2: 3x Throughput, Same Hardware
Redesigning Genesis 1B from 20 to 32 layers. Same param count, same GPUs, 3x training throughput.
The Optimizer State Bug: A Silent Failure in DCP Resume
A silent AdamW state bug during Run 1 that produced a false recovery on poisoned weights.
The Genesis Manifesto
Data sovereignty, constitutional alignment, and why the future of AI is local, private, and personality-first.
Fixing FSDP Checkpoint Deadlocks on 2x RTX 4090
How DCP sharded checkpoints and CPU-offload resume fixed deadlocks on consumer GPUs without NVLink.
Mapping the Mind of Qwen 3.5 9B
A sparse autoencoder for mechanistic interpretability: zero dead features, 16,384 dimensions.
Let's build together
Tell us about your project and we'll get back to you within 24 hours.
Or reach out directly