Building Tenslam MiniLM: 29.9M to 60.1M Parameters, 791M Tokens, and an Evaluation Bug
An engineering write-up on training two decoder-only Transformers, recovering an inference export, and fixing misleading validation.
Engineering notes, technical essays, and working ideas across AI, software, and science.
This section is for applied technical writing, not content for content's sake. Expect notes on computer vision, local models, backend systems, AI tooling, product lessons, and occasional science-heavy curiosity.
If you want to follow new posts, the site has an RSS feed at /feed.xml.
An engineering write-up on training two decoder-only Transformers, recovering an inference export, and fixing misleading validation.
A technical pipeline for turning RGB video observations into executable humanoid robot behavior.
Why structured movement data matters, and why video is only the starting point.
What local model experiments taught me about speed, memory, and practical constraints.
Lessons from turning a mobile camera into a feedback loop for training.