Writing

Deep dives on projects and research: autonomous ground and underwater vehicles, perception and reinforcement learning.

6 posts

Fine-tuned 27B LoRAs tie gpt-6-luna on the offline bench but capture half as many live rules moments

I Fine-Tuned Small LLMs All Summer. Then I Shipped the API.

Dozens of LoRA runs from Qwen 1.7B to 27B, a 3,416-card gold corpus, and an eval stack that kept moving under me. The fine-tunes matched a cheap frontier API on quality, but serving them only pays off at roughly ten tables running 24/7, and a new Luna generation at half the price made the API the right thing to design around.

#LLM #Fine-tuning #LoRA #Evaluation #MLOps #Economics

Precision/recall: offline distilled cascade at P1.0/R0.90 vs the live shipped operating point at P0.84/R0.69

Gatekeeping a Frontier LLM with a 66M-Parameter Model

How Sage decides when to speak: three weeks of moving the FIRE/SILENT decision from an LLM to a distilled DistilBERT. The labels were wrong before the model was, a silence timer was hiding 91% of the transcript, and distilling the arbiter made precision free. Includes a CPU microbenchmark, the cost math, and the honest gap between offline 90/90 and live P0.84/R0.69.

#NLP #Distillation #DistilBERT #LLM #Evaluation #PyTorch

Sage realtime architecture: browser and Discord audio into per-player Deepgram streams, a silence gate, a two-call LLM agent with MCP tools and hybrid RAG, and a unified DM timeline

Sage: Real-Time Voice AI for the Dungeon Master

Sixty days into building a live AI co-pilot for my D&D table: per-player streaming STT, a silence-gated two-call agent over MCP tools and hybrid RAG, an honest latency budget, the benchmarks that lied to me, and the production incident that made me collapse five code paths into one.

#LLM #Speech #Real-time #MCP #FastAPI #Distributed Systems

Paradigm IGVC robot on the bench in the workshop

Intelligent Ground Vehicle Competition

Leading the software for Paradigm's entry in the 30th IGVC: vision-based obstacle detection, mapping and ROS 2 Nav2 for an autonomous course with lane lines and obstacles.

#Computer Vision #Transformer #ROS #Unreal Engine #PyTorch

Herd's Eye View architecture diagram: multi-robot cameras into cross-attention, a world-centric map and a control policy

My Research - Herds Eye View

My MSc research (AIIDE-2023): a shared, world-centric view built from many agents' cameras that helps RL agents learn in multi-agent games.

#Computer Vision #Transformer #RL #Unity #PyTorch #C#

The SR AUV at the edge of its test tank

Subsea Resident Autonomous Underwater Vehicle

My engineering capstone: autopilot perception, navigation and control for a subsea resident AUV, trained in a Unity simulator with reinforcement learning.

#Computer Vision #RL #Unity #TensorFlow #C#

© 2026 Andrew Nash updated 2026-10-04
  • Experience
  • Projects
  • Publications
  • Education
  • Writing all posts
  • I Fine-Tuned Small LLMs All Summer. Then I Shipped the API. 2026
  • Gatekeeping a Frontier LLM with a 66M-Parameter Model 2026
  • Sage: Real-Time Voice AI for the Dungeon Master 2026
  • Intelligent Ground Vehicle Competition 2023
  • My Research - Herds Eye View 2023
  • Subsea Resident Autonomous Underwater Vehicle 2020
  • Resume (PDF)
  • GitHub github.com/andrewnash
  • LinkedIn in/andrewnashnl
  • Copy email anash1324@gmail.com
  • Switch to light theme
  • Print resume

↑↓ move↵ openesc close