Field notes and decision memos

Private AI Decision Library

Explore evidence-led notes on where AI should run, what agents need after the demonstration, and how technical mechanisms change workflow economics. Claims are bounded to their workload and evidence.

August 27, 2026LLM Benchmarking Private AI Inference Engineering

Operating a Private 27B LLM: What Makes a Benchmark Decision-Grade?

Use a benchmark card to decide when measurements from a private 27B language-model environment are complete, comparable, reproducible, and relevant to architecture. The method records workload, hardware, model representation, cache state, concurrency, acceptance, units, matched baselines, raw outputs, and failures without publishing unsupported performance claims.