Skip to journal
david sheffer.

THE JOURNAL

Notes from the workbench.

Engineering memory. Big models, modest machines. Experiments that changed how I think—and the path that brought me here.

Local LLMs · Field notes

30 billion parameters. No GPU.

What running Qwen3 on a six-core, 64 GB machine taught me about active parameters, memory bandwidth, and the difference between fitting and running well.

4 min read

Read story

Building Hunch

Code remembers what. Who remembers why?

The idea behind Hunch: keep the decisions, failed approaches, and context that an AI coding session should not have to rediscover.

3 min read

Read story

Engineering memory · Evidence

Your agent remembered. Did it actually learn?

Building Hunch pushed me to separate four things that are too easily collapsed: recall, claimed use, verification, and actual improvement.

3 min read

Read story

Local LLMs · A failed experiment

I made it stream. It got slower.

A 70.5-second local-model pipeline became a 109-second pipeline after adding progressive output. The missing ingredient was actual overlap.

3 min read

Read story

Retrieval · Measuring the result

Perfect JSON. Worse search.

My local model produced valid structured output hundreds of times. The harder question was whether any of it helped someone find the right thing.

4 min read

Read story
An imagined workshop, created from David’s portrait

The journey

The long way into engineering.

QA, customer support, project management, frontend, full stack. A winding path that still shapes every system I build.

3 min read

Read story