Tag

#inference

← All posts
A photograph bisected by the ocean surface: a small, ordinary lump of ice above the waterline, and beneath it a vast data centre — server racks, pipework and cabling — descending into darkness.

The Model Is Not the Product

Same model, wildly different experience: why quantization, caching, and scheduling — not the weights — decide what your app actually gets.