Willy Tarreau's stuff

Background For quite some time I had been submitting tasks to LLMs via llama-cli (natively) or llama-server (API), both from the excellent...

I recently stumbled upon this llama.cpp fork which supports AMD Radeon Instinct MI50-32GB cards ("gfx906"). That made me discover...

A well known story All those who run a small infrastructure at home know this problem. It's Monday morning, while drinking your first co...

In the previous synthetic comparison between ebtree and cebtree it was quite clear that performance varies quite a bit between key types, k...