Posts Tagged ‘Local AI’

How fast a local LLM runs depends on the hardware, the model and the number of requests it processes at the same time. To measure this, I benchmarked 20 current open-weight models on an NVIDIA DGX Station GB300 and 14 of them on a DGX Spark. This series presents the results, one machine and one…