Posts Tagged ‘MoE’
NVIDIA DGX Station GB300 compared with 4x / 8x RTX PRO 6000 Server edition GPU Server
The NVIDIA DGX Station GB300 is an interesting offering for teams requiring cloud independence. It is primarily intended for office deployment, as a relatively quiet machine with a 1600W power supply unit. However, some teams are also able to host their own servers in a datacenter. Therefore, it is useful to compare the NVIDIA DGX…
WeiterlesenNVIDIA DGX Station GB300 FAQs
How fast is the NVIDIA DGX Station GB300? Our first customer for the DGX Station GB300 allowed us to share this screenshot. It shows the performance of DeepSeek-V4-Flash-NVFP4 and Qwen2.5-Coder-32B-Instruct. These models fit comfortably into the HBM3e VRAM. DeepSeek-V4-Flash-NVFP4 achieves around 159 output token/s, and Qwen2.5-Coder-32B-Instruct around 70 – 73 output token/s. Which LLM models…
Weiterlesen
English 
Deutsch (Sie)