Lawyer’s eight-V100 AI server moves DeepSeek from 2-bit to near-NVFP4 precision
A lawyer has upgraded his private AI server with eight Nvidia V100 GPUs, now running 80% of DeepSeek V4.1 Flash at 4-bit NVFP4 precision instead of 2-bit.
The lawyer's eight-GPU Nvidia V100 server now runs DeepSeek V4.1 Flash's most-used experts at NVFP4 precision instead of 2-bit. The upgrade includes 1TB of RAM and an Nvidia RTX 3090, significantly improving the server's capabilities for his law practice.
The server uses DeepSeek V4.1 Flash with a legal harness—custom workflows and checks the lawyer wraps around the model. While performance decreased slightly from 160–215 to 150–180 tokens per second, the crashes that plagued the new build have been resolved.
Power Supply Issue
The culprit behind the crashes, originally blamed on PCIe connectivity, was likely a bad power supply unit. This discovery highlights the importance of hardware diagnostics in complex AI setups.
Related
