dgx-spark-qwen38 / Models / Qwen3.8-Flash-Next 176B
Run Qwen3.8-Flash-Next 176B on a DGX Spark
A 176B mixture of experts on one box, by Qwen. NVFP4 with NEXTN speculation, on SGLang.
Qwen's 176B mixture of experts in NVFP4 on one box, at its full 262K window: its 47.7 GiB FP8 N-gram table lives in a sparse file on the local NVMe, so the memory goes to the weights and a real KV cache. On an ASUS Ascent GX10 with 128 GB: 47.9 tok/s, on code, with FLASH_TIER=context.
Measured
47.9tok/s
on code, with FLASH_TIER=context
- A 262K-token window
- GSM8K 97.41% on 1,314 problems
- HumanEval 95.73%, MMLU 90.8%
- Measured on
- an ASUS Ascent GX10 with 128 GB, the project's reference box
- How
- the flash lane campaign
- Source
- docs/flash-lane.md
Load it
From the cockpit: open the Lanes view, pick Qwen3.8-Flash-Next 176B and press Load. From a terminal, in the repo folder on the box:
./switch-model.sh flash # switches the boot, then prints the commands to runswitch-model.sh never restarts an engine itself: it prints the exact stop and start commands. The cockpit's Load runs them for you.
Other checkpoints of the same lane load the same way: flash-nvda, flash-uncensored.
On a 64 GB DGX Spark
No: it needs a 128 GB DGX Spark. A 64 GB box serves Nemotron 3.5 Bolt and Qwen3.8-27B: what runs on 64 GB.
Use it from your tools
The box serves OpenAI- and Anthropic-compatible APIs on port 30001, with an API key. Claude Code, opencode, Open WebUI and the OpenAI and Anthropic SDKs point there instead of a cloud: see Claude Code with a local model and opencode with a local model.
Install it
One command, on stock DGX OS. The same command updates it later.
curl -fsSL https://raw.githubusercontent.com/hasso5703/dgx-spark-qwen38/main/get.sh | bashQuestions about Qwen3.8-Flash-Next 176B on a DGX Spark
Can a DGX Spark run Qwen3.8-Flash-Next 176B?
Yes. Qwen's 176B mixture of experts in NVFP4 on one box, at its full 262K window: its 47.7 GiB FP8 N-gram table lives in a sparse file on the local NVMe, so the memory goes to the weights and a real KV cache. The installer of dgx-spark-qwen38 sets it up, and the cockpit loads it with one button.
How fast is Qwen3.8-Flash-Next 176B on a DGX Spark?
47.9 tok/s, on code, with FLASH_TIER=context, measured on an ASUS Ascent GX10 with 128 GB. A 262K-token window. GSM8K 97.41% on 1,314 problems. HumanEval 95.73%, MMLU 90.8%.
Does Qwen3.8-Flash-Next 176B run on a 64 GB DGX Spark?
No: it needs a 128 GB DGX Spark.
The other lanes
- QwenQwen3.8-27B71.4 tok/s, greedy median, one request
- NVIDIAFlash FP4-Local55.4 tok/s, greedy median, at its default effort
- NVIDIANemotron 3.5 Bolt140 tok/s, rewriting code, one request, reasoning off
- NVIDIANemotron 3.5 Super VL69.5 tok/s, rewriting code, one request, reasoning off
- Ornith AIOrnith 1.5 122B42.4 tok/s, greedy median, one request
- Aleph AlphaKolibri-148.0 tok/s, one request
- QwenQwen-Image 2.17.5 s, with its Turbo, per 1024×1024 image
- MiniMaxMiniMax-H3126.2 to 127.9 s, with the Turbo adapter, for 4 s of 480P video