dgx-spark-qwen38 / Guides
Guides for DGX Spark owners
Each one answers a question owners ask, with the source of every number.
- How to run a local LLM on a DGX SparkOllama, NVIDIA's playbooks, an engine you tune or a one-command installer: how each runs an LLM on a DGX Spark, what it asks of you, and the speeds measured.
- An OpenAI-compatible API on a DGX SparkPoint Open WebUI, Cursor, Continue, Zed or the OpenAI SDK at your DGX Spark: one base URL on port 30001 and an API key. Any model name works.
- Can a DGX Spark run a 1M-token context?A plain install serves Qwen3.8-27B with a 1,010,000-token window on a DGX Spark. The KV pool behind it, the other 1M lanes, prefill times and how to switch.
- Claude Code with a local model on a DGX SparkRun Claude Code on the model your DGX Spark serves: claude-local sets the endpoint, the key and the limits of the lane, and keeps the session off Anthropic.
- Image and video generation on a DGX SparkQwen-Image 2.1 makes a 1024×1024 image in 7.5 s with its Turbo on a DGX Spark, and MiniMax-H3 4 s of video with its sound in about two minutes.
- opencode with a local model on a DGX SparkThe installer sets up opencode for your DGX Spark's model: an oc launcher that lifts the hidden 32,000-token output cap, limits fitted to the pool.
- Speech recognition and text to speech on a DGX SparkQwen3-ASR hears 30 languages and Kokoro speaks seven, on a DGX Spark's CPU beside any model, behind OpenAI-compatible audio routes.
- Update the AI stack of a DGX Spark without breaking itOne command installs and updates the AI stack of a DGX Spark: pinned images and checkpoints, your choices kept, the serving model proved.
- Which inference engine should you run on a DGX Spark?SGLang, vLLM and llama.cpp on one DGX Spark: the drafter and the content matter more than the engine. Code: 28-32 tok/s SGLang with DSpark, 25-26 llama.cpp.
- Why does my DGX Spark freeze when a model loads?SGLang misses 25-40 GB of transient allocations on a DGX Spark, and a pool pushed to zero freezes it. Why it happens, how to see it coming and how to avoid it.
- Why is Ollama slow on my DGX Spark?Owners report Ollama slow on DGX Spark. What they found, what to check, and one same-harness test: 60.7 tok/s on vLLM against 42.1 on Ollama for GPT-OSS-120B.
- What to run on a 64 GB DGX SparkNemotron 3.5 Bolt at 110.8 tok/s and Qwen3.8-27B at 67.2 tok/s at a 64 GB budget, and what needs 128 GB.