Serving study / recorded October 1–3, 2026

GLM-5.3-Flash on two DGX Sparks: four serving stacks

Same model, same two Sparks, four ways to serve it: Kindling's vLLM with NVIDIA's NVFP4, Mia's vLLM kit with EXL3, and TensorFold 0.6.2 with EXL3 and with MLX 4-bit. Kindling wins crowds and long prompts. TensorFold MLX wins single-user speed and repeats, with byte-identical output. The best-looking volcano came from TensorFold EXL3, after a one-character fix.

Volcano, four stacks

Kindling vLLM · NVFP4 · top leftMia vLLM · EXL3 · top rightTensorFold · EXL3 (repaired) · bottom leftTensorFold · MLX 4-bit · bottom right

Headless-browser recordings of each model's generated code on a fixed-step 24 fps virtual clock, 75 s from the first frame, no interaction. Not recordings of inference. Cards below are in visual rank by eye; one run each.

TensorFold 0.6.2 · Mia EXL3 4bpw

91,944 output tokens · 51.9 min · 30 tok/s · 66.8 KB · 1 one-character repair

Best-looking volcano: textured slopes, glowing crater, a large billowing plume, steam vents and a turquoise coast. As written the page never started: one typo (x,z pz) is a syntax error. One-character repair in a separate copy; the repaired term is multiplied by zero, so the fix changes nothing visible.

Kindling vLLM · NVIDIA NVFP4

62,104 output tokens · 26.0 min · 40 tok/s · 52.8 KB · no repairs

Most complete eruption sequence: ash column, ejecta, a lava river winding to the coast and a full pull-back. A large tan blob covers the top of the frame in the second half. No repairs.

TensorFold 0.6.2 · MLX 4-bit

112,773 output tokens · 41.8 min · 45 tok/s · 71.4 KB · no repairs

Clean and bright: village, striped cone, lightning in the plume and a lava line down the slope. Mild for an eruption and the camera stays close to the cone. No repairs.

Mia vLLM · EXL3 4bpw

65,912 output tokens · 42.7 min · 26 tok/s · 61.8 KB · no repairs

The camera buries itself in the hillside during the eruption and the eruption itself is thin; good wide island at the end. No repairs.

Speed, same harness

Thinking on for every row except the last three, which use Kindling's own decode test with thinking off at temperature 0. Best value per row highlighted.

Kindling vLLM
NVFP4
Mia vLLM
EXL3 4bpw
TensorFold
EXL3 4bpw
TensorFold
MLX 4-bit
1 request, tok/s53424358
4 at once, combined tok/s67563653
8 at once, combined tok/s87603753
First token, 1 request0.38 s0.32 s0.25 s0.23 s
First token, 4 at once (median)0.84 s0.65 s24.12 s19.92 s
First token, 8 at once (median)1.2 s29.8 s66.8 s30.2 s
Prompt read 16K, tok/s1,3301,5345521,147
Prompt read 64K, tok/s2,0441,5606271,253
Prompt read 128K, tok/s1,5781,5426101,179
Decode after 128K prompt, tok/s40313648
Same 64K prompt again, first token2.46 s2.37 s0.15 s0.13 s
4 × 32K prompts, wall69 s114 s233 s123 s
Thinking off, structured tok/s9371—84
Thinking off, code tok/s7052—69
Thinking off, prose tok/s4024—40
Same request twice / solo = 16 at once8/8 · 0/80/8 · 0/88/8 · 8/88/8 · 8/8

TensorFold 0.6.2 serves GLM one request at a time, so its 4- and 8-at-once rows are queueing. Mia's default profile runs four at a time; requests 5–8 queue. TensorFold EXL3 was not run on the thinking-off test. The last row counts byte-identical replies out of 8 prompts.

Four-panel chart: combined decode, first-token wait, prompt reading and decode after long prompts for the four stacks

Island weather, three stacks

The earlier round, before Mia's kit joined. TensorFold EXL3 built the cleanest island; on the volcano the clean-versus-repaired split went the other way, which is why neither round ranks the formats.

TensorFold EXL3 left, TensorFold MLX 4-bit (two repairs) right. Weather buttons clicked at the same virtual seconds on every arm: sun 0 s, rain 6 s, storm 13 s, hurricane 20 s, sun 27 s.

TensorFold 0.6.2 · Mia EXL3 4bpw

72,014 output tokens · 38.7 min · 31 tok/s · 50.6 KB · no repairs

Clean on the first try: palm island, weather station panel, rain, storm and a hurricane with huge jagged waves.

Kindling vLLM · NVIDIA NVFP4

60,832 output tokens · 24.6 min · 41 tok/s · 40.0 KB · 2 one-line repairs

Rendered a black sky and ocean as written. Two one-line repairs (missing fog include in the ocean shader; a sun brightness value overwritten by a colour of the same name) restore turquoise water, beach, palms, hut and pier.

TensorFold 0.6.2 · MLX 4-bit

98,082 output tokens · 36.1 min · 45 tok/s · 53.3 KB · 2 one-line repairs

Two one-line repairs (the same missing fog include; a storm mesh used before it was declared). After them: lagoon, hut, pier, rain. The island still renders as a black silhouette and storm clouds as black blobs, a third defect left unrepaired.

Read before comparing

The setup, the caveats, the limits.

Hardware: two DGX Sparks (GB10, 128 GB each), tensor-parallel 2 over 200 Gb RoCE. All four stacks used an incoai DFlash2 drafter; that drafter is licensed CC BY-NC-ND.

Stacks: Kindling kindlingai/glm-5.3-flash-gx10 @ d5abfe1 on nvidia/GLM-5.3-Flash-NVFP4. Mia MiaAI-Lab/GLM-5.3-Flash-EXL3-2x-DGX-Sparks @ 6278ecb, published image, default profile. TensorFold 0.6.2 @ 56e2e3e (the latest release when run) with Mia-AiLab/GLM-5.3-Flash-EXL3-TR3-4bpw and with TensorFold/GLM-5.3-Flash-MLX-4bit-MTP.

What each comparison isolates: TensorFold EXL3 vs TensorFold MLX is the same engine with two quantizations. Kindling vs Mia is NVFP4 vs EXL3 on vLLM, but two different vLLM builds with their own patches, and Mia's kit pins a newer drafter revision. Kindling vs TensorFold mixes engine and format.

Exactness: TensorFold gave byte-identical replies run to run and alone versus 16 at once (8/8 both). Kindling repeated itself (8/8) but changed under load (0/8); Mia's kit varied in both (0/8, 0/8).

Incidents: a first Mia speed run was thrown out after two copies of the harness hit the same server; every Mia number here is from the clean rerun. TensorFold ignores the switch Kindling's test uses to turn thinking off, so its first thinking-off pass was still thinking; the published row uses the switch TensorFold honours and was checked to produce zero reasoning tokens.

Volcano prompt, verbatim: "Create a single self-contained HTML file using Three.js that renders a visually spectacular, bright, colorful, and highly detailed 3D animated volcanic eruption scene with glowing lava, thick ash, flying ejecta, and dramatic environmental effects. Requirements: * Use Three.js loaded from a CDN. * Everything must be contained in one HTML file and work directly when opened in a modern browser. * Fill the entire browser viewport edge to edge with the 3D scene. Do not leave margins, borders, blank space, or unused areas. * Create a bright, polished, AAA-quality stylized 3D visual style with vibrant colors, detailed materials, cinematic lighting, soft shadows, atmospheric depth, and excellent visibility. * Create a large detailed volcanic island landscape surrounded by colorful terrain, a tropical coastline, turquoise sea, black sand beaches, jungle vegetation, a small village with huts and a wooden pier near the shore, and distant smaller islands. * Make the volcano the clear central focus of the scene, large enough to see important details such as the crater rim, layered rock strata, old solidified lava channels, fumaroles, and vegetation climbing the lower slopes. * Position the volcano in the center of the island at the beginning of the animation, calm and dormant, with a thin wisp of steam rising from the crater. * Include a small research station or observation post on the lower slope with instruments, antennas, and warning lights. * Start with a brief calm pre-eruption moment with subtle atmospheric movement such as light steam drifting, birds circling, gentle waves on the shore, and warning lights beginning to blink. * Show the ground beginning to tremble, with small rocks tumbling down the slopes and dust shaking loose from the crater rim. * Show the crater gradually beginning to glow from within, brightening from dull red to intense orange-white as pressure builds. * Create bright, powerful animated lava fountains erupting from the crater with multiple layers, including a bright white-yellow core, glowing orange lava blobs, and long arcing trails of molten rock. * Add intense heat glow and warm light from the lava reflecting onto the crater walls, the ash cloud, the nearby slopes, and the research station. * Create large volumes of thick animated ash and steam billowing upward from the crater into a towering eruption column, expanding outward at the top into a broad anvil shape. * Make the ash cloud roll, expand, swirl, and rise naturally instead of appearing as simple static clouds, with the underside lit orange by the lava. * Add glowing volcanic bombs and ejecta launched in ballistic arcs from the crater, leaving glowing trails and landing on the slopes with bursts of sparks and dust. * Add smaller particles, sparks, glowing embers, ash flakes, and drifting cinders throughout the eruption area. * Show rivers of glowing lava breaking over the crater rim and flowing down the flanks in branching channels, with a bright liquid core and a cooling darker crust forming on the surface as it advances. * Make nearby trees, grass, and vegetation react as the lava and hot ash approach, bending, catching fire, and burning. * Show steam explosions where lava reaches the sea, with white steam plumes and hissing spray. * Add visible atmospheric distortion or heat shimmer above the lava and crater if possible. * Add occasional volcanic lightning flickering inside the ash column. * Include subtle camera vibration and a brief cinematic camera shake during the initial tremor and the main eruption without making the scene difficult to watch. * Use a smooth cinematic camera that begins close to the coastline and village, then slowly pulls back and rises to reveal the full eruption, the lava rivers, and the towering ash column, while keeping the volcano and major effects clearly visible. * As the camera rises, smoothly reveal more of the colorful island, the coastline, the sea, clouds, and the distant horizon. * Keep the volcano large and prominent throughout the sequence. * Add layered clouds at different heights, with the eruption column eventually climbing toward and punching through them. * Use a bright blue daytime sky with colorful white clouds and strong sunlight so the lava, ash, glow, and environment remain clearly visible. * Avoid a dark night scene. The result should be bright, vibrant, high-contrast, and visually clear. * Use realistic-looking shadows and dynamic lighting, including the changing influence of the bright lava glow. * Keep the viewport visually dense and impressive throughout the animation, with no excessive empty sky or unused space. * Use layered terrain, sea, vegetation, ash, clouds, and atmospheric effects to maintain visual interest as the camera pulls back. * The animation should follow a clear sequence: calm volcano with steam wisp → warning lights blink → ground trembles and rocks tumble → crater glows brighter → lava fountain erupts → ash column rises → volcanic bombs arc outward → lava rivers flow down the flanks → vegetation burns → lava reaches the sea and steam explodes → ash column punches through the clouds with lightning → camera pulls back to reveal the whole island. * Use smooth animation for the lava, ash, ejecta, sparks, particles, vegetation, sea, steam, clouds, lighting, shadows, and camera movement. * Do not add overlay text, titles, labels, HUD, captions, menus, buttons, borders, or UI elements over the scene. * The browser viewport should contain only the animated 3D volcanic eruption scene, filling the entire screen edge to edge. * Start the animation automatically when the page loads. * Add smooth camera controls only if they do not obstruct the scene or interfere with the cinematic composition. * Optimize for smooth performance in a modern browser. * No build process is allowed, and there must be no external dependencies other than the Three.js CDN."

Island prompt, verbatim: "Create an interactive tropical island weather simulator in Three.js. Let me switch between sunshine, rain, thunderstorms with lightning, and a hurricane. Make the island and surrounding ocean react to the weather, with smooth transitions and convincing motion. Include orbit and zoom controls. Make it mobile-friendly with touch controls, easy-to-tap weather buttons, a responsive layout, and smooth performance on phones. Make it visually impressive, and choose your own style and details. Deliver everything in one HTML file, with no external libraries besides Three.js and its official addons."

Sampling: temperature 1.0, top_p 0.95, thinking on, no output cap beyond the serving window. One generation per stack per prompt, so the visual ranks describe these runs, not the quantizations. Originals are published untouched; every repair is a separate copy with its diff.