llml LLM Launcher

New profiles added regularly — watch the llml repo ↗ to get notified.

← browse

Kimi-K2.6-non-thinking-UD-Q2_K_XL

Dynamic 2-bit quant.

llama.cpp Mixed Cross-platform General Updated 2026-06-05
Model Kimi-K2.6-non-thinking-UD-Q2_K_XL
Backend llama.cpp
Hardware Mixed
Use case General
Maintainer @flyingnobita
Last updated 2026-06-05

Why this profile exists

Dynamic 2-bit quant; 350GB+ total memory (RAM+VRAM); Instant/non-thinking mode

Launch configuration

# args
--temp 0.6
--top-p 0.95
--context-size 98304
--chat-template-kwargs {"enable_thinking":false}

Hardware assumptions

  • Mixed — tested envelope
  • Cross-platform — backend installed and on PATH
  • Backend: llama.cpp >= current llml-supported version
  • Profile assumes the model file is already on disk; llml supplies the path at launch