Issues

• GLM-5.3-Flash-NVFP4 CUDA OOM during load on RTX 5070 Ti 16 GB (sm_120)

  FlashML-org/FreeToken#611 · Filter by author ogino opened on Oct 6, 2026

• Windows wheels resolve unpinned torch dependency to CPU-only build: 'cannot use CUDA device 0: only 0 device(s) visible'

  FlashML-org/FreeToken#607 · Filter by author pablosilva87 opened on Oct 5, 2026
  1

• DeepSeek-V4-Flash-0731-NVFP4 (nvidia) fails on 0.1.3+gfa0e9537d: WeightLoadError KeyError 'layers.0.ffn.experts.0.w1.scale'

  FlashML-org/FreeToken#606 · Filter by author pablosilva87 opened on Oct 5, 2026
  1

• [Engine] Qwen3.8-Flash-Next-FP8 exhausts host RAM on RTX 5090 + 128 GB after serial loading fallback

  buglinux
  FlashML-org/FreeToken#600 · Filter by author yunwei37 opened on Oct 4, 2026
  1

• [Windows][Desktop] WeightLoadError: invalid python storage with Qwen3.6 NVFP4 and gpt-oss-20b MXFP4

  bugDesktopwindows
  FlashML-org/FreeToken#597 · Filter by author Shahrad-gh opened on Oct 4, 2026
  2

• The computer on the local area network cannot be accessed

  bugDesktopwindows
  FlashML-org/FreeToken#584 · Filter by author albertjacksoon opened on Sep 30, 2026

• An offloaded prefill streams every expert of each layer, however short the chunk

  FlashML-org/FreeToken#579 · Filter by author YevheniiKotyrlo opened on Sep 30, 2026

• On Windows the engine sizes its pools as if no other process held any of the card

  windows
  FlashML-org/FreeToken#570 · Filter by author YevheniiKotyrlo opened on Sep 29, 2026

• A hybrid model's cached prefix cannot be resumed far back: no GDN snapshot survives below a prompt's last chunk

  windows
  FlashML-org/FreeToken#569 · Filter by author YevheniiKotyrlo opened on Sep 29, 2026

• Serving Qwen3.8-Flash-Next's 1M-token window on one 24 GB card

  FlashML-org/FreeToken#568 · Filter by author YevheniiKotyrlo opened on Sep 29, 2026

• A stream that is silent through a long prefill is dropped by Node clients and prefilled for nobody

  windows
  FlashML-org/FreeToken#567 · Filter by author YevheniiKotyrlo opened on Sep 29, 2026

• Bug: AssertionError: Not enough memory for KV cache when serving Qwen3.8-27B-NVFP4 on Windows

  bugwindows
  FlashML-org/FreeToken#561 · Filter by author hulonghe opened on Sep 28, 2026
  2

• Feature: --api-key flag for serve mode (token auth on the HTTP API)

  FlashML-org/FreeToken#557 · Filter by author santanu20 opened on Sep 27, 2026

• [Feature] Cumulative prefill/decode seconds on /v1/stats so pollers can compute speeds

  FlashML-org/FreeToken#552 · Filter by author mgeldi opened on Sep 25, 2026

• Qwen3.8-Flash-Next-GSQ-RCO-GGUF not loading.

  buglinux
  FlashML-org/FreeToken#549 · Filter by author DarkReaperBoy opened on Sep 25, 2026
  1

• Show model sampling defaults and allow per-request overrides in the Windows client

  Desktopfeature
  FlashML-org/FreeToken#547 · Filter by author dai-ych opened on Sep 24, 2026
  1

• Backend supervisor: TypeError: unsupported operand type(s) for /: 'WindowsPath' and 'NoneType'

  bugDesktopwindows
  FlashML-org/FreeToken#542 · Filter by author zhanglt opened on Sep 23, 2026
  1

• AMD Roadmap 2026 Q4-2027 Q1

  amdfeature
  FlashML-org/FreeToken#541 · Filter by author zihaomu opened on Sep 23, 2026

• [Desktop] weights failed to load: Gemma-4-26B-A4B NVFP4

  bugwindows
  FlashML-org/FreeToken#540 · Filter by author LPT-S opened on Sep 23, 2026
  1

• [Desktop] weights failed to load: Gemma-4-26B-A4B NVFP4

  bugwindows
  FlashML-org/FreeToken#539 · Filter by author yun201720 opened on Sep 23, 2026
  2

• RTX 3090 device loss (Xid 79) at --max-prefill-length 8192 in offload mode — known limitation, or host-specific?

  buglinux
  FlashML-org/FreeToken#538 · Filter by author kngharv opened on Sep 22, 2026
  3

• /health endpoint returns status 200 when model is not yet loaded

  buglinux
  FlashML-org/FreeToken#537 · Filter by author cphlipot opened on Sep 22, 2026
  5

• Please consider adding support for XiaomiMiMo/MiMo-V2.6-Flash-RL

  new-model
  FlashML-org/FreeToken#536 · Filter by author alambayana opened on Sep 22, 2026

• FP8 block-quantized MoE models have no usable kernel under moe_strategy=offload (0.1.3)

  bugDesktophigh prioritywindows
  FlashML-org/FreeToken#534 · Filter by author tielemao opened on Sep 22, 2026
  4

• [Desktop] weights failed to load: Qwen3.8-Flash-Next NVFP4

  bugwindows
  FlashML-org/FreeToken#533 · Filter by author Ramachandrajoshi opened on Sep 22, 2026
  3