-
Notifications
You must be signed in to change notification settings - Fork 998
Pull requests: FlashML-org/FreeToken
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
qwen4_exp: load modelopt MIXED_PRECISION (NVFP4 experts + block-FP8 dense) checkpoints
#320
opened Sep 1, 2026 by
gberasmus87
Loading…
fix(rocm): avoid indirect host pointers during HIP graph capture
#316
opened Sep 1, 2026 by
ErikBPF
Loading…
feat(qwen4_exp): stream the PLE n-gram table from disk
#311
opened Aug 31, 2026 by
jason-fxz
Collaborator
Loading…
feat: Automatic KV/MoE Laddering for decode speed vs context-length trade off ( upto 33% faster decode )
#300
opened Aug 30, 2026 by
aswinkumar1999
Loading…
Support poolside/Laguna-S-2.1-NVFP4, and fix serving from source on Windows
#298
opened Aug 30, 2026 by
Eng-Ahmd
Loading…
feat(qwen3_5_moe): support compressed-tensors NVFP4 experts with block-fp8 dense side
#296
opened Aug 30, 2026 by
JIAQI13
Loading…
fix(qwen3_5_moe): detect shared-expert quant for modelopt mixed checkpoints
#294
opened Aug 30, 2026 by
JIAQI13
Loading…
2
fix(scheduler): hybrid radix hit corruption — GDN snapshot copy-on-donate + admission barriers
#287
opened Aug 30, 2026 by
Cerynitius
Loading…
fix(models): load NVFP4 expert banks from checkpoints without a safetensors index
#283
opened Aug 30, 2026 by
paulp83
Loading…
fix(moe): match the benchbw verdict to the served model's expert size
#278
opened Aug 29, 2026 by
bernimccoy
Contributor
Loading…
fix: [BUG] qwen3_5 dense: mixed-precision NVFP4 crashes in ct_bf16_fuse (Float8 × BFloat16 promotion)
#275
opened Aug 29, 2026 by
yuyi2439
Loading…
glm5_next: support GLM-5.3-Flash (hybrid KDA + DSA, mHC, NVFP4 expert offload)
#270
opened Aug 29, 2026 by
Cerynitius
Loading…
fix(server): report why a tokenizer/detokenizer worker died during load
#269
opened Aug 29, 2026 by
sime2408
Loading…
feat(kvcache): sub-byte Q4_0 and Q6_0 KV cache quantization
#268
opened Aug 29, 2026 by
fangyuan-3149
Loading…
fix(server): hide qwen transport markers from semantic responses
#266
opened Aug 29, 2026 by
HaileyStorm
Loading…
Previous Next
ProTip!
Updated in the last three days: updated:>2026-08-29.