You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Contributor questions: DFlash2 draft training data, checkpoint contributions, and which open work to review #714
Hi — I'm a contributor with no merge rights, working on Qwen3.8-27B decode speed on an M5 Pro (20-core GPU, 48 GiB). I have several open drafts and research issues, but I'd like to stop adding to the pile and aim at what you would actually review. Five short questions; one-line answers are plenty.
Where my measurements stand (details in #542, #543, #590):
Decode looks bandwidth-bound: GPU time per cycle is about 72 ms at one lane and about 88 ms at four lanes, so weights are streamed once and shared.
Kernel and tile micro-experiments gave 0–3% or regressed.
Draft training: Is the corpus and recipe behind the released incoai/Qwen3.8-27B-DFlash2 checkpoint available, or at least its data mix and objective? If not, would you accept a retrained draft from a contributor, and if so what evidence (held-out emitted tokens per cycle, greedy output unchanged)?
Checkpoint delivery: If a better draft comes out of this, how should it be shipped? A model repo under a contributor account, or something you host?
Evidence standard: Wall-clock A/B runs on a laptop are noisy for me (thermal and power events). Would you accept emitted tokens per cycle and GPU ms per cycle from the existing counters as the primary evidence, with wall tok/s as confirmation?
Tree verifier: A 16-row tree verifier gave +12% (known prompts) and +7% (independent prompts) in cold-request tests, but ordinary and shader lifecycle runs differ from the unchanged build. Is a greedy "every committed token equals the raw target argmax" certificate plus a distribution check an acceptable correctness bar, or do you require identical text to the current build?
Activity