Skip to content

Contributor questions: DFlash2 draft training data, checkpoint contributions, and which open work to review #714

Open

Description

@linson007

Hi — I'm a contributor with no merge rights, working on Qwen3.8-27B decode speed on an M5 Pro (20-core GPU, 48 GiB). I have several open drafts and research issues, but I'd like to stop adding to the pile and aim at what you would actually review. Five short questions; one-line answers are plenty.

Where my measurements stand (details in #542, #543, #590):

Questions:

  1. Draft training: Is the corpus and recipe behind the released incoai/Qwen3.8-27B-DFlash2 checkpoint available, or at least its data mix and objective? If not, would you accept a retrained draft from a contributor, and if so what evidence (held-out emitted tokens per cycle, greedy output unchanged)?
  2. Checkpoint delivery: If a better draft comes out of this, how should it be shipped? A model repo under a contributor account, or something you host?
  3. Evidence standard: Wall-clock A/B runs on a laptop are noisy for me (thermal and power events). Would you accept emitted tokens per cycle and GPU ms per cycle from the existing counters as the primary evidence, with wall tok/s as confirmation?
  4. Tree verifier: A 16-row tree verifier gave +12% (known prompts) and +7% (independent prompts) in cold-request tests, but ordinary and shader lifecycle runs differ from the unchanged build. Is a greedy "every committed token equals the raw target argmax" certificate plus a distribution check an acceptable correctness bar, or do you require identical text to the current build?
  5. Review capacity: I have many drafts open (listed in Qwen3.8-27B on a 48 GiB M5 Pro: reproducible inference measurements and tuning results #580 and Investigate deployment-aware DFlash2 selector training before increasing draft capacity #542). Which one or two would you actually review? I'll close or park the rest and keep one active at a time.

Thank you.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions