Skip to content
8BitsForgeContact

Lab Notes6 field reports

All Lab Notes

Tag archive

#mtp

MTP · 2 field reports

Filed under Local AI (2). All tags.

Chronological feed

  1. Local AI · 10 min read

    Squeezing Qwen3.8 Until It Cried: A 46.9% Speedup and One Optimization Too Far

    A 46.9% Qwen3.8 speedup, a production qualification, and the tempting 64K shortcut that failed when the benchmark got serious.

    Promote the full-vocabulary checkpoint: 46.88% faster decode, qualified behavior, and no support for the later 64K shortcut.

  2. Local AI · 8 min read

    How ubatch=1024 Won the Benchmark and Lost the Ability to Speak

    A 6% prefill improvement, five failed conversations, and one tiny silicon cult chanting the unused32 token.

    Rejected — the narrow prefill win concealed catastrophic generation and tool-call failures.