ds4 flash 0731 UD-IQ2_M wrote a custom metal kernal for kimi k2 IQ1_0 in about 50 minutes
retained text
<!-- SC_OFF --><div class="md"><p>as a programming ignoramus this kind of thing seems extremely impressive to me... maybe others can shed light on whether this is expected from this level model at q2.</p> <p>DS4 IQ2_M just spent about 50 minutes writing a custom metal kernel after it could not find one on github for unsloth's IQ1_0 Kimi k3 quant for my mac studio 512 gb.</p> <p>Performance is meh but much better than cpu. About 4 t/s decode and 20 prefill for k3 Q1_0 (mac studio 512gb)</p> <p>I've also run 0731 on mlx at 8 and 4 bits... the 2 bit unsloth seems within common sampling settings-level margin of error across these quants for my tasks. Runs at about 1k prefill and 50 decode on 1x rtx pro 6000 via lm studio.</p> <p>I still find 4 bit glm 5.2 better but it's kinda close. Crazy for a 90 gb file.</p> </div><!-- SC_ON -->   submitted by   <a href="https://www.reddit.com/user/technaturalism"> /u/technaturalism </a> <br /> <span><a href="https://www.reddit.com/r/LocalLLaMA/comments/1vje00y/ds4_flash_0731_udiq2_m_wrote_a_custom_metal/">[link]</a></span>   <span><a href="https://www.reddit.com/r/LocalLLaMA/comments/1vje00y/ds4_flash_0731_udiq2_m_wrote_a_custom_metal/">[comments]</a></span>
document fetched 2026-08-09 07:00 · canonical https://reddit.com/r/LocalLLaMA/comments/1vje00y/ds4_flash_0731_udiq2_m_wrote_a_custom_metal