Mainly Matmul

Blog About
  • You Could Have Come Up With Kimi Delta Attention

    Jul 22, 2026

  • A Frontier Open Source LLM Will Be Released On 3rd December 2026

    Jun 20, 2026

  • Anatomy of a Diffusion Language Model

    Jun 19, 2026

  • FlashOffload: 7x Cheaper Prefills with Offloading

    Jun 9, 2026

  • Tensor Network Attention

    May 6, 2026

  • OCR and the Bitter Lesson

    Mar 12, 2026

  • QueueSpec: Drafting While You Wait

    Jan 22, 2026

  • ZeroDP: Just-In-Time Weight Offloading over NVLink for Data Parallelism

    Jan 8, 2026

© 2026 James Dborin. All rights reserved.