The Apple-Meta MLX Collaboration
Apple rewrote its MLX framework specifically so Muse Spark Open's 816 billion parameter weights can be split across two Mac Studios with M5 Ultra chips, pooling a full terabyte of unified memory (512GB per machine) and 1.2 TB/s of bandwidth per machine into what behaves like a single system[1]. An Apple executive called it 'amazing to run a model of Muse Spark Open's caliber and scale this efficiently, right from your desk'[2]. The move signals that on-device inference for frontier-scale open models is now a joint engineering problem for chipmakers and model labs, not just a software afterthought, even if, as later sections cover, almost no individual actually owns the hardware needed to use it.


