The Benchmark Claim That Doesn't Fully Hold Up
Microsoft is marketing MAI-Transcribe-2-Streaming as the most accurate real-time transcription model on the market, citing a #1 ranking out of 38 models on Artificial Analysis's AA-WER Streaming leaderboard - 2.5% final word-error rate, 2.8% first-partial, with partial hypotheses showing up roughly 100 milliseconds after audio arrives [1][2]. That ranking is real and independently measured [3]. But the same benchmark's own published comparison complicates the picture: on its price-final metric, ElevenLabs' Scribe v2 Realtime comes in at $6.50 with a 3.6% WER and 0.14-second latency, beating Microsoft on specific sub-metrics even as Microsoft wins the headline ranking [3]. A separate report, using the shorter label 'MAI-Transcribe-2,' cites a $0.10-per-hour price and claims about beating OpenAI, Google, and ElevenLabs on speed that don't reconcile with the $0.54-per-hour figure cited elsewhere [4]- likely a different SKU or a later price change, but a reminder to check the primary benchmark data rather than the press-release summary.



