Tag: evaluation
All the articles with the tag "evaluation".
Speech Recognition Models Repeated Numbers That Researchers Had Removed From the Audio
Researchers silenced numbers in public benchmark recordings, but several speech recognition models still returned the exact values. The audit asks whether some models learned the answer keys.
People Preferred Gemini's Voice Agent Even Though Other Models Completed More Tasks
In Artificial Analysis's 2026 Speech Agent Arena, Gemini 3.1 Flash Live led user preference with 74.6% task success, while less-preferred rivals reached 89.4% and 94.7%.
An AI Voice Agent Said It Changed a Customer's Address Even Though the Database Never Updated
In a 278-task test, voice agents completed 26% to 51% of customer-service work, and one agent confirmed an address change without making the required tool call.