RAIL: Rethinking Auditory Intelligence in Large Audio-Language Models with a CHC-Grounded

Six LALMs exceed human performance in general, while auditory processing all lags behind human. It comes from a paper posted to arXiv on 14 October 2026. Humans process rich auditory environments through various cognitive capabilities such as audio perception, audio reasoning and memory. Despite recent progress in large audio-language models (LALMs), current evaluation remains largely task- or domain-centric, focusing on end performance while ignoring underlying auditory cognitive behaviors. This gap between how auditory cognition is understood in humans and how it is evaluated in LALMs hinders the interpretation of model behaviour in underlying capabilities and limits alignment with human auditory objectives. We introduce RAIL, a human-centric benchmark grounded in the Cattell--Horn--Carroll (CHC) framework, which formalises auditory cognition into five core capabilities, and develops them into structured evaluation tasks with principled data curation and human-aligned evaluation protocols. Evaluating 26 LALMs reveals strong performance in knowledge-related tasks but weak auditory perception and memory, reflecting reliance on language-based pretraining. Limited reasoning under auditory settings further suggests a mismatch between existing training paradigms and human-like auditory reasoning, as well as over-reasoning at the cost of efficiency. Overall, RAIL establishes a new framework for human-aligned evaluation of auditory intelligence.

Why it counts

Six LALMs exceed human performance in general, while auditory processing all lags behind human.

Sources

Primary source: primary source

What is not known

This brief does not claim independent replication. Claims that appear only on X and not in the primary source stay unknown.