Caption quality metric
Also known as: ACE metric, Caption evaluation metric
A measure designed to predict how understandable automatically generated captions are for Deaf and Hard-of-Hearing users, as an alternative to standard Word Error Rate which correlates poorly with actual DHH comprehension. The Automatic Caption Evaluation (ACE) metric combines word-importance scoring (how critical a misrecognized word is to sentence meaning) with semantic distance scoring (how different the error is from the intended word) and error-spread modelling (how one error degrades comprehension of surrounding words).
Category: evaluation · deaf and hard of hearing · speech recognition
Related: Word error rate · Automatic speech recognition · Captioning · CART