Fact · Accessibility and health
0.74Spearman rho
In a 2017 study of 30 deaf and hard of hearing users, the authors' new caption metric, ACE, correlated 0.74 (Spearman rho) with their ratings of caption usability.
Checked against its source on October 16, 2026
In the source's own words
“The correlation coefficient was found to be rho = 0.742791 with a p-value <0.0001.”
Evaluating the Usability of Automatically Generated Captions for People who are Deaf or Hard of Hearing, Sushant Kafle and Matt Huenerfauth, ASSETS 2017, ACM SIGACCESS Conference on Computers and Accessibility, 2017, Results, hypothesis H2a.
Open the original- What it measures
- Participants compared pairs of automatic caption texts that had the same word error rate, so the metric was the only difference between the pairs.
- What it does not show
- A research metric, not a feature of any app. The study used 30 users and one set of caption texts from a 2017 recognizer.