Evaluating the predictions of objective intelligibility metrics for modified and synthetic speech

Tang, Y, Cooke, M and Valentini-Botinhao, C 2015, 'Evaluating the predictions of objective intelligibility metrics for modified and synthetic speech' , Computer Speech & Language, 35 , pp. 73-92.

[img] PDF - Published Version
Restricted to Repository staff only

Download (1MB)


Several modification algorithms that alter natural or synthetic speech with the goal of improving intelligibility in noise have been proposed recently. A key requirement of many modification techniques is the ability to predict intelligibility, both offline during algorithm development, and online, in order to determine the optimal modification for the current noise context. While existing objective intelligibility metrics (OIMs) have good predictive power for unmodified natural speech in stationary and fluctuating noise, little is known about their effectiveness for other forms of speech. The current study evaluated how well seven OIMs predict listener responses in three large datasets of modified and synthetic speech which together represent 396 combinations of speech modification, masker type and signal-to-noise ratio. The chief finding is a clear reduction in predictive power for most OIMs when faced with modified and synthetic speech. Modifications introducing durational changes are particularly harmful to intelligibility predictors. OIMs that measure masked audibility tend to over-estimate intelligibility in the presence of fluctuating maskers relative to stationary maskers, while OIMs that estimate the distortion caused by the masker to a clean speech prototype exhibit the reverse pattern.

Item Type: Article
Schools: Schools > School of Computing, Science and Engineering
Journal or Publication Title: Computer Speech & Language
Publisher: Elsevier
ISSN: 0885-2308
Related URLs:
Funders: EU
Depositing User: Y Tang
Date Deposited: 23 Nov 2015 15:31
Last Modified: 15 Feb 2022 19:55
URI: https://usir.salford.ac.uk/id/eprint/37103

Actions (login required)

Edit record (repository staff only) Edit record (repository staff only)


Downloads per month over past year