Imperial College London

Dr Dan Goodman

Faculty of EngineeringDepartment of Electrical and Electronic Engineering

Senior Lecturer
 
 
 
//

Contact

 

+44 (0)20 7594 6264d.goodman Website

 
 
//

Location

 

1001Electrical EngineeringSouth Kensington Campus

//

Summary

 

Publications

Citation

BibTex format

@article{Weerts:2021:10.1101/2021.04.19.440438,
author = {Weerts, L and Rosen, S and Clopath, C and Goodman, DFM},
doi = {10.1101/2021.04.19.440438},
title = {The Psychometrics of Automatic Speech Recognition},
url = {http://dx.doi.org/10.1101/2021.04.19.440438},
year = {2021}
}

RIS format (EndNote, RefMan)

TY  - JOUR
AB - <jats:p>Deep neural networks have had considerable success in neuroscience as models of the visual system, and recent work has suggested this may also extend to the auditory system. We tested the behaviour of a range of state of the art deep learning-based automatic speech recognition systems on a wide collection of manipulated sounds used in standard human psychometric experiments. While some systems showed qualitative agreement with humans in certain tests, in others all tested systems diverged markedly from humans. In particular, all systems used spectral invariance, temporal fine structure and speech periodicity differently from humans. We conclude that despite some promising results, none of the tested automatic speech recognition systems can yet act as a strong proxy for human speech recognition. However, we note that the more recent systems with better performance also tend to better match human results, suggesting that continued cross-fertilisation of ideas between human and automatic speech recognition may be fruitful. Our open source toolbox allows researchers to assess future automatic speech recognition systems or add additional psychoacoustic measures.</jats:p>
AU - Weerts,L
AU - Rosen,S
AU - Clopath,C
AU - Goodman,DFM
DO - 10.1101/2021.04.19.440438
PY - 2021///
TI - The Psychometrics of Automatic Speech Recognition
UR - http://dx.doi.org/10.1101/2021.04.19.440438
ER -