The 2nd Clarity Prediction Challenge: A Machine Learning Challenge for Hearing Aid Intelligibility Prediction

Barker, Jon; Akeroyd, Michael A.; Bailey, Will; Cox, Trevor J.; Culling, John F.; Firth, Jennifer; Graetzer, Simone; Naylor, Graham

Abstract

This paper reports on the design and outcomes of the 2nd Clarity Prediction Challenge (CPC2) for predicting the intelligibility of hearing aid processed signals heard by individuals with a hearing impairment. The challenge was designed to promote new approaches for estimating the intelligibility of hearing aid signals that can be used in future hearing aid algorithm development. It extends an earlier round (CPC1, 2022) in a number of critical directions, including a larger dataset coming from new speech intelligibility listening experiments, a greater degree of variability in the test materials, and a design that requires prediction systems to generalise to unseen algorithms and listeners. This paper provides a full description of the new publicly available CPC2 dataset, the CPC2 challenge design, and the baseline systems. The challenge attracted 12 systems from 9 research teams. The systems are reviewed, their performance is analysed and conclusions are presented, with reference to the progress made since the earlier CPC1 challenge. In particular, it is seen how reference-free, non-intrusive systems based on pre-trained large acoustic models can perform well in this context.

• Presentation Conference Type: Conference Paper (published)
• Conference Name: 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
• Start Date: Apr 14, 2024
• End Date: Apr 19, 2024
• Acceptance Date: Dec 13, 2023
• Publication Date: Apr 14, 2024
• Deposit Date: Apr 30, 2024
• Publicly Available Date: Apr 30, 2024
• Publisher: Institute of Electrical and Electronics Engineers
• DOI: https://doi.org/10.1109/icassp48485.2024.10446441