Evaluation of Lombard Speech Models in the Context of Speech in Noise Enhancement
The Lombard effect is one of the most well-known effects of noise on speech production. Speech with the Lombard effect is more easily recognizable in noisy environments than normal natural speech. Our previous investigations showed that speech synthesis models might retain Lombard-effect characteris...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2020-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9163113/ |
id |
doaj-567a48de021841839a724266c7503e01 |
---|---|
record_format |
Article |
spelling |
doaj-567a48de021841839a724266c7503e012021-03-30T03:54:02ZengIEEEIEEE Access2169-35362020-01-01815515615517010.1109/ACCESS.2020.30154219163113Evaluation of Lombard Speech Models in the Context of Speech in Noise EnhancementGrazina Korvel0Krzysztof Kakol1Olga Kurasova2https://orcid.org/0000-0002-0570-1741Bozena Kostek3https://orcid.org/0000-0001-6288-2908Institute of Data Science and Digital Technologies, Vilnius University, Vilnius, LithuaniaAudio Acoustics Laboratory, Faculty of Electronics, Telecommunications and Informatics, Gdańsk University of Technology, Gdańsk, PolandInstitute of Data Science and Digital Technologies, Vilnius University, Vilnius, LithuaniaAudio Acoustics Laboratory, Faculty of Electronics, Telecommunications and Informatics, Gdańsk University of Technology, Gdańsk, PolandThe Lombard effect is one of the most well-known effects of noise on speech production. Speech with the Lombard effect is more easily recognizable in noisy environments than normal natural speech. Our previous investigations showed that speech synthesis models might retain Lombard-effect characteristics. In this study, we investigate several speech models, such as harmonic, source-filter, and sinusoidal, applied to Lombard speech in the context of speech enhancement. For this purpose, 100 utterances of natural speech, and 100 with the Lombard effect induced are used. The goal of this study is to check to what extent speech utterances based on these models are recognizable and at what SNR (Signal-to-Noise Ratio) level threshold a particular model stops working. For this purpose, the synthesized models and Lombard speech are mixed with babble speech and street noise recordings with different SNRs. The quality of these models is measured, employing objective indicators as well as subjective tests. Since there is no standardized measure to apply to enhanced speech, an objective measure of assessing the speech quality of a model synthesizing Lombard speech characteristics, based on a feature vector, is proposed. Our approach is then compared with the standardized metric used in telecommunications as well as with subjective test results. The experimental investigations show the superiority of the source-filter models applied to synthesize Lombard speech over other models utilized. Also, the measure proposed correlates more closely with the results of the subjective evaluation than the outcomes from the ITU-T P.563 recommendation. This was checked with a ANOVA statistical analysis.https://ieeexplore.ieee.org/document/9163113/Lombard speechquality of experiencespeech modeling techniques |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Grazina Korvel Krzysztof Kakol Olga Kurasova Bozena Kostek |
spellingShingle |
Grazina Korvel Krzysztof Kakol Olga Kurasova Bozena Kostek Evaluation of Lombard Speech Models in the Context of Speech in Noise Enhancement IEEE Access Lombard speech quality of experience speech modeling techniques |
author_facet |
Grazina Korvel Krzysztof Kakol Olga Kurasova Bozena Kostek |
author_sort |
Grazina Korvel |
title |
Evaluation of Lombard Speech Models in the Context of Speech in Noise Enhancement |
title_short |
Evaluation of Lombard Speech Models in the Context of Speech in Noise Enhancement |
title_full |
Evaluation of Lombard Speech Models in the Context of Speech in Noise Enhancement |
title_fullStr |
Evaluation of Lombard Speech Models in the Context of Speech in Noise Enhancement |
title_full_unstemmed |
Evaluation of Lombard Speech Models in the Context of Speech in Noise Enhancement |
title_sort |
evaluation of lombard speech models in the context of speech in noise enhancement |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2020-01-01 |
description |
The Lombard effect is one of the most well-known effects of noise on speech production. Speech with the Lombard effect is more easily recognizable in noisy environments than normal natural speech. Our previous investigations showed that speech synthesis models might retain Lombard-effect characteristics. In this study, we investigate several speech models, such as harmonic, source-filter, and sinusoidal, applied to Lombard speech in the context of speech enhancement. For this purpose, 100 utterances of natural speech, and 100 with the Lombard effect induced are used. The goal of this study is to check to what extent speech utterances based on these models are recognizable and at what SNR (Signal-to-Noise Ratio) level threshold a particular model stops working. For this purpose, the synthesized models and Lombard speech are mixed with babble speech and street noise recordings with different SNRs. The quality of these models is measured, employing objective indicators as well as subjective tests. Since there is no standardized measure to apply to enhanced speech, an objective measure of assessing the speech quality of a model synthesizing Lombard speech characteristics, based on a feature vector, is proposed. Our approach is then compared with the standardized metric used in telecommunications as well as with subjective test results. The experimental investigations show the superiority of the source-filter models applied to synthesize Lombard speech over other models utilized. Also, the measure proposed correlates more closely with the results of the subjective evaluation than the outcomes from the ITU-T P.563 recommendation. This was checked with a ANOVA statistical analysis. |
topic |
Lombard speech quality of experience speech modeling techniques |
url |
https://ieeexplore.ieee.org/document/9163113/ |
work_keys_str_mv |
AT grazinakorvel evaluationoflombardspeechmodelsinthecontextofspeechinnoiseenhancement AT krzysztofkakol evaluationoflombardspeechmodelsinthecontextofspeechinnoiseenhancement AT olgakurasova evaluationoflombardspeechmodelsinthecontextofspeechinnoiseenhancement AT bozenakostek evaluationoflombardspeechmodelsinthecontextofspeechinnoiseenhancement |
_version_ |
1724182622857330688 |