Pronunciation modelling and bootstrapping

Bootstrapping techniques have the potential to accelerate the development of language technology resources. This is of specific importance in the developing world where language technology resources are scarce and linguistic diversity is high. In this thesis we analyse the pronunciation modelling ta...

Full description

Bibliographic Details
Main Author: Davel, Marelie Hattingh
Other Authors: Prof E Barnard
Published: 2013
Subjects:
Online Access:http://hdl.handle.net/2263/28611
Davel, M 2005, Pronunciation modelling and bootstrapping, PhD thesis, University of Pretoria, Pretoria, viewed yymmdd < http://hdl.handle.net/2263/28611 >
http://upetd.up.ac.za/thesis/available/etd-10112005-150530/
id ndltd-netd.ac.za-oai-union.ndltd.org-up-oai-repository.up.ac.za-2263-28611
record_format oai_dc
spelling ndltd-netd.ac.za-oai-union.ndltd.org-up-oai-repository.up.ac.za-2263-286112017-07-20T04:11:31Z Pronunciation modelling and bootstrapping Davel, Marelie Hattingh Prof E Barnard mdavel@csir.co.za Grapheme-to-phoneme conversion Grapheme-to-phoneme alignment Bootstrapping UCTD Bootstrapping techniques have the potential to accelerate the development of language technology resources. This is of specific importance in the developing world where language technology resources are scarce and linguistic diversity is high. In this thesis we analyse the pronunciation modelling task within a bootstrapping framework, as a case study in the bootstrapping of language technology resources. We analyse the grapheme-to-phoneme conversion task in the search for a grapheme-to-phoneme conversion algorithm that can be utilised during bootstrapping. We experiment with enhancements to the Dynamically Expanding Context algorithm and develop a new algorithm for grapheme-tophoneme rule extraction (Default & Refine) that utilises the concept of a ‘default phoneme’ to create a cascade of increasingly specialised rules. This algorithm displays a number of attractive properties including rapid learning, language independence, good asymptotic accuracy, robustness to noise, and the production of a compact rule set. In order to have greater flexibility with regard to the various heuristic choices made during rewrite rule extraction, we define a new theoretical framework for analysing instance-based learning of rewrite rule sets. We define the concept of minimal representation graphs, and discuss the utility of these graphs in obtaining the smallest possible rule set describing a given set of discrete training data. We develop an approach for the interactive creation of pronunciation models via bootstrapping, and implement this approach in a system that integrates various of the analysed grapheme-to-phoneme alignment and conversion algorithms. The focus of this work is on combining machine learning and human intervention in such a way as to minimise the amount of human effort required during bootstrapping, and a generic framework for the analysis of this process is defined. Practical tools that support the bootstrapping process are developed and the efficiency of the process is analysed from both a machine learning and a human factors perspective. We find that even linguistically untrained users can use the system to create electronic pronunciation dictionaries accurately, in a fraction of the time the traditional approach requires. We create new dictionaries in a number of languages (isiZulu, Afrikaans and Sepedi) and demonstrate the utility of these dictionaries by incorporating them in speech technology systems. Thesis (PhD (Electronic Engineering))--University of Pretoria, 2006. Electrical, Electronic and Computer Engineering unrestricted 2013-09-07T13:49:04Z 2005-10-11 2013-09-07T13:49:04Z 2005-08-01 2006-10-11 2005-10-11 Thesis http://hdl.handle.net/2263/28611 Davel, M 2005, Pronunciation modelling and bootstrapping, PhD thesis, University of Pretoria, Pretoria, viewed yymmdd < http://hdl.handle.net/2263/28611 > http://upetd.up.ac.za/thesis/available/etd-10112005-150530/ © 2005, University of Pretoria. All rights reserved. The copyright in this work vests in the University of Pretoria. No part of this work may be reproduced or transmitted in any form or by any means, without the prior written permission of the University of Pretoria.
collection NDLTD
sources NDLTD
topic Grapheme-to-phoneme conversion
Grapheme-to-phoneme alignment
Bootstrapping
UCTD
spellingShingle Grapheme-to-phoneme conversion
Grapheme-to-phoneme alignment
Bootstrapping
UCTD
Davel, Marelie Hattingh
Pronunciation modelling and bootstrapping
description Bootstrapping techniques have the potential to accelerate the development of language technology resources. This is of specific importance in the developing world where language technology resources are scarce and linguistic diversity is high. In this thesis we analyse the pronunciation modelling task within a bootstrapping framework, as a case study in the bootstrapping of language technology resources. We analyse the grapheme-to-phoneme conversion task in the search for a grapheme-to-phoneme conversion algorithm that can be utilised during bootstrapping. We experiment with enhancements to the Dynamically Expanding Context algorithm and develop a new algorithm for grapheme-tophoneme rule extraction (Default & Refine) that utilises the concept of a ‘default phoneme’ to create a cascade of increasingly specialised rules. This algorithm displays a number of attractive properties including rapid learning, language independence, good asymptotic accuracy, robustness to noise, and the production of a compact rule set. In order to have greater flexibility with regard to the various heuristic choices made during rewrite rule extraction, we define a new theoretical framework for analysing instance-based learning of rewrite rule sets. We define the concept of minimal representation graphs, and discuss the utility of these graphs in obtaining the smallest possible rule set describing a given set of discrete training data. We develop an approach for the interactive creation of pronunciation models via bootstrapping, and implement this approach in a system that integrates various of the analysed grapheme-to-phoneme alignment and conversion algorithms. The focus of this work is on combining machine learning and human intervention in such a way as to minimise the amount of human effort required during bootstrapping, and a generic framework for the analysis of this process is defined. Practical tools that support the bootstrapping process are developed and the efficiency of the process is analysed from both a machine learning and a human factors perspective. We find that even linguistically untrained users can use the system to create electronic pronunciation dictionaries accurately, in a fraction of the time the traditional approach requires. We create new dictionaries in a number of languages (isiZulu, Afrikaans and Sepedi) and demonstrate the utility of these dictionaries by incorporating them in speech technology systems. === Thesis (PhD (Electronic Engineering))--University of Pretoria, 2006. === Electrical, Electronic and Computer Engineering === unrestricted
author2 Prof E Barnard
author_facet Prof E Barnard
Davel, Marelie Hattingh
author Davel, Marelie Hattingh
author_sort Davel, Marelie Hattingh
title Pronunciation modelling and bootstrapping
title_short Pronunciation modelling and bootstrapping
title_full Pronunciation modelling and bootstrapping
title_fullStr Pronunciation modelling and bootstrapping
title_full_unstemmed Pronunciation modelling and bootstrapping
title_sort pronunciation modelling and bootstrapping
publishDate 2013
url http://hdl.handle.net/2263/28611
Davel, M 2005, Pronunciation modelling and bootstrapping, PhD thesis, University of Pretoria, Pretoria, viewed yymmdd < http://hdl.handle.net/2263/28611 >
http://upetd.up.ac.za/thesis/available/etd-10112005-150530/
work_keys_str_mv AT davelmareliehattingh pronunciationmodellingandbootstrapping
_version_ 1718498998511206400