评估尺度相关最佳化方法於华语错误发音检测之研究.PDFVIP

Computational Linguistics and Chinese Language Processing Vol. 21, No. 2, December 2016, pp. 55-70 55 ? The Association for Computational Linguistics and Chinese Language Processing 評估尺度相關最佳化方法於華語錯誤發音檢測之研究 Evaluation Metric-related Optimization Methods for Mandarin Mispronunciation Detection 許曜麒?、楊明翰?、洪孝宗?、林奕儒?、陳冠宇?、陳柏琳? Yao-Chi Hsu, Ming-Han Yang, Hsiao-Tsung Hung, Yi-Ju Lin, Kuan-Yu Chen and Berlin Chen 摘要 錯誤發音檢測(Mispronunciation Detection)與錯誤發音診斷(Mispronunciation Diagnosis)為電腦輔助發音訓練系統的一部分，它們能輔助第二外語學習者準 確地找出語句中錯誤發音的部位以增進學習者的口說熟練度。本論文延續過去 學者的研究，大致可將貢獻分為三點：1) 比較不同的發音分數做為錯誤發音 檢測的評估依據，並探討對於錯誤發音檢測效能的影響；2) 我們透過最佳化 評估尺度相關訓練法則估測深層類神經網路聲學模型的參數以及發音檢測決 策函數之參數；3) 使用 F1 度量作為目標函數時，若將二類的 F1 度量線性組合 並調整權重，可有效處理資料類別不平衡的問題。一系列的實驗將建立在華語 錯誤發音檢測與診斷任務，從實驗中可以觀察到我們提出的方法之優點。 關鍵詞：電腦輔助發音訓練、錯誤發音檢測、自動語音辨識、鑑別式訓練與深 層類神經網路。 ?????????????????????????????????????????????????????? ?國立台灣師範大學資訊工程學系 Department of Computer Science Information Engineering, National Taiwan Normal University E-mail: {ychsu, mh_yang, alexhung, lin_yj, berlin}@ntnu.edu.tw ?中央研究院資訊科學所 Institute of Information Science, Academia Sinica E-mail: kychen@iis.sinica.edu.tw 56 許曜麒 等 Abstract Mispronunciation detection and diagnosis are part and parcel of a computer assisted pronunciation training (CAPT) system, collectively facilitating second-language (L2) learners to pinpoint erroneous pronunciations in a given utterance so as to improve their spoken proficiency. This thesis presents a continuation of such a general line of research and the major contributions are three-fold. First, we compared the performance of different pronunciation features in mispronunciation detection. Second, we propose an effective training approach that estimates the deep neural network based acoustic models involved in the mispronunciation detection process by optimizing an objective directly linked to the ultimate