General Framework for Acoustic Modeling

CrossWord of AM training

Building ASR system incrementally:

Context-independent ➔ Context-dependent modeling
Mono-phone ➔ Tri-phone HMM
Single Gaussian mixture per state ➔ Multiple Gaussian mixtures per state

Context-independent Modeling   上下文无关建模

CrossWord of AM training


Flowchart for Crossword Modeling:

CrossWord of AM trainingCrossWord of AM training


Forced Alignment:

CrossWord of AM training

CrossWord of AM training

Input:
Word level transcription  词汇转录
Lexicon/Dictionary        词汇、字典
Multiple pronunciations   多重发音
Z. (z eh d vs. z iy)
HMMs

Output:
Phoneme level transcription of actual pronunciation with time boundary 具有时间边界的实际发音转换


To deal with the issue of imprecise transcription     处理不精确转录的问题最初,

Initially HMMs are trained on the basis of one fixed pronunciation per word   HMM是根据每个单词一个固定的发音进行训练的

To determine the actual pronunciations in the utterances used to train the HMM system 确定用于训练HMM系统的话语中的实际发音
HVite is used in forced alignment mode to select the best matching pronunciations.  HVite用于强制对齐模式,以选择最佳匹配发音。
The new phone level transcriptions can then be used to retrain the HMMs  然后可以使用新的phone级转录来重新训练HMM


Transcription snippets:转录片段

CrossWord of AM training
Workflow of Crossword Acoustic Modeling in Autotrain
CrossWord of AM training

CrossWord of AM training

Input of Crossword Training:

CrossWord of AM training

CrossWord of AM training

Stage 1-Generate phone-based trans:


CrossWord of AM training

Stage 2 Generate monophone HMMs:

CrossWord of AM training

Stage 3-Generate triphone HMMs and trans

CrossWord of AM training


CrossWord of AM training

Stage 4-Bulid fully-trained triphone HMMs

CrossWord of AM training

CrossWord of AM training

Stage 5- TrainingPriors

CrossWord of AM training


Stage 6- Gender-specific HMMs

CrossWord of AM training


Output of Crossword Training

CrossWord of AM training






相关文章:

  • 2021-12-04
  • 2021-09-22
  • 2022-01-01
  • 2022-12-23
  • 2022-12-23
  • 2022-12-23
  • 2022-12-23
  • 2021-06-14
猜你喜欢
  • 2021-09-21
  • 2022-12-23
  • 2021-08-01
  • 2022-12-23
  • 2022-12-23
  • 2021-12-31
  • 2021-07-10
相关资源
相似解决方案