ASR:2015-01-26

From cslt Wiki
Jump to: navigation, search

Speech Processing

AM development

Environment

  • May gpu760 of grid-14 has been repairing.
  • grid-11 often shutdown automatically, too slow computation speed.

RNN AM

Dropout & Maxout & rectifier

  • Need to solve the too small learning-rate problem
  • 20h small scale sparse dnn with rectifier. --Chao liu
  • 20h small scale sparse dnn with Maxout/rectifier based on weight-magnitude-pruning. --Mengyuan Zhao

Convolutive network

  • Convolutive network(DAE)

DNN-DAE(Deep Auto-Encode-DNN)

RNN-DAE(Deep based Auto-Encode-RNN)

VAD

  • DAE
  • Technical report --Shi Yin

Speech rate training

Confidence

  • Reproduce the experiments on fisher dataset.
  • Use the fisher DNN model to decode all-wsj dataset
  • preparing scoring for puqiang data
  • HOLD

Neural network visulization

Speaker ID

Language ID

Voice Conversion

  • Yiye is reading materials
  • HOLD


Text Processing

LM development

Domain specific LM

  • LM2.1
  • mix the sougou2T-lm,kn-discount continue
  • train a large lm using 25w-dict.(hanzhenglong/wxx)
  • add more data including poi, document information.
  • add v1.0 vocab and filter the useless word
  • set the test set

tag LM

  • Tag Lm
  • tag Probability should test add the weight(hanzhenglong) and handover to hanzhenglong ("this month")
  • similar word extension in FST
  • write a draft of a paper
  • result :16.32->10.23

RNN LM

  • rnn
  • test wer RNNLM on Chinese data from jietong-data
  • generate the ngram model from rnnlm and test the ppl with different size txt.
  • lstm+rnn
  • check the lstm-rnnlm code about how to Initialize and update learning rate.(hold)

Word2Vector

W2V based doc classification

  • data prepare.

Knowledge vector

  • Knowledge vector
  • run the big data
  • prepare the paper.
  • result

Character to word

  • Character to word conversion(hold)

Translation

  • v5.0 demo released
  • cut the dict and use new segment-tool

Sparse NN in NLP

  • write a technical report

QA

improve fuzzy match

  • add Synonyms similarity using MERT-4 method(hold)

improve lucene search

  • add more feature to improve search.
  • POS, NER ,tf ,idf ..
  • extract more features about lexical, syntactic and semantic to improve re-ranking performance.
  • using sentence vector

context framework

  • code for organization
  • change to knowledge graph

query normalization

  • using NER to normalize the word
  • new inter will install SEMPRE