Difference between revisions of "NLP Status Report 2017-1-3"

From cslt Wiki
Jump to: navigation, search
Line 27: Line 27:
 
|-
 
|-
 
|Shiyue Zhang ||  
 
|Shiyue Zhang ||  
* tried to add true action info when training gate, which got better results than no true actions, but still not very good.
+
* tried to improve rnng+mm model, but still failed  [[http://cslt.riit.tsinghua.edu.cn/mediawiki/images/9/9f/RNNG%2Bmm_experiment_report.pdf report]]
* tried different scale vectors, and found setting >=-5000 is good
+
* stop rnng work to help Teacher Feng with NMT
* tried to change cos to only inner product, and inner product is better than cos.
+
* ran theano NMT code successfully, and found a problem of test
* [[http://cslt.riit.tsinghua.edu.cn/mediawiki/images/9/9f/RNNG%2Bmm_experiment_report.pdf report]]
+
* read 3 papers [[http://cslt.riit.tsinghua.edu.cn/mediawiki/images/9/92/DEEP_BIAFFINE_ATTENTION_FOR_NEURAL_DEPENDENCY_PARSING.pdf]] [[http://cslt.riit.tsinghua.edu.cn/mediawiki/images/a/aa/Simple_and_Accurate_Dependency_Parsing_Using_Bidirectional_LSTM_Feature_Representations.pdf]] [[http://cslt.riit.tsinghua.edu.cn/mediawiki/images/f/fb/Bi-directional_Attention_with_Agreement_for_Dependency_Parsing.pdf]]
+
* trying the joint training, which got a problem of optimization.
+
 
||
 
||
* try the joint training
+
* run and test the theano NMT model
* read more papers and write a summary
+
* try to modify tensorflow NMT model, run and test
 
|-
 
|-
 
|Guli ||
 
|Guli ||

Revision as of 06:03, 3 January 2017

Date People Last Week This Week
2016/12/26 Yang Feng
  • nmt+mn: tried to improve the nmt baseline;
  • read the code of Andy's;
  • wrote the code for bleu evaluation;
  • finished the code of nmt+mn;
  • ran experiments;
Jiyuan Zhang
  • integrated tone_model to attention_model for insteading manul rule,but the effect wasn't good
  • replacing all_pz rule with half_pz
  • token a classical Chinese as input,generated poem [1]
  • improve poem model
Andi Zhang
  • handed in previous codes to Mrs.Feng
  • help Jiyuan gather poems about tianyuan
  • help Jiyuan with his work
  • gather more poems
Shiyue Zhang
  • tried to improve rnng+mm model, but still failed [report]
  • stop rnng work to help Teacher Feng with NMT
  • ran theano NMT code successfully, and found a problem of test
  • run and test the theano NMT model
  • try to modify tensorflow NMT model, run and test
Guli
  • finished the first draft of the survey
  • voice tagging
  • morpheme-based nmt
  • improve nmt with monolingual data
Peilun Xiao
  • learned tf-idf algorithm
  • coded tf-idf alogrithm in python,but found it not worked well
  • tried to use small dataset to test the program
  • use sklearn tfidf to test the dataset