Difference between revisions of "NLP Status Report 2017-6-5"

From cslt Wiki
Jump to: navigation, search
(以“{| class="wikitable" !Date !! People !! Last Week !! This Week |- | rowspan="6"|2017/5/31 |Jiyuan Zhang || || |- |Aodong LI || * Small data: Only make the English...”为内容创建页面)
 
Line 36: Line 36:
 
|}
 
|}
 
* experiments with '''constant''' initialized embedding:  
 
* experiments with '''constant''' initialized embedding:  
−
 
−
|}
 
  
 
||
 
||

Revision as of 05:35, 5 June 2017

Date People Last Week This Week
2017/5/31 Jiyuan Zhang
Aodong LI
  • Small data: 
 Only make the English encoder's embedding constant -- 45.98
 Only initialize the English encoder's embedding and then finetune it -- 46.06
 Share the attention mechanism and then directly add them -- 46.20
  • big data baseline bleu = 30.83
  • Fixed three embeddings
alpha beta result (bleu)
1 1 43.50
4/3 2/3 43.58 (w/o retrained)
2/3 4/3 41.22 (w/o retrained)
2/3 4/3 42.36 (w/ retrained)
  • experiments with constant initialized embedding:
Shiyue Zhang
Shipan Ren
Retrieved from "http://cslt.riit.tsinghua.edu.cn/mediawiki/index.php?title=NLP_Status_Report_2017-6-5&oldid=27354"