From cslt Wiki
Revision as of 03:02, 6 March 2017 by Zhangsy (Talk | contribs)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search
Date People Last Week This Week
2017/1/3 Yang Feng
Jiyuan Zhang
Andi Zhang
Shiyue Zhang
  • figured out the problem of attention: the initial value of V should be around 0
  • tested different modification, such as add mask, init b with 0. Compared the results, and concluded only change the initial value of V is the best.
  • try to get right attention on memory
Peilun Xiao