機器學習-圖像識別-5

1、圖像識別 -5RNN/LSTMLanguage ModelsTraditional Language ModelsTraditional Language ModelsRecurrent Neural NetworksRecurrent Neural Network language modelRecurrent Neural Network language modelRecurrent Neural Network language modelRecurrent Neural Network language modelTraining RNNVanishing/exploding gra

2、dientVanishing/exploding gradientVanishing/exploding gradientVanishing/exploding gradientVanishing/exploding gradientTricks for exploding gradient - clipping trickSequential modelingSequential modelingBidirectional RNNDeep Bidirectional RNNStatistical machine translationAlignmentAlignmentAlignmentAl

3、ignmentDecode:Search for best ofmany hypothesesTraditional MTDeep learning for MTRNN Translation modelRNN Translation modelRNN Translation modelBetter unitsGRUsGRUsGRU intuitionLong-short-term-memories(LSTMs)Long-short-term-memories(LSTMs)LSTMs are very popular Default model for most sequence labeli

4、ngtasks Very powerful, especially when stacked and made even deeper Need lots of dataVisualization of different gates文章Learning Phrase Representations using RNN EncoderDecoder for Statistical Machine Translation Sequence to Sequence Learning with Neural Networks LSTM: A Search Space Odyssey http:/colah.github.io/posts/2015-08-Understanding-LSTMs/ http:/karpathy.github.io/2015/05/21/rnn-effectiveness/