Gundram   Leifert
Tobias   Strauß
Roger   Labahn
Welf   Wustlich

A new Approach for Cells in Multidimensional Recurrent Neural Networks

Preprint series:   Preprints aus dem Institut für Mathematik, Universität Rostock

MSC: -  

Abstract:   A recent approach for offline handwriting recognition is to use multidimensional recurrent neural networks (MDRNN) with connectionist temporal classification which has shown to yield very good results on several datasets. MDRNNs contain special units – multidimensional Long Short-Term Memory (MDLSTM) cells. These cells suffer from instability especially for higher dimensionality. We analyze the reasons for this effect and introduce several cells with better stability. We present a method to design stable multidimensional cells using the theory of linear shift invariant systems. The new cells are compared to MDLSTMs on the Arabic and French ICDAR datasets, where they yield better results.

Keywords:   -

karin.martin@uni-rostock.de
Seite generiert am 15.01.2013,   14:44   Uhr