Your Search Results

Use this resource - and many more! - in your textbook!

AcademicPub holds over eight million pieces of educational content for you to mix-and-match your way.

Experience the freedom of customizing your course pack with AcademicPub!
Not an educator but still interested in using this content? No problem! Visit our provider's page to contact the publisher and get permission directly.

Method of digging tunnels horizontally into the error hypersurface to speed up training and to escape from local minima

By: Shaowei Xia; Xun Liang; Jihong Du;

1994 / IEEE / 0-7803-1901-X

Description

This item was taken from the IEEE Periodical ' Method of digging tunnels horizontally into the error hypersurface to speed up training and to escape from local minima ' In this paper, a general compressing method is reviewed systematically at first. Then the idea and steps of digging horizontally into the error hypersurface are presented, as well as an example. Since there exists serious and complex nonlinearity in the error hypersurface, training by gradient descending techniques is often too slow when it is on a plateau and has the risk of trapping into local minima. Digging tunnels into the error hypersurface by means of rotation transformation will lead to the plateau to speed up the training or skip from local minima.<>