A Transformation for Implementing Efficient Dynamic Backpropagation Networks.pdfVIP

In proceedings of the International Conference on Artificial Neural Networks and Genetic Algorithms , pp. 41-44, 1995. A TRANSFORMATION FOR IMPLEMENTING EFFICIENT DYNAMIC BACKPROPAGATION NEURAL NETWORKS George L. Rudolph and Tony R. Martinez Computer Science Department, Brigham Young University, Provo, Utah 84602 e-mail: george@axon.cs.byu.edu, martinez@cs.byu.edu Abstract Most Artificial Neural Networks (ANNs) have a fixed topology during learning, and often suffer from a number of short-comings as a result. Variations of ANNs that use dynamic topologies have shown ability to overcome many of these problems. This paper introduces Location-Independent Transformations (LITs) as a general strategy for implementing distributed feedforward networks that use dynamic topologies (dynamic ANNs) efficiently in parallel hardware. A LIT creates a set of location-independent nodes, where each node computes its part of the network output independent of other nodes, using local information. This type of transformation allows efficient support for adding and deleting nodes dynamically during learning. In particular, this paper presents an LIT for standard Backpropagation with two layers of weights, and shows how dynamic extensions to Backpropagation can be supported. 1. INTRODUCTION This paper proposes a strategy for implementing standard and dynamic backpropagation neural networks in parallel hardware: LIT BP (Location-Independent Transformation for Backpropagation Networks). LIT BP is part of an effort to develop a general strategy (called LIT) for implementing ANNs. This