Empirical Learning Through Neural Networks: The Wave-Net Solution

This chapter aims to draw the framework in which neural network (NN) solutions to the problem can be developed and studied; and to show how careful considerations on the fundamental issues naturally lead to the Wave-Net solution. The analysis not only attempts to justify the development of the Wave-Net but also refines its operational characteristics. The motivation for studying the functional estimation problem is the derivation of a modeling framework suitable for process control. The problem of deriving an estimate of an unknown function from empirical data is posed and studied in a theoretical level. Then, the problem is formulated in mathematical terms and the sources of the error related to any proposed solution to the estimation problem are identified. The chapter formulates basic algorithm whose new element is the pointwise presentation of the data and the dynamic evolution of the solution itself. The need for a multi-resolution framework in representing the unknown function is recognized and the wavelet transform is proposed as the essential vehicle to satisfy this requirement. The complete algorithm has been presented and identified as the modified Wave-Net model. Modeling examples demonstrate the properties of the derived solution.