Complex-Valued Neural Networks. Advances and Applications

This book was written in response to the growing demand for a text that provides a unified treatment of linear and nonlinear complex valued adaptive filters, and methods for the processing of general complex signals (circular and noncircular). It brings together adaptive filtering algorithms for feedforward (transversal) and feedback architectures and the recent developments in the statistics of complex variable, under the powerful frameworks of CR (Wirtinger) calculus and augmented complex statistics. This offers a number of theoretical performance gains, which is illustrated on both stochastic gradient algorithms, such as the augmented complex least mean square (ACLMS), and those based on Kalman filters. This work is supported by a number of simulations using synthetic and real world data, including the noncircular and intermittent radar and wind signals.

State-of-the-art coverage of Kalman filter methods for the design of neural networks This self-contained book consists of seven chapters by expert contributors that discuss Kalman filtering as applied to the training and use of neural networks. Although the traditional approach to the subject is almost always linear, this book recognizes and deals with the fact that real problems are most often nonlinear. The first chapter offers an introductory treatment of Kalman filters with an emphasis on basic Kalman filter theory, Rauch-Tung-Striebel smoother, and the extended Kalman filter. Other chapters cover: An algorithm for the training of feedforward and recurrent multilayered perceptrons, based on the decoupled extended Kalman filter (DEKF) Applications of the DEKF learning algorithm to the study of image sequences and the dynamic reconstruction of chaotic processes The dual estimation problem Stochastic nonlinear dynamics: the expectation-maximization (EM) algorithm and the extended Kalman smoothing (EKS) algorithm The unscented Kalman filter Each chapter, with the exception of the introduction, includes illustrative applications of the learning algorithms described here, some of which involve the use of simulated and real-life data. Kalman Filtering and Neural Networks serves as an expert resource for researchers in neural networks and nonlinear dynamical systems. An Instructor's Manual presenting detailed solutions to all the problems in the book is available upon request from the Wiley Makerting Department.

A step-by-step introduction to modeling, training, and forecasting using wavelet networks Wavelet Neural Networks: With Applications in Financial Engineering, Chaos, and Classification presents the statistical model identification framework that is needed to successfully apply wavelet networks as well as extensive comparisons of alternate methods. Providing a concise and rigorous treatment for constructing optimal wavelet networks, the book links mathematical aspects of wavelet network construction to statistical modeling and forecasting applications in areas such as finance, chaos, and classification. The authors ensure that readers obtain a complete understanding of model identification by providing in-depth coverage of both model selection and variable significance testing. Featuring an accessible approach with introductory coverage of the basic principles of wavelet analysis, Wavelet Neural Networks: With Applications in Financial Engineering, Chaos, and Classification also includes: • Methods that can be easily implemented or adapted by researchers, academics, and professionals in identification and modeling for complex nonlinear systems and artificial intelligence • Multiple examples and thoroughly explained procedures with numerous applications ranging from financial modeling and financial engineering, time series prediction and construction of confidence and prediction intervals, and classification and chaotic time series prediction • An extensive introduction to neural networks that begins with regression models and builds to more complex frameworks • Coverage of both the variable selection algorithm and the model selection algorithm for wavelet networks in addition to methods for constructing confidence and prediction intervals Ideal as a textbook for MBA and graduate-level courses in applied neural network modeling, artificial intelligence, advanced data analysis, time series, and forecasting in financial engineering, the book is also useful as a supplement for courses in informatics, identification and modeling for complex nonlinear systems, and computational finance. In addition, the book serves as a valuable reference for researchers and practitioners in the fields of mathematical modeling, engineering, artificial intelligence, decision science, neural networks, and finance and economics.

This book contains 26 papers from the Magnetoelectric Multiferroic Thin Films and Multilayers; Dielectric Ceramic Materials and Electronic Devices; Recent Developments in High-Temperature Superconductivity; and Multifunctional Oxides symposia held during the 2010 Materials Science and Technology (MS&T'10) meeting, October 17-21, 2010, Houston, Texas. Topics include: Properties; Structures; Synthesis; Characterization; Device Applications; Multiferroics and Magnetoelectrics; YBCO Pinning Methods and Properties; YBCO Processing and Reliability Related Issues; New Superconductors and MgB2.

A key resource and framework for assessing the performance of competing entities, including forecasting models Advances in DEA Theory and Applications provides a much-needed framework for assessing the performance of competing entities with special emphasis on forecasting models. It helps readers to determine the most appropriate methodology in order to make the most accurate decisions for implementation. Written by a noted expert in the field, this text provides a review of the latest advances in DEA theory and applications to the field of forecasting. Designed for use by anyone involved in research in the field of forecasting or in another application area where forecasting drives decision making, this text can be applied to a wide range of contexts, including education, health care, banking, armed forces, auditing, market research, retail outlets, organizational effectiveness, transportation, public housing, and manufacturing. This vital resource: Explores the latest developments in DEA frameworks for the performance evaluation of entities such as public or private organizational branches or departments, economic sectors, technologies, and stocks Presents a novel area of application for DEA; namely, the performance evaluation of forecasting models Promotes the use of DEA to assess the performance of forecasting models in a wide area of applications Provides rich, detailed examples and case studies Advances in DEA Theory and Applications includes information on a balanced benchmarking tool that is designed to help organizations examine their assumptions about their productivity and performance.

With contributed papers from the 2011 Materials Science & Technology symposia, this is a useful one-stop resource for understanding the most important issues in the advances and applications of electroceramics. Logically organized and carefully selected, the articles cover the themes of the symposia: Magnetoelectric Multiferroic Thin Films and Multilayers; Dielectric Ceramic Materials and Electronic Devices; and Multifunctional Oxide. An essential reference for government labs and academics in mechanical and chemical engineering, materials and or ceramics, and chemistry.

Blind identification consists of estimating a multi-dimensional system only through the use of its output, and source separation, the blind estimation of the inverse of the system. Estimation is generally carried out using different statistics of the output. The authors of this book consider the blind identification and source separation problem in the complex-domain, where the available statistical properties are richer and include non-circularity of the sources – underlying components. They define identifiability conditions and present state-of-the-art algorithms that are based on algebraic methods as well as iterative algorithms based on maximum likelihood theory. Contents 1. Mathematical Preliminaries. 2. Estimation by Joint Diagonalization. 3. Maximum Likelihood ICA. About the Authors Eric Moreau is Professor of Electrical Engineering at the University of Toulon, France. His research interests concern statistical signal processing, high order statistics and matrix/tensor decompositions with applications to data analysis, telecommunications and radar. T?lay Adali is Professor of Electrical Engineering and Director of the Machine Learning for Signal Processing Laboratory at the University of Maryland, Baltimore County, USA. Her research interests concern statistical and adaptive signal processing, with an emphasis on nonlinear and complex-valued signal processing, and applications in biomedical data analysis and communications. Blind identification consists of estimating a multidimensional system through the use of only its output. Source separation is concerned with the blind estimation of the inverse of the system. The estimation is generally performed by using different statistics of the outputs. The authors consider the blind estimation of a multiple input/multiple output (MIMO) system that mixes a number of underlying signals of interest called sources. They also consider the case of direct estimation of the inverse system for the purpose of source separation. They then describe the estimation theory associated with the identifiability conditions and dedicated algebraic algorithms. The algorithms depend critically on (statistical and/or time frequency) properties of complex sources that will be precisely described.

This book focuses heavily on the principles, analysis and applications of code-division multiple-access (CDMA) techniques in optical communication systems and networks. In this book, the authors intimately discuss modern optical networks and their applications in current and emerging communication technologies, evaluating the quality, speed and number of supported services. In particular, principles and fundamentals of optical CDMA techniques from beginner to advanced levels are heavily covered. Furthermore, the authors concentrate on methods and techniques of various encoding and decoding schemes and their structures, as well as analysis of optical CDMA systems with various transceiver models including advanced multi-level incoherent and coherent modulations with the architecture of access/aggregation networks in mind. Moreover, authors examine intriguing topics of optical CDMA networking, compatibility with IP networks, and implementation of optical multi-rate multi-service CDMA networks. Key features: Expanded coverage of optical CDMA networks, starts from principles and fundamentals Comprehensive mathematical modelling and analysis from signal to system levels Addresses the applications of modern optical networking in the current and emerging communication technologies Greater focus on advanced optical multi-level incoherent and coherent modulations, spreading codes, and transceiver designs Detailed hardware specifications, system-level block diagrams, and network nodes’ functionalities This book appeals to researchers, practicing engineers, and advanced students. It is a practical resource for readers with an interest in optical communications and networks.

A comprehensive, coherent, and in depth presentation of the state of the art in fuzzy clustering. Fuzzy clustering is now a mature and vibrant area of research with highly innovative advanced applications. Encapsulating this through presenting a careful selection of research contributions, this book addresses timely and relevant concepts and methods, whilst identifying major challenges and recent developments in the area. Split into five clear sections, Fundamentals, Visualization, Algorithms and Computational Aspects, Real-Time and Dynamic Clustering, and Applications and Case Studies, the book covers a wealth of novel, original and fully updated material, and in particular offers: a focus on the algorithmic and computational augmentations of fuzzy clustering and its effectiveness in handling high dimensional problems, distributed problem solving and uncertainty management. presentations of the important and relevant phases of cluster design, including the role of information granules, fuzzy sets in the realization of human-centricity facet of data analysis, as well as system modelling demonstrations of how the results facilitate further detailed development of models, and enhance interpretation aspects a carefully organized illustrative series of applications and case studies in which fuzzy clustering plays a pivotal role This book will be of key interest to engineers associated with fuzzy control, bioinformatics, data mining, image processing, and pattern recognition, while computer engineers, students and researchers, in most engineering disciplines, will find this an invaluable resource and research tool.

The presentation of a novel theory in orthogonal regression The literature about neural-based algorithms is often dedicated to principal component analysis (PCA) and considers minor component analysis (MCA) a mere consequence. Breaking the mold, Neural-Based Orthogonal Data Fitting is the first book to start with the MCA problem and arrive at important conclusions about the PCA problem. The book proposes several neural networks, all endowed with a complete theory that not only explains their behavior, but also compares them with the existing neural and traditional algorithms. EXIN neurons, which are of the authors' invention, are introduced, explained, and analyzed. Further, it studies the algorithms as a differential geometry problem, a dynamic problem, a stochastic problem, and a numerical problem. It demonstrates the novel aspects of its main theory, including its applications in computer vision and linear system identification. The book shows both the derivation of the TLS EXIN from the MCA EXIN and the original derivation, as well as: Shows TLS problems and gives a sketch of their history and applications Presents MCA EXIN and compares it with the other existing approaches Introduces the TLS EXIN neuron and the SCG and BFGS acceleration techniques and compares them with TLS GAO Outlines the GeTLS EXIN theory for generalizing and unifying the regression problems Establishes the GeMCA theory, starting with the identification of GeTLS EXIN as a generalization eigenvalue problem In dealing with mathematical and numerical aspects of EXIN neurons, the book is mainly theoretical. All the algorithms, however, have been used in analyzing real-time problems and show accurate solutions. Neural-Based Orthogonal Data Fitting is useful for statisticians, applied mathematics experts, and engineers.