Multivariate Analysis: Methods And Applications

Kernel methods have long been established as effective techniques in the framework of machine learning and pattern recognition, and have now become the standard approach to many remote sensing applications.

Scientists and others today often collect samples of curves and other functional observations. This monograph presents many ideas and techniques for such data. Included are expressions in the functional domain of such classics as linear regression, principal components analysis, linear modeling, and canonical correlation analysis, as well as specifically functional techniques such as curve registration and principal differential analysis. Data arising in real applications are used throughout for both motivation and illustration, showing how functional approaches allow us to see new things, especially by exploiting the smoothness of the processes generating the data. The data sets exemplify the wide scope of functional data analysis; they are drawn from growth analysis, meteorology, biomechanics, equine science, economics, and medicine.

It has been evident from many years of research work in the geohydrologic sciences that a summary of relevant past work, present work, and needed future work in multivariate statistics with geohydrologic applications is not only desirable, but is necessary.

The use of methods of time series analysis in the study of multivariate time series has become of increased interest in recent years. Although the methods are rather well developed and understood for univarjate time series analysis, the situation is not so complete for the multivariate case. This book is designed to introduce the basic concepts and methods that are useful in the analysis and modeling of multivariate time series, with illustrations of these basic ideas. The development includes both traditional topics such as autocovariance and auto­ correlation matrices of stationary processes, properties of vector ARMA models, forecasting ARMA processes, least squares and maximum likelihood estimation techniques for vector AR and ARMA models, and model checking diagnostics for residuals, as well as topics of more recent interest for vector ARMA models such as reduced rank structure, structural indices, scalar component models, canonical correlation analyses for vector time series, multivariate unit-root models and cointegration structure, and state-space models and Kalman filtering techniques and applications.

The three decades which have followed the publication of Heinz Neudecker's seminal paper `Some Theorems on Matrix Differentiation with Special Reference to Kronecker Products' in the Journal of the American Statistical Association (1969) have witnessed the growing influence of matrix analysis in many scientific disciplines. Amongst these are the disciplines to which Neudecker has contributed directly - namely econometrics, economics, psychometrics and multivariate analysis.