Introduction to Linear Regression Analysis

Concise, mathematically clear, and comprehensive treatment of the subject. * Expanded coverage of diagnostics and methods of model fitting. * Requires no specialized knowledge beyond a good grasp of matrix algebra and some acquaintance with straight-line regression and simple analysis of variance models. * More than 200 problems throughout the book plus outline solutions for the exercises. * This revision has been extensively class-tested.

An easy-to-grasp introduction to nonparametric regression This book's straightforward, step-by-step approach provides an excellent introduction to the field for novices of nonparametric regression. Introduction to Nonparametric Regression clearly explains the basic concepts underlying nonparametric regression and features: * Thorough explanations of various techniques, which avoid complex mathematics and excessive abstract theory to help readers intuitively grasp the value of nonparametric regression methods * Statistical techniques accompanied by clear numerical examples that further assist readers in developing and implementing their own solutions * Mathematical equations that are accompanied by a clear explanation of how the equation was derived The first chapter leads with a compelling argument for studying nonparametric regression and sets the stage for more advanced discussions. In addition to covering standard topics, such as kernel and spline methods, the book provides in-depth coverage of the smoothing of histograms, a topic generally not covered in comparable texts. With a learning-by-doing approach, each topical chapter includes thorough S-Plus? examples that allow readers to duplicate the same results described in the chapter. A separate appendix is devoted to the conversion of S-Plus objects to R objects. In addition, each chapter ends with a set of problems that test readers' grasp of key concepts and techniques and also prepares them for more advanced topics. This book is recommended as a textbook for undergraduate and graduate courses in nonparametric regression. Only a basic knowledge of linear algebra and statistics is required. In addition, this is an excellent resource for researchers and engineers in such fields as pattern recognition, speech understanding, and data mining. Practitioners who rely on nonparametric regression for analyzing data in the physical, biological, and social sciences, as well as in finance and economics, will find this an unparalleled resource.

Mixed modelling is very useful, and easier than you think! Mixed modelling is now well established as a powerful approach to statistical data analysis. It is based on the recognition of random-effect terms in statistical models, leading to inferences and estimates that have much wider applicability and are more realistic than those otherwise obtained. Introduction to Mixed Modelling leads the reader into mixed modelling as a natural extension of two more familiar methods, regression analysis and analysis of variance. It provides practical guidance combined with a clear explanation of the underlying concepts. Like the first edition, this new edition shows diverse applications of mixed models, provides guidance on the identification of random-effect terms, and explains how to obtain and interpret best linear unbiased predictors (BLUPs). It also introduces several important new topics, including the following: Use of the software SAS, in addition to GenStat and R. Meta-analysis and the multiple testing problem. The Bayesian interpretation of mixed models. Including numerous practical exercises with solutions, this book provides an ideal introduction to mixed modelling for final year undergraduate students, postgraduate students and professional researchers. It will appeal to readers from a wide range of scientific disciplines including statistics, biology, bioinformatics, medicine, agriculture, engineering, economics, archaeology and geography. Praise for the first edition: “One of the main strengths of the text is the bridge it provides between traditional analysis of variance and regression models and the more recently developed class of mixed models…Each chapter is well-motivated by at least one carefully chosen example…demonstrating the broad applicability of mixed models in many different disciplines…most readers will likely learn something new, and those previously unfamiliar with mixed models will obtain a solid foundation on this topic.”—Kerrie Nelson University of South Carolina, in American Statistician, 2007

Mixed modelling is very useful, and easier than you think! Mixed modelling is now well established as a powerful approach to statistical data analysis. It is based on the recognition of random-effect terms in statistical models, leading to inferences and estimates that have much wider applicability and are more realistic than those otherwise obtained. Introduction to Mixed Modelling leads the reader into mixed modelling as a natural extension of two more familiar methods, regression analysis and analysis of variance. It provides practical guidance combined with a clear explanation of the underlying concepts. Like the first edition, this new edition shows diverse applications of mixed models, provides guidance on the identification of random-effect terms, and explains how to obtain and interpret best linear unbiased predictors (BLUPs). It also introduces several important new topics, including the following: Use of the software SAS, in addition to GenStat and R. Meta-analysis and the multiple testing problem. The Bayesian interpretation of mixed models. Including numerous practical exercises with solutions, this book provides an ideal introduction to mixed modelling for final year undergraduate students, postgraduate students and professional researchers. It will appeal to readers from a wide range of scientific disciplines including statistics, biology, bioinformatics, medicine, agriculture, engineering, economics, archaeology and geography. Praise for the first edition: “One of the main strengths of the text is the bridge it provides between traditional analysis of variance and regression models and the more recently developed class of mixed models…Each chapter is well-motivated by at least one carefully chosen example…demonstrating the broad applicability of mixed models in many different disciplines…most readers will likely learn something new, and those previously unfamiliar with mixed models will obtain a solid foundation on this topic.”—Kerrie Nelson University of South Carolina, in American Statistician, 2007

An outstanding introduction to the fundamentals of regression analysis-updated and expanded The methods of regression analysis are the most widely used statistical tools for discovering the relationships among variables. This classic text, with its emphasis on clear, thorough presentation of concepts and applications, offers a complete, easily accessible introduction to the fundamentals of regression analysis. Assuming only a basic knowledge of elementary statistics, Applied Regression Analysis, Third Edition focuses on the fitting and checking of both linear and nonlinear regression models, using small and large data sets, with pocket calculators or computers. This Third Edition features separate chapters on multicollinearity, generalized linear models, mixture ingredients, geometry of regression, robust regression, and resampling procedures. Extensive support materials include sets of carefully designed exercises with full or partial solutions and a series of true/false questions with answers. All data sets used in both the text and the exercises can be found on the companion disk at the back of the book. For analysts, researchers, and students in university, industrial, and government courses on regression, this text is an excellent introduction to the subject and an efficient means of learning how to use a valuable analytical tool. It will also prove an invaluable reference resource for applied scientists and statisticians.

An accessible introduction to real analysis and its connection to elementary calculus Bridging the gap between the development and history of real analysis, Introduction to Real Analysis: An Educational Approach presents a comprehensive introduction to real analysis while also offering a survey of the field. With its balance of historical background, key calculus methods, and hands-on applications, this book provides readers with a solid foundation and fundamental understanding of real analysis. The book begins with an outline of basic calculus, including a close examination of problems illustrating links and potential difficulties. Next, a fluid introduction to real analysis is presented, guiding readers through the basic topology of real numbers, limits, integration, and a series of functions in natural progression. The book moves on to analysis with more rigorous investigations, and the topology of the line is presented along with a discussion of limits and continuity that includes unusual examples in order to direct readers' thinking beyond intuitive reasoning and on to more complex understanding. The dichotomy of pointwise and uniform convergence is then addressed and is followed by differentiation and integration. Riemann-Stieltjes integrals and the Lebesgue measure are also introduced to broaden the presented perspective. The book concludes with a collection of advanced topics that are connected to elementary calculus, such as modeling with logistic functions, numerical quadrature, Fourier series, and special functions. Detailed appendices outline key definitions and theorems in elementary calculus and also present additional proofs, projects, and sets in real analysis. Each chapter references historical sources on real analysis while also providing proof-oriented exercises and examples that facilitate the development of computational skills. In addition, an extensive bibliography provides additional resources on the topic. Introduction to Real Analysis: An Educational Approach is an ideal book for upper- undergraduate and graduate-level real analysis courses in the areas of mathematics and education. It is also a valuable reference for educators in the field of applied mathematics.

Praise for the Third Edition «…this is an excellent book which could easily be used as a course text…» —International Statistical Institute The Fourth Edition of Applied Linear Regression provides a thorough update of the basic theory and methodology of linear regression modeling. Demonstrating the practical applications of linear regression analysis techniques, the Fourth Edition uses interesting, real-world exercises and examples. Stressing central concepts such as model building, understanding parameters, assessing fit and reliability, and drawing conclusions, the new edition illustrates how to develop estimation, confidence, and testing procedures primarily through the use of least squares regression. While maintaining the accessible appeal of each previous edition,Applied Linear Regression, Fourth Edition features: Graphical methods stressed in the initial exploratory phase, analysis phase, and summarization phase of an analysis In-depth coverage of parameter estimates in both simple and complex models, transformations, and regression diagnostics Newly added material on topics including testing, ANOVA, and variance assumptions Updated methodology, such as bootstrapping, cross-validation binomial and Poisson regression, and modern model selection methods Applied Linear Regression, Fourth Edition is an excellent textbook for upper-undergraduate and graduate-level students, as well as an appropriate reference guide for practitioners and applied statisticians in engineering, business administration, economics, and the social sciences.

A Comprehensive Account for Data Analysts of the Methods and Applications of Regression Analysis. Written by two established experts in the field, the purpose of the Handbook of Regression Analysis is to provide a practical, one-stop reference on regression analysis. The focus is on the tools that both practitioners and researchers use in real life. It is intended to be a comprehensive collection of the theory, methods, and applications of regression methods, but it has been deliberately written at an accessible level. The handbook provides a quick and convenient reference or “refresher” on ideas and methods that are useful for the effective analysis of data and its resulting interpretations. Students can use the book as an introduction to and/or summary of key concepts in regression and related course work (including linear, binary logistic, multinomial logistic, count, and nonlinear regression models). Theory underlying the methodology is presented when it advances conceptual understanding and is always supplemented by hands-on examples. References are supplied for readers wanting more detailed material on the topics discussed in the book. R code and data for all of the analyses described in the book are available via an author-maintained website. «I enjoyed the presentation of the Handbook, and I would be happy to recommend this nice handy book as a reference to my students. The clarity of the writing and proper choices of examples allows the presentations ofmany statisticalmethods shine. The quality of the examples at the end of each chapter is a strength. They entail explanations of the resulting R outputs and successfully guide readers to interpret them.» American Statistician

Theoretical Foundations of Functional Data Analysis, with an Introduction to Linear Operators provides a uniquely broad compendium of the key mathematical concepts and results that are relevant for the theoretical development of functional data analysis (FDA). The self–contained treatment of selected topics of functional analysis and operator theory includes reproducing kernel Hilbert spaces, singular value decomposition of compact operators on Hilbert spaces and perturbation theory for both self–adjoint and non self–adjoint operators. The probabilistic foundation for FDA is described from the perspective of random elements in Hilbert spaces as well as from the viewpoint of continuous time stochastic processes. Nonparametric estimation approaches including kernel and regularized smoothing are also introduced. These tools are then used to investigate the properties of estimators for the mean element, covariance operators, principal components, regression function and canonical correlations. A general treatment of canonical correlations in Hilbert spaces naturally leads to FDA formulations of factor analysis, regression, MANOVA and discriminant analysis. This book will provide a valuable reference for statisticians and other researchers interested in developing or understanding the mathematical aspects of FDA. It is also suitable for a graduate level special topics course.