Regression Analysis by Example

Praise for the Fourth Edition: «This book is . . . an excellent source of examples for regression analysis. It has been and still is readily readable and understandable.» —Journal of the American Statistical Association Regression analysis is a conceptually simple method for investigating relationships among variables. Carrying out a successful application of regression analysis, however, requires a balance of theoretical results, empirical rules, and subjective judgment. Regression Analysis by Example, Fifth Edition has been expanded and thoroughly updated to reflect recent advances in the field. The emphasis continues to be on exploratory data analysis rather than statistical theory. The book offers in-depth treatment of regression diagnostics, transformation, multicollinearity, logistic regression, and robust regression. The book now includes a new chapter on the detection and correction of multicollinearity, while also showcasing the use of the discussed methods on newly added data sets from the fields of engineering, medicine, and business. The Fifth Edition also explores additional topics, including: Surrogate ridge regression Fitting nonlinear models Errors in variables ANOVA for designed experiments Methods of regression analysis are clearly demonstrated, and examples containing the types of irregularities commonly encountered in the real world are provided. Each example isolates one or two techniques and features detailed discussions, the required assumptions, and the evaluated success of each technique. Additionally, methods described throughout the book can be carried out with most of the currently available statistical software packages, such as the software package R. Regression Analysis by Example, Fifth Edition is suitable for anyone with an understanding of elementary statistics.

Introduces the key concepts in the analysis of categoricaldata with illustrative examples and accompanying R code This book is aimed at all those who wish to discover how to analyze categorical data without getting immersed in complicated mathematics and without needing to wade through a large amount of prose. It is aimed at researchers with their own data ready to be analyzed and at students who would like an approachable alternative view of the subject. Each new topic in categorical data analysis is illustrated with an example that readers can apply to their own sets of data. In many cases, R code is given and excerpts from the resulting output are presented. In the context of log-linear models for cross-tabulations, two specialties of the house have been included: the use of cobweb diagrams to get visual information concerning significant interactions, and a procedure for detecting outlier category combinations. The R code used for these is available and may be freely adapted. In addition, this book: Uses an example to illustrate each new topic in categorical data Provides a clear explanation of an important subject Is understandable to most readers with minimal statistical and mathematical backgrounds Contains examples that are accompanied by R code and resulting output Includes starred sections that provide more background details for interested readers Categorical Data Analysis by Example is a reference for students in statistics and researchers in other disciplines, especially the social sciences, who use categorical data. This book is also a reference for practitioners in market research, medicine, and other fields.

An outstanding introduction to the fundamentals of regression analysis-updated and expanded The methods of regression analysis are the most widely used statistical tools for discovering the relationships among variables. This classic text, with its emphasis on clear, thorough presentation of concepts and applications, offers a complete, easily accessible introduction to the fundamentals of regression analysis. Assuming only a basic knowledge of elementary statistics, Applied Regression Analysis, Third Edition focuses on the fitting and checking of both linear and nonlinear regression models, using small and large data sets, with pocket calculators or computers. This Third Edition features separate chapters on multicollinearity, generalized linear models, mixture ingredients, geometry of regression, robust regression, and resampling procedures. Extensive support materials include sets of carefully designed exercises with full or partial solutions and a series of true/false questions with answers. All data sets used in both the text and the exercises can be found on the companion disk at the back of the book. For analysts, researchers, and students in university, industrial, and government courses on regression, this text is an excellent introduction to the subject and an efficient means of learning how to use a valuable analytical tool. It will also prove an invaluable reference resource for applied scientists and statisticians.

Concise, mathematically clear, and comprehensive treatment of the subject. * Expanded coverage of diagnostics and methods of model fitting. * Requires no specialized knowledge beyond a good grasp of matrix algebra and some acquaintance with straight-line regression and simple analysis of variance models. * More than 200 problems throughout the book plus outline solutions for the exercises. * This revision has been extensively class-tested.

A Comprehensive Account for Data Analysts of the Methods and Applications of Regression Analysis. Written by two established experts in the field, the purpose of the Handbook of Regression Analysis is to provide a practical, one-stop reference on regression analysis. The focus is on the tools that both practitioners and researchers use in real life. It is intended to be a comprehensive collection of the theory, methods, and applications of regression methods, but it has been deliberately written at an accessible level. The handbook provides a quick and convenient reference or “refresher” on ideas and methods that are useful for the effective analysis of data and its resulting interpretations. Students can use the book as an introduction to and/or summary of key concepts in regression and related course work (including linear, binary logistic, multinomial logistic, count, and nonlinear regression models). Theory underlying the methodology is presented when it advances conceptual understanding and is always supplemented by hands-on examples. References are supplied for readers wanting more detailed material on the topics discussed in the book. R code and data for all of the analyses described in the book are available via an author-maintained website. «I enjoyed the presentation of the Handbook, and I would be happy to recommend this nice handy book as a reference to my students. The clarity of the writing and proper choices of examples allows the presentations ofmany statisticalmethods shine. The quality of the examples at the end of each chapter is a strength. They entail explanations of the resulting R outputs and successfully guide readers to interpret them.» American Statistician

A comprehensive and current introduction to the fundamentals of regression analysis Introduction to Linear Regression Analysis, 6th Edition is the most comprehensive, fulsome, and current examination of the foundations of linear regression analysis. Fully updated in this new sixth edition, the distinguished authors have included new material on generalized regression techniques and new examples to help the reader understand retain the concepts taught in the book. The new edition focuses on four key areas of improvement over the fifth edition: New exercises and data sets New material on generalized regression techniques The inclusion of JMP software in key areas Carefully condensing the text where possible Introduction to Linear Regression Analysis skillfully blends theory and application in both the conventional and less common uses of regression analysis in today's cutting-edge scientific research. The text equips readers to understand the basic principles needed to apply regression model-building techniques in various fields of study, including engineering, management, and the health sciences.

The first text to bridge the gap between image processing and jump regression analysis Recent statistical tools developed to estimate jump curves and surfaces have broad applications, specifically in the area of image processing. Often, significant differences in technical terminologies make communication between the disciplines of image processing and jump regression analysis difficult. In easy-to-understand language, Image Processing and Jump Regression Analysis builds a bridge between the worlds of computer graphics and statistics by addressing both the connections and the differences between these two disciplines. The author provides a systematic analysis of the methodology behind nonparametric jump regression analysis by outlining procedures that are easy to use, simple to compute, and have proven statistical theory behind them. Key topics include: Conventional smoothing procedures Estimation of jump regression curves Estimation of jump location curves of regression surfaces Jump-preserving surface reconstruction based on local smoothing Edge detection in image processing Edge-preserving image restoration With mathematical proofs kept to a minimum, this book is uniquely accessible to a broad readership. It may be used as a primary text in nonparametric regression analysis and image processing as well as a reference guide for academicians and industry professionals focused on image processing or curve/surface estimation.

A thorough review of the most current regression methods in time series analysis Regression methods have been an integral part of time series analysis for over a century. Recently, new developments have made major strides in such areas as non-continuous data where a linear model is not appropriate. This book introduces the reader to newer developments and more diverse regression models and methods for time series analysis. Accessible to anyone who is familiar with the basic modern concepts of statistical inference, Regression Models for Time Series Analysis provides a much-needed examination of recent statistical developments. Primary among them is the important class of models known as generalized linear models (GLM) which provides, under some conditions, a unified regression theory suitable for continuous, categorical, and count data. The authors extend GLM methodology systematically to time series where the primary and covariate data are both random and stochastically dependent. They introduce readers to various regression models developed during the last thirty years or so and summarize classical and more recent results concerning state space models. To conclude, they present a Bayesian approach to prediction and interpolation in spatial data adapted to time series that may be short and/or observed irregularly. Real data applications and further results are presented throughout by means of chapter problems and complements. Notably, the book covers: * Important recent developments in Kalman filtering, dynamic GLMs, and state-space modeling * Associated computational issues such as Markov chain, Monte Carlo, and the EM-algorithm * Prediction and interpolation * Stationary processes

Incorporates mixed-effects modeling techniques for more powerful and efficient methods This book presents current and effective nonparametric regression techniques for longitudinal data analysis and systematically investigates the incorporation of mixed-effects modeling techniques into various nonparametric regression models. The authors emphasize modeling ideas and inference methodologies, although some theoretical results for the justification of the proposed methods are presented. With its logical structure and organization, beginning with basic principles, the text develops the foundation needed to master advanced principles and applications. Following a brief overview, data examples from biomedical research studies are presented and point to the need for nonparametric regression analysis approaches. Next, the authors review mixed-effects models and nonparametric regression models, which are the two key building blocks of the proposed modeling techniques. The core section of the book consists of four chapters dedicated to the major nonparametric regression methods: local polynomial, regression spline, smoothing spline, and penalized spline. The next two chapters extend these modeling techniques to semiparametric and time varying coefficient models for longitudinal data analysis. The final chapter examines discrete longitudinal data modeling and analysis. Each chapter concludes with a summary that highlights key points and also provides bibliographic notes that point to additional sources for further study. Examples of data analysis from biomedical research are used to illustrate the methodologies contained throughout the book. Technical proofs are presented in separate appendices. With its focus on solving problems, this is an excellent textbook for upper-level undergraduate and graduate courses in longitudinal data analysis. It is also recommended as a reference for biostatisticians and other theoretical and applied research statisticians with an interest in longitudinal data analysis. Not only do readers gain an understanding of the principles of various nonparametric regression methods, but they also gain a practical understanding of how to use the methods to tackle real-world problems.