Probability and Statistical Inference

Now updated in a valuable new edition—this user-friendly book focuses on understanding the «why» of mathematical statistics Probability and Statistical Inference, Second Edition introduces key probability and statis-tical concepts through non-trivial, real-world examples and promotes the developmentof intuition rather than simple application. With its coverage of the recent advancements in computer-intensive methods, this update successfully provides the comp-rehensive tools needed to develop a broad understanding of the theory of statisticsand its probabilistic foundations. This outstanding new edition continues to encouragereaders to recognize and fully understand the why, not just the how, behind the concepts,theorems, and methods of statistics. Clear explanations are presented and appliedto various examples that help to impart a deeper understanding of theorems and methods—from fundamental statistical concepts to computational details. Additional features of this Second Edition include: A new chapter on random samples Coverage of computer-intensive techniques in statistical inference featuring Monte Carlo and resampling methods, such as bootstrap and permutation tests, bootstrap confidence intervals with supporting R codes, and additional examples available via the book's FTP site Treatment of survival and hazard function, methods of obtaining estimators, and Bayes estimating Real-world examples that illuminate presented concepts Exercises at the end of each section Providing a straightforward, contemporary approach to modern-day statistical applications, Probability and Statistical Inference, Second Edition is an ideal text for advanced undergraduate- and graduate-level courses in probability and statistical inference. It also serves as a valuable reference for practitioners in any discipline who wish to gain further insight into the latest statistical tools.

This concise, yet thorough, book is enhanced with simulations and graphs to build the intuition of readers Models for Probability and Statistical Inference was written over a five-year period and serves as a comprehensive treatment of the fundamentals of probability and statistical inference. With detailed theoretical coverage found throughout the book, readers acquire the fundamentals needed to advance to more specialized topics, such as sampling, linear models, design of experiments, statistical computing, survival analysis, and bootstrapping. Ideal as a textbook for a two-semester sequence on probability and statistical inference, early chapters provide coverage on probability and include discussions of: discrete models and random variables; discrete distributions including binomial, hypergeometric, geometric, and Poisson; continuous, normal, gamma, and conditional distributions; and limit theory. Since limit theory is usually the most difficult topic for readers to master, the author thoroughly discusses modes of convergence of sequences of random variables, with special attention to convergence in distribution. The second half of the book addresses statistical inference, beginning with a discussion on point estimation and followed by coverage of consistency and confidence intervals. Further areas of exploration include: distributions defined in terms of the multivariate normal, chi-square, t, and F (central and non-central); the one- and two-sample Wilcoxon test, together with methods of estimation based on both; linear models with a linear space-projection approach; and logistic regression. Each section contains a set of problems ranging in difficulty from simple to more complex, and selected answers as well as proofs to almost all statements are provided. An abundant amount of figures in addition to helpful simulations and graphs produced by the statistical package S-Plus(r) are included to help build the intuition of readers.

C. R. Rao would be found in almost any statistician's list of five outstanding workers in the world of Mathematical Statistics today. His book represents a comprehensive account of the main body of results that comprise modern statistical theory. -W. G. Cochran «[C. R. Rao is] one of the pioneers who laid the foundations of statistics which grew from ad hoc origins into a firmly grounded mathematical science.» -B. Efrom Translated into six major languages of the world, C. R. Rao's Linear Statistical Inference and Its Applications is one of the foremost works in statistical inference in the literature. Incorporating the important developments in the subject that have taken place in the last three decades, this paperback reprint of his classic work on statistical inference remains highly applicable to statistical analysis. Presenting the theory and techniques of statistical inference in a logically integrated and practical form, it covers: * The algebra of vectors and matrices * Probability theory, tools, and techniques * Continuous probability models * The theory of least squares and the analysis of variance * Criteria and methods of estimation * Large sample theory and methods * The theory of statistical inference * Multivariate normal distribution Written for the student and professional with a basic knowledge of statistics, this practical paperback edition gives this industry standard new life as a key resource for practicing statisticians and statisticians-in-training.

An up-to-date approach to understanding statistical inference Statistical inference is finding useful applications in numerous fields, from sociology and econometrics to biostatistics. This volume enables professionals in these and related fields to master the concepts of statistical inference under inequality constraints and to apply the theory to problems in a variety of areas. Constrained Statistical Inference: Order, Inequality, and Shape Constraints provides a unified and up-to-date treatment of the methodology. It clearly illustrates concepts with practical examples from a variety of fields, focusing on sociology, econometrics, and biostatistics. The authors also discuss a broad range of other inequality-constrained inference problems that do not fit well in the contemplated unified framework, providing a meaningful way for readers to comprehend methodological resolutions. Chapter coverage includes: Population means and isotonic regression Inequality-constrained tests on normal means Tests in general parametric models Likelihood and alternatives Analysis of categorical data Inference on monotone density function, unimodal density function, shape constraints, and DMRL functions Bayesian perspectives, including Stein’s Paradox, shrinkage estimation, and decision theory

This book provides a comprehensive and systematic approach to understanding GARCH time series models and their applications whilst presenting the most advanced results concerning the theory and practical aspects of GARCH. The probability structure of standard GARCH models is studied in detail as well as statistical inference such as identification, estimation and tests. The book also provides coverage of several extensions such as asymmetric and multivariate models and looks at financial applications. Key features: Provides up-to-date coverage of the current research in the probability, statistics and econometric theory of GARCH models. Numerous illustrations and applications to real financial series are provided. Supporting website featuring R codes, Fortran programs and data sets. Presents a large collection of problems and exercises. This authoritative, state-of-the-art reference is ideal for graduate students, researchers and practitioners in business and finance seeking to broaden their skills of understanding of econometric time series models.

A multidisciplinary approach that emphasizes learning by analyzing real-world data sets This book is the result of the authors' hands-on classroom experience and is tailored to reflect how students best learn to analyze linear relationships. The text begins with the introduction of four simple examples of actual data sets. These examples are developed and analyzed throughout the text, and more complicated examples of data sets are introduced along the way. Taking a multidisciplinary approach, the book traces the conclusion of the analyses of data sets taken from geology, biology, economics, psychology, education, sociology, and environmental science. As students learn to analyze the data sets, they master increasingly sophisticated linear modeling techniques, including: * Simple linear models * Multivariate models * Model building * Analysis of variance (ANOVA) * Analysis of covariance (ANCOVA) * Logistic regression * Total least squares The basics of statistical analysis are developed and emphasized, particularly in testing the assumptions and drawing inferences from linear models. Exercises are included at the end of each chapter to test students' skills before moving on to more advanced techniques and models. These exercises are marked to indicate whether calculus, linear algebra, or computer skills are needed. Unlike other texts in the field, the mathematics underlying the models is carefully explained and accessible to students who may not have any background in calculus or linear algebra. Most chapters include an optional final section on linear algebra for students interested in developing a deeper understanding. The many data sets that appear in the text are available on the book's Web site. The MINITAB(r) software program is used to illustrate many of the examples. For students unfamiliar with MINITAB(r), an appendix introduces the key features needed to study linear models. With its multidisciplinary approach and use of real-world data sets that bring the subject alive, this is an excellent introduction to linear models for students in any of the natural or social sciences.

A concise, easily accessible introduction to descriptive and inferential techniques Statistical Inference: A Short Course offers a concise presentation of the essentials of basic statistics for readers seeking to acquire a working knowledge of statistical concepts, measures, and procedures. The author conducts tests on the assumption of randomness and normality, provides nonparametric methods when parametric approaches might not work. The book also explores how to determine a confidence interval for a population median while also providing coverage of ratio estimation, randomness, and causality. To ensure a thorough understanding of all key concepts, Statistical Inference provides numerous examples and solutions along with complete and precise answers to many fundamental questions, including: How do we determine that a given dataset is actually a random sample? With what level of precision and reliability can a population sample be estimated? How are probabilities determined and are they the same thing as odds? How can we predict the level of one variable from that of another? What is the strength of the relationship between two variables? The book is organized to present fundamental statistical concepts first, with later chapters exploring more advanced topics and additional statistical tests such as Distributional Hypotheses, Multinomial Chi-Square Statistics, and the Chi-Square Distribution. Each chapter includes appendices and exercises, allowing readers to test their comprehension of the presented material. Statistical Inference: A Short Course is an excellent book for courses on probability, mathematical statistics, and statistical inference at the upper-undergraduate and graduate levels. The book also serves as a valuable reference for researchers and practitioners who would like to develop further insights into essential statistical tools.

A fascinating investigation into the foundations of statistical inference This publication examines the distinct philosophical foundations of different statistical modes of parametric inference. Unlike many other texts that focus on methodology and applications, this book focuses on a rather unique combination of theoretical and foundational aspects that underlie the field of statistical inference. Readers gain a deeper understanding of the evolution and underlying logic of each mode as well as each mode's strengths and weaknesses. The book begins with fascinating highlights from the history of statistical inference. Readers are given historical examples of statistical reasoning used to address practical problems that arose throughout the centuries. Next, the book goes on to scrutinize four major modes of statistical inference: * Frequentist * Likelihood * Fiducial * Bayesian The author provides readers with specific examples and counterexamples of situations and datasets where the modes yield both similar and dissimilar results, including a violation of the likelihood principle in which Bayesian and likelihood methods differ from frequentist methods. Each example is followed by a detailed discussion of why the results may have varied from one mode to another, helping the reader to gain a greater understanding of each mode and how it works. Moreover, the author provides considerable mathematical detail on certain points to highlight key aspects of theoretical development. The author's writing style and use of examples make the text clear and engaging. This book is fundamental reading for graduate-level students in statistics as well as anyone with an interest in the foundations of statistics and the principles underlying statistical inference, including students in mathematics and the philosophy of science. Readers with a background in theoretical statistics will find the text both accessible and absorbing.

Stochastic processes are widely used for model building in the social, physical, engineering and life sciences as well as in financial economics. In model building, statistical inference for stochastic processes is of great importance from both a theoretical and an applications point of view. This book deals with Fractional Diffusion Processes and statistical inference for such stochastic processes. The main focus of the book is to consider parametric and nonparametric inference problems for fractional diffusion processes when a complete path of the process over a finite interval is observable. Key features: Introduces self-similar processes, fractional Brownian motion and stochastic integration with respect to fractional Brownian motion. Provides a comprehensive review of statistical inference for processes driven by fractional Brownian motion for modelling long range dependence. Presents a study of parametric and nonparametric inference problems for the fractional diffusion process. Discusses the fractional Brownian sheet and infinite dimensional fractional Brownian motion. Includes recent results and developments in the area of statistical inference of fractional diffusion processes. Researchers and students working on the statistics of fractional diffusion processes and applied mathematicians and statisticians involved in stochastic process modelling will benefit from this book.

Stochastic processes are widely used for model building in the social, physical, engineering and life sciences as well as in financial economics. In model building, statistical inference for stochastic processes is of great importance from both a theoretical and an applications point of view. This book deals with Fractional Diffusion Processes and statistical inference for such stochastic processes. The main focus of the book is to consider parametric and nonparametric inference problems for fractional diffusion processes when a complete path of the process over a finite interval is observable. Key features: Introduces self-similar processes, fractional Brownian motion and stochastic integration with respect to fractional Brownian motion. Provides a comprehensive review of statistical inference for processes driven by fractional Brownian motion for modelling long range dependence. Presents a study of parametric and nonparametric inference problems for the fractional diffusion process. Discusses the fractional Brownian sheet and infinite dimensional fractional Brownian motion. Includes recent results and developments in the area of statistical inference of fractional diffusion processes. Researchers and students working on the statistics of fractional diffusion processes and applied mathematicians and statisticians involved in stochastic process modelling will benefit from this book.